Evaluation of the consumer - directed care initiative - Final Report
3.5 Methodological approach
- Executive summary
- Glossary
1 Introduction- 2 The consumer-directed care initiative
3 Evaluation of the consumer-directed care initiative- 4 Profile of participants and the supports they accessed
- 5 Implementation and operation of the initiative
- 6 Impact of the initiative for CDC participants and their carers
- 7 Impact of the initiative for CDRC participants and the people they care for
- 8 Impact on providers and the broader service system
- 9 Cost assessment and cost-effectiveness of the initiative
- 10 Key findings
- 11 Lessons learnt and strategies for consideration
- Appendices
- References
The methodological approach underpinning the evaluation recognised the need to undertake the evaluation at two levels (outcomes and process), and to evaluate the two CDC components (packaged care and respite care) separately.
Figure 2 below summarises the links between the different levels and elements of the evaluation.
Figure 2: Components and key elements of the CDC evaluation
This figure in the HTML version is displayed as text for accessibility requirements. It is displayed as a figure in the PDF version.Process evaluation
Effectiveness of packaged CDC (implementation and operation)Effectiveness of CDC respite care (implementation and operation)
Outcome evaluation
Effectiveness of packaged CDC (outcomes)Effectiveness of CDC respite care (outcomes)
Cost effectiveness assessment
Costs and cost effectiveness of packaged CDCCosts and cost effectiveness of CDC respite care
An Evaluation Framework was developed to guide each stage of the evaluation. The framework included a number of evaluation tools (consumer and carer surveys and service provider data collection templates) to collect the data for the evaluation. Ethics Committee approval was granted for the data collection tools.
A mixed method approach to data collection was used, using a mix of quantitative and qualitative methods appropriate to the target groups. The range of data collection methods used in the evaluation is described below:
Participant and comparison group surveys
Paper-based surveys were sent to all CDC and CDRC participants as well as an equal number of people in packaged care and respite comparison groups in June 2011. The surveys sought participants’ perspectives of the impact and benefits of CDC/CDRC compared with standard packaged care, as well as their experiences relating to the planning, budgeting and service delivery aspects of CDC/CDRC.In addition, the surveys included the five-item ICECAP-O tool to derive a single measure of wellbeing for each of the CDC and CDRC participant and comparison groups3. The ICECAP-O provides a broader measure of wellbeing and ‘quality of life’ than other validated tools available (such as the AQoL4 or EQ-5D5), which generally focus on health-related quality of life or health outcomes and which may not have been designed specifically for older people.
Service provider data collection
Two service provider data collections were completed by CDC and CDRC providers: in July 2011 (covering the period 1 April to 30 June 2011) and in October 2011 (covering the period 1 July to 30 September 2011). The data collected related to CDC/CDRC participant characteristics, supports accessed and package expenditure for each participant, and development and ongoing costs incurred by CDC/CDRC providers.Participant and provider interviews
Semi-structured interviews were conducted with 51 CDC participants and carers of CDC participants, and 27 CDRC participants. Interviews were conducted in-person and by telephone.Interviews were also conducted with 26 providers: 16 CDC providers and 10 CDRC providers. Interviews were conducted with a mix of providers across States/Territories, metropolitan and regional areas, small and large providers, and those targeting different special needs groups.
3. The ‘ICEpop CAPability measure for older people’ (ICECAP-O) is a validated measure of wellbeing in older people. The ICECAP-O tool uses a definition of wellbeing which is broader than most other measurement tools (which focus on health and/or functional capability), and covers five attributes of wellbeing that were found to be important to older people in the UK: Attachment (love and friendship), Security (thinking about the future without concern), Role (doing things that make you feel valued), Enjoyment (enjoyment and pleasure), Control (independence). Further information is available at http://www.icecap.bham.ac.uk/ICECAP-O/index.shtml (accessed September 2011).
4. Assessment of Quality of Life (AQoL) instruments measure health-related quality of life. Further information is available at, http://www.aqol.com.au/ (accessed December 2011).
5. EQ-5D is a standardised instrument for use as a measure of health outcome. Further information is available at http://www.euroqol.org/ (accessed December 2011).
Top of page