Establish comprehensive, timely and regular national reporting on the progress of mental health reform which responds to the full range of stakeholder needs.

The fourth plan provides an opportunity to develop a comprehensive, tailored system of reporting on performance, both within and beyond the health sector. There are currently several vehicles for regular reporting on mental health in Australia that provide a good foundation but these need to be overhauled to remove duplication and improve their timeliness and relevance (see table 1). Amongst these, a restructured and modernised National Mental Health Report will be the primary vehicle for reporting on mental health reform, including the progress of the fourth plan. Health ministers will jointly authorise this report, and commit their respective administrations to the collection and reporting of all required data in a timely way. The report will be developed in a way that builds the momentum for change through its role in encouraging peer pressure and enabling of public scrutiny.

The National Mental Health Report will draw on and interpret a range of data sources, including the Mental Health Services in Australia report, prepared annually by the Australian Institute of Health and Welfare. In addition to presenting analysis of reform trends, the redesigned National Mental Health Report will include independent commentaries from invited national stakeholder and other bodies, to contribute to the ongoing analysis of mental health reform in Australia. As such, the report will not only present the 'good news', but also point to where further action is needed to achieve the vision of the National Mental Health Policy 2008 for services to people with mental illness in Australia.

Indicators to be used to monitor the success of the fourth plan are listed in table 2. The National Mental Health Report will publish updates on these indicators as they become available, along with reporting on the progress of the actions committed by governments in each of the five priority action areas. Complementing this information, future national mental health reports will continue to analyse and report on other key measures currently used for national monitoring (for example, per capita expenditure, workforce levels, hospital–community mix). These are important measures to add to understanding of the long term trends in mental health reform in Australia as well as providing essential context for the new indicators to be reported. Top of page

The indicators summarised in table 2 represent core measures for assessing the achievements of the fourth plan, and details on data sources for these indicators are provided in appendix 2. For some of these indicators, relevant data are already available and are used for current monitoring of the performance of the mental health system. For other indicators, relevant data collections are not in place, or, where they are, further work is needed to enable them to be used to inform the indicator. Collaboration between governments will be needed to fill these data gaps.

Targets have not been set for the indicators outlined in table 2 but will be progressed during the first twelve months of the fourth plan. The setting of targets should not be done arbitrarily but needs to take into account objective evidence derived from local and international research, as well as best practice guidelines and opinions of both experts and stakeholders. As with the collaborative work needed to fill the data gaps, the contributions of all governments will be needed to develop performance targets for each of the indicators that are credible and expressed in a way that is meaningful to all parties.

Table 1: Regular national level reports contributing to comprehensive information about mental health services in Australia

Table 1 is presented as a list in this HTML version for accessibility reasons. It is presented as a table in the PDF version.

National mental health report

Purpose
Principal report for monitoring progress of mental health reform in Australia. Presents analysis of reform against specified indicators.
Prepared/released by
Australian Government, for AHMC
How the report will be developed 2009-14
Focus to be on reporting progress and outcomes of fourth plan.

Key contextual indicators used in previous national mental health reports to be continued, to allow monitoring of long term trends in mental health resourcing and service mix.

Special commentaries to be added to allow stakeholder opinion and analysis to inform national debate.
Frequency
Annual

Mental health services in Australia

Purpose
Presents the source descriptive data on the activity of mental health services, primarily based on annual national minimum data sets. Also includes descriptive information on activities of services operating beyond the health sector which are of relevance to mental health.
Prepared/released by
Australian Institute of Health and Welfare, funded by Australian Government
How the report will be developed 2009-14
Publication to be developed as the comprehensive report for all source data that describe mental health services in Australia.

Increasing range of source data and customised analyses to be developed for on-line access
Frequency
Annual

COAG action plan on mental health annual progress report

Purpose
Serves as the key accountability instrument for the action plan - summarises progress in the action plan's implementation and available data on outcomes.
Prepared/released by
Prepared under auspice of AHMC for COAG
How the report will be developed 2009-14
Report scheduled to conclude at end of action plan in 2011.

Progress indicators are incorporated in indicators developed for fourth plan and will be published in National Mental Health Report.
Frequency
Annual to 2011
Top of page

Table 2: Indicators of outcomes of the fourth national mental health plan

Priority area 1: social inclusion and recovery

Outcome:
The community will understand the importance and role of mental health and wellbeing, and recognise the impact of mental illness. People with mental health problems and mental illness will be embraced and supported by their communities to realise their potential, and live full and productive lives. Service delivery will be organised to deliver more coordinated care across health and social domains.
Indicators for which data are currently available:
  • Participation rates by people with mental illness of working age in employment
  • Participation rates by young people aged 16–30 with mental illness in education and employment
Indicators requiring further development:
  • Rates of stigmatising attitudes within the community
  • Percentage of mental health consumers living in stable housing
  • Rates of community participation by people with mental illness Top of page

Priority area 2: prevention and early intervention

Outcome
People will have a better understanding and recognition of mental health problems and mental illness. They will be supported to develop resilience and coping skills. They will be better prepared to seek help for themselves and others to prevent or intervene early in the onset of recurrence of mental illness. There will be greater recognition and response to co-occurring alcohol and other drug problems and physical health issues. Generalist services will have support and access to advice and specialist services when needed.
Indicators for which data are currently available:
  • Proportion of primary and secondary schools with mental health literacy component included in curriculum
  • Rates of contact with primary mental health care by children and young people
  • Rates of use of licit and illicit drugs that contribute to mental illness in young people
  • Rates of suicide in the community
Indicators requiring further development:
  • Proportion of front line workers within given sectors who have been exposed to relevant education and training
  • Rates of understanding of mental health problems and mental illness in the community
  • Prevalence of mental illness Top of page

Priority area 3: service access, coordination and continuity of care

Outcome:
There will be improved access to appropriate care, continuity of care and reduced rates of relapse and re-presentation to mental health services. There will be an adequate level and mix of services through population based planning and service development across sectors. Governments and service providers will work together to establish organisational arrangements that promote the most effective and efficient use of services, minimise duplication and streamline access.
Indicators for which data are currently available:
  • Percentage of population receiving mental health care
  • Readmission to hospital within 28 days of discharge
  • Rates of pre-admission community care
  • Rates of post-discharge community care
Indicators requiring further development:
  • Proportion of specialist mental health sector consumers with nominated general practitioner
  • Average waiting times for consumers with mental health problems presenting to emergency departments
  • Prevalence of mental illness among homeless populations
  • Prevalence of mental illness among people who are remanded or newly sentenced to adult and juvenile correctional facilities Top of page

Priority area 4: quality improvement and innovation

Outcome:
The community will have access to information on service delivery and outcomes on a regional basis. This will include reporting against agreed standards of care including consumer and carer experiences and perceptions. Mental health legislation will meet agreed principles and, in conjunction with any related legislation, be able to support appropriate transfer of civil and forensic patients between jurisdictions. There will be explicit avenues of support for emerging and current leaders to implement evidence based and innovative models of care, to foster research and dissemination of findings, and to further workforce development and reform.
Indicators for which data are currently available:
  • Proportion of total mental health workforce accounted for by consumer and carer workers
  • Proportion of services reaching threshold standards of accreditation under the National Mental Health Standards
  • Mental health outcomes for people who receive treatment from state and territory services and the private hospital system
Indicators requiring further development:
  • Proportion of consumers and carers with positive experiences of service delivery Top of page

Priority area 5: accountability - measuring and reporting progress

Outcome:
The public will able to make informed judgements about the extent of mental health reform in Australia, including the progress of this fourth plan, and have confidence in the information available to make these judgements. Consumers and carers will have access to information about the performance of services responsible for their care across the range of health quality domains and be able to compare these to national benchmarks.
Indicators for which data are currently available:
  • N/A
Indicators requiring further development:
  • Proportion of services publicly reporting performance data Top of page

Build an accountable service delivery system that monitors its performance on service quality indicators and makes this information available to consumers and other stakeholders.

Accountability at the service delivery level will be strengthened by the introduction of systems of public reporting by service organisations on key performance measures. This will be progressed as part of broader initiatives to establish a culture of continuous quality improvement within service delivery systems that revolve around benchmarking and consumer and carer involvement. The aim will be to stimulate the development of informed mental health service delivery organisations that value positive results, strive for quality and are transparent to those they serve.

Introduction of these new arrangements will be achieved through incentives and supports to organisations seeking to participate in the new developments. This will include providing access to national benchmarking data, forums for interaction between peer organisations to share performance data and learn from each other and other leadership development opportunities. Internet based systems of reporting and benchmarking will be developed to better inform consumers, carers and the general community about local service performance.

Further develop mental health information, including national mental health data collections, that provide the foundation for system accountability and reporting.

The solid information foundation developed over the past decade requires continuing collaborative effort between governments to keep data sources up to date, as well as fill gaps in current national collections. Key gaps in regularly available national data to be corrected over the course of the fourth plan are measures of consumers' experiences of services, recovery based outcome measures and collections that cover the growing specialised mental health non government sector. To guide the information development work, an updated National Mental Health Information Development Priorities document will be prepared in the first year of the fourth plan.Top of page

Conduct a rigorous evaluation of the Fourth National Mental Health Plan.

The fourth plan has a strong commitment to evaluation. The monitoring and reporting activities described above, including the assessment of the achievements of the fourth plan against explicit indicators, will form the core of the evaluation. The evaluation will go beyond this. It will draw on a range of additional sources, in recognition of the fact that the indicators can only present a partial picture of progress. For example, the indicators are quantitative in nature, and the evaluation will ensure that qualitative information is captured too. In particular, the perceptions of consumers, families and carers, and the broader community will be sought through stakeholder consultations that employ qualitative data collection and analysis techniques.The emphasis here will be on the extent to which the mental health system and related sectors work together to promote recovery. Similar methods will be used to gauge workers' views of the system, competencies and morale.

The evaluation of the fourth plan will involve the development of a clear framework at its outset that operationalises the aims of the fourth plan in a manner that enables them to be assessed. It will then use this information to determine any additional evaluative information that needs to be collected to examine the extent to which the aims of the fourth plan are achieved.

The evaluation will recognise the role of other sectors in mental health. Assessing the activities occurring in other sectors that may have an influence on the mental health of the community will be challenging, but the evaluation will incorporate an emphasis on these wherever possible.