This report provides findings and recommendations from an evaluation of the Child Health Check Initiative (CHCI) and the Expanding Health Service Delivery Initiative (EHSDI). The evaluation, commissioned by the Australian Government Department of Health and Ageing (DoHA), has been undertaken independently and the interpretation, conclusions and recommendations in this report are those of the authors.
This summary report outlines the key findings and recommendations of the full evaluation report. The summary report is more practically oriented than the full report and includes a set of main messages (Section 1) designed for people who make decisions on running the Northern Territory (NT) primary health care (PHC) system.
The CHCI and the EHSDI were contrasting approaches to addressing the health needs of remote Aboriginal communities in the NT. The programs were implemented as part of the Northern Territory Emergency Response (NTER).
The CHCI was launched as a centrally driven program. There was a lack of policy development process or consultation with stakeholders outside central government. Policy decisions focused on the clinical and logistical aspects of the child health checks, and engagement with the NT health sector was largely about specific implementation issues. The lack of suitable policy development meant there was insufficient regard for the diversity of the people, systems and processes already operating in the NT and insufficient focus on existing bottlenecks in the NT health system.
The program achieved some credible successes in areas such as dental, hearing and ear, nose and throat (ENT) health; however, its overall impact was dulled by a lack of precision in the way it interacted with communities and the existing health care system.
The EHSDI, on the other hand, is an ongoing program being built on a rich history of innovation and health system development in the NT. The Australian Government, the NT Government and Aboriginal Community Controlled Health Organisations (ACCHOs) are playing an active part. The program is building on commendable models of Aboriginal controlled PHC services as well as governance, quality and accountability approaches that have been developed in response to the specific context of providing PHC in NT remote Aboriginal communities. While the program faces ongoing challenges, the EHSDI’s achievements to date are a cause for celebration.
There is still a considerable gap between the health outcomes of the Indigenous people of the NT and non-Indigenous Australians in the NT and across Australia. The developing PHC service models in the NT have the potential to contribute to closing this gap provided they are sustained and adequately resourced.top of page
2.1 Key findings—the Child Health Check Initiative
The design of the CHCI did not follow normal policy protocolsThe CHCI arose from an intense national political process that precluded the development of any specific policy documents. Medicare Benefits Schedule (MBS) item 708 (an existing health check program for Aboriginal and Torres Strait Islander children aged less than 15 years) became the de facto policy for the child health checks; however, it was not designed for the specific conditions in remote NT communities and is usually carried out as part of an ongoing relationship between a child and a health clinic or health practitioner. This was not the case in the delivery of the CHCI.
The lack of adequate policy processes meant that the child health checks did not follow international best practice for screening programs. There is no evidence of officials using best practice guidelines for designing screening programs such as those issued by the World Health Organization (Wilson and Jungner 1968).
There was a ‘bottleneck’ in referral systemsApproximately 70 per cent of all children who had a child health check received at least one referral to follow-up care. The NT health system, which was not coping with the existing number of referrals from PHC, did not have the capacity, processes, infrastructure or workforce to provide an increased volume of follow-up health services in a short time frame. This aggravated a ‘bottleneck’ in the pathway to referred services. The proportion of children who had been given a referral from a child health check but had not been seen by the follow-up service was 19.6 per cent for PHC services, 34.2 per cent for ENT specialist services, 39.8 per cent for dental services, 42.0 per cent for paediatric services, 45.4 per cent for tympanometry and audiometry services, and 57.4 per cent for other specialist services.
The CHCI brought considerable resources into the NT health systemThe NT remote PHC sector had long been under-funded (McDermott et al 1997; Rosewarne and Boffa 2004; Mooney and Henry 2004) and the extra financial resources that accompanied the CHCI were welcome and needed. From 1 July 2007 to 30 June 2010 a total of $54.469 million was spent on the initiative ($17.935 million on the child health checks and $36.535 million on follow-up services). This represents an average cost per child of $1,691 for the child health checks, and an average cost per follow-up service of $1,181 for dental services and $1,842 for hearing/ENT services.
By way of comparison, the benefit paid for the MBS Item No. 708 child health check is around $200 per child and research suggests that the average cost of a 60-minute face-to-face medical consultation in remote Aboriginal communities in the NT in 2003–04 was around $504. While these costs are not directly comparable, it does suggest that the CHCI, as a new health screening program, involved a substantial financial outlay (including administrative costs) and that the benefits that occurred in areas such as follow-up dental and hearing services could have been achieved more directly.
There was a lack of engagement with and disruption to existing systemsThe centrally-driven approach to the CHCI meant that there was insufficient consideration of the needs of the people, systems and processes already operating in the NT. The checks were often conducted by teams of visiting professionals in a ‘fly-in/fly-out’ model. Many of these teams appeared to do their best to engage with local health service staff and the community. Nevertheless, for many health services the checks were a disruption to normal clinic business and other services were sometimes suspended while the checks were carried out. This represented a significant opportunity cost as staff attention was diverted to conducting the checks, supporting visiting teams or working to overcome community scepticism and fear about the checks.
Those who received a child health check were more likely to have been previously hospitalised and more likely to participate in existing child health screening programs
The CHCI achieved an overall coverage rate of between 57 and 65 per cent of the total eligible population. Coverage was higher in small communities and among children aged 2–9 years and lower in large communities and among children aged 14–15 years. While not directly comparable the coverage rate for younger children, estimated at between 56.4 and 69.4 per cent, compares with a 69 per cent coverage rate for the routine but less comprehensive NT GAA1 program.
Comparison of the health characteristics of the populations who did and did not receive a health check suggests that there was little difference in the health status of the two groups. Those who received a child health check were more likely to have been previously hospitalised and more likely to have attended existing child health screening programs in the NT, compared to the popu lation who did not receive a check.
New service delivery models for hearing/ENT and dental were program successesFunding provided through the CHCI enabled the development of new service delivery models for hearing/ENT and dental services. Improved case management practices in hearing/ENT services have resulted in more precise tracking of children through the system, reducing the risk of children falling through the gaps. A new dental service delivery model helped overcome workforce shortages during the roll out of follow-up services. These new models have the potential to provide more efficient service delivery, providing these services continue to be funded and are developed within the context of a comprehensive PHC approach.
Data generated was used effectively to focus attention on the NTThe CHCI added a significant amount of data to the PHC system. There is evidence that the CHCI data has been used to focus Australian Government attention on the needs of Aboriginal children in the NT. DoHA has regularly been asked at Senate Estimates hearings about the progress of the checks and follow-up referrals, as well as the prevalence of the specific conditions found. The CHCI dataset provided the basis for DoHA responses to the committee. The CHCI data provided decision makers with quantifiable, tangible and timely evidence of the health needs of Aboriginal children and of health services’ ability to meet these needs, in a way that was not previously possible.
There is evidence that larger NT health providers have made use of CHCI data to improve programs and to inform reviews on the treatment of some conditions; however, smaller providers do not have the capacity to make use of the data. There is a widespread view among NT health professionals that the data did little to increase local understanding of the population health needs of Aboriginal children as this information was already well known to health providers.top of page
2.2 Key findings—the Expanding Health Service Delivery Initiative
Engagement with existing processesAn important feature of the EHSDI is its engagement with existing reform processes in the NT. The EHSDI was preceded by a 15-year period of development in the NT health system under programs such as the Coordinated Care Trials and the Primary Health Care Access Program, the establishment of the NT Aboriginal Health Forum (AHF) and the Pathways to Community Control (NT AHF 2008) framework to support the transition to community control. The EHSDI was built on the successes of and lessons learned from these initiatives.
The EHSDI significantly increased funding to the NT remote health systemLike the CHCI, the EHSDI significantly increased the financial resources available to the NT health system. The initiative added around 17 per cent to remote PHC funding in the NT in 2008–09 and around 29 per cent in 2009–10. The health workforce increased by 251 full-time equivalent positions over a two-year period. EHSDI funding enabled increased investment in remote health infrastructure such as staff accommodation and clinic buildings.
The Remote Area Health Corps (RAHC) added to workforce capacity in the NT remote health sectorThe RAHC model focuses on one workforce issue—recruiting health professionals for short-term placements—and has been successful in deploying 439 health professionals to more than three quarters of all NT remote health services. Other longstanding workforce issues remain including the difficulty in recruiting and retaining permanent staff. The current arrangements for recruiting, training and supporting Aboriginal Health Workers (AHWs) are also a major concern. The future of the RAHC needs to be considered within the context of effectively and sustainably addressing these wider workforce issues.
Regionalisation was under-scoped and under-resourcedThe NT PHC sector is engaged in a complex process of change. There is an attempt to balance the health system’s need for efficient health service provision based on economies of scale, with the desire for greater community control of health services. Regionalisation processes have been under-scoped and under-resourced, and there is a lack of clarity on the tasks involved, actions required and who should undertake them.
Communication within and across the NT AHF partners concerning increasing Aboriginal community control and regionalisation has not been consistent and there appear to be varying degrees of acceptance of the concept. The process will remain problematic while mixed messages from the leading organisations persist.
There is insufficient policy capacity in the NTThe EHSDI reform process has not been accompanied by sufficient increased policy and administrative capacity in the key partner organisations in the NT. The bulk of the implementation policy work has been undertaken by the Primary Health Reform Group (PHRG); however, the existing policy capacity is insufficient to sustain the pace and effectiveness of the reform agenda. The organisations involved in implementing the PHC reforms need to re-assess where the current policy capacity is being applied and ensure that there is sufficient policy capacity in the right place to effect the intended changes.
Existing governance frameworks in the NT have served the developments in the sector wellThe NT AHF has an important role in the strategic governance of the EHSDI and the PHRG has been formed to oversee the implementation of the program. The extensive development of structures and relationships before the EHSDI meant that the sudden increase in resourcing could be managed within existing frameworks. The commitment to partnership between the Australian Government, NT Government and Aboriginal community controlled health sector, and to NT-based decision making, is commendable.
The system is moving towards more equitable distribution of financial resourcesBefore the EHSDI, health services received funding from a number of sources including DoHA program funding, DoHA Regional Health Service funding and the NT Government. The specific amounts received by each service varied considerably with some providers receiving much higher levels of funding per head of population than others. The EHSDI funding for service expansion was distributed using a benchmark methodology to determine which proposed Health Service Delivery Areas (HSDAs) were priorities for additional funding. This contributed to a more equitable distribution of resources at a regional level.
The benchmark will need further development before it can be routinely used as a costing model for delivering services in remote areas. There is still a considerable way to go before the health services for remote populations have the funding required to provide a full range of PHC services.
The NT Aboriginal Health Key Performance Indicators (NT AHKPIs) are a significant achievement of the current reform processThe NT AHKPIs are a unique feature of the NT remote health system, providing a system-wide tool for gathering data on health service activities and outputs. With further development, including expanding the scope of the indicators and supporting health service staff to use the results to inform health service planning, the NT AHKPIs have the potential to both support continuous quality improvement (CQI) activities and strengthen accountability purposes.
1The GAA (Growth Assessment and Action) program is the NT Government’s ongoing program aimed at improving the growth and nutritional status of children 0–4 years of age who live in remote areas. It involves routinely collecting measurements of children’s weight, height/length and haemoglobin. Since March 2009 the NT Department of Health and Families began piloting a new program called Healthy Under 5 Kids. This program complements the GAA.top of page