Guidelines for the Aged Care GP Panels Initiative August 2007

Guidelines for the Aged Care GP Panels Initiative August 2007 - Chapter 6 Performance, Monitoring and Evaluation

Aged Care General Practitioner Panels Intiative

Page last updated: 21 September 2007

Performance, Monitoring and Evaluation

a) Types of Data

The Department collects information to assist in monitoring the progress of the Initiative and to determine the extent to which the Initiative is meeting its objectives. This information will assist the Department to obtain a better understanding of the operation of the program to inform future policy advice.

The Department collects information from:
  • 6 and 12 Month Reports from the Divisions network including;
  • Aged Care GP Panel Standard Data Items;
  • National Quality and Performance System Performance Indicators;
  • Aged Care GP Panel Performance Indicators;
  • Medicare activity data;
  • Survey of RACFs;
  • Survey of GPs and allied health service providers; and
  • Annual Survey of Divisions Data
When examining the data, the Department recognises the need to consider the data in context.

b) Performance Indicators

Division Performance Indicators

The Performance Indicators relate to each of the Program outcomes to be achieved, and to the establishment and management of the Panels Initiative.
Information on the Performance Indicators will be drawn from the Division Reports, a survey of RACFs and Medicare Australia data. There are a number of indicators for each outcome to ensure a comprehensive picture is gained of overall performance.

Each Division will be required to comprehensively report on their achievements and activities undertaken against the Performance Indicators.
Top of page

Aged Care GP Panels Initiative Indicators

In addition to the compulsory indicators under the National Quality and Performance System (NQPS), there are a number of program level performance indicators that Divisions must report against in their 6 and 12 Month Reports including:

1. Improved access
  • RACFs’ advice that access to GP and allied health services has improved.
2. Increased involvement in RACFs’ quality activities
  • proportion of RACFs that have GP and allied health service provider involvement in their quality improvement activities.
  • RACF satisfaction with the outcomes of GP and allied health service provider involvement in their quality improvement activities.
3. Effective partnerships and collaboration
  • RACFs’ advice that the Panels Initiative is undertaking work to address key concerns;
  • key priorities to address needs within the Division’s boundaries have been identified;
  • Aged Care GP Panel is operational;
  • transparent and accountable processes for the Panels Initiative member selection and appointment is established and maintained; and
  • the Panels Initiative is built on and amended in light of the initiatives development.

Workforce Planning


The Department will provide the following data to Divisions for workforce planning purposes on an annual basis.
1. Improved access
  • number of residential aged care GP services as a ratio to Full Time Equivalent GPs.
- Using data from Medicare residential item numbers and GP data; and
  • the age and gender of GPs providing residential aged care services in the Participant’s region is more comparable with the national average.
- Using GP data.
Top of page

Survey of RACFs

Information on the following performance indicators will be collected through the survey of RACFs:

1. Improved access
  • RACFs advice that access to GP and allied health services has improved.
2. Increased involvement in aged care homes’ quality activities
  • proportion of RACFs that have GP and allied health service provider involvement in their quality improvement activities; and
  • RACFs satisfaction with the outcomes of GP and allied health service provider involvement in their quality improvement activities.
3. Effective partnerships and collaboration
  • communication and partnerships are established and maintained between GPs, allied health service providers and RACFs.
  • RACFs, allied health service providers and GPs are working effectively together to improve access to medical care for residents of RACFs.
  • RACFs’ advice that Panels Initiative is undertaking work to address key concerns.
Apart from the above performance information, Divisions must also provide information relating to the establishment and management of Panels Initiative including:
  • identification of key priorities to address needs within the Division’s boundaries;
  • whether Divisions have an operational Panel;
  • standard data items such as number of panels and number of GPs and allied health service providers per Panel;
  • transparent and accountable processes for appointment of Panel GPs and allied health service providers are established and maintained;
  • the Panel model is built on and amended in light of the Initiative’s development; and
  • appropriate expenditure of funds has occurred. In addition, the Department will also need to collect performance information relating to:
In addition, the Department will alos need to collect performance information relating to:
  • the performance of the AGPN and SBOs;
  • its own performance;
  • the scope and achievements of the Initiative overall;
  • how well accountability requirements have been met; and
  • broader policy questions about workforce, access and quality in the residential aged care sector.
Division’s should refer to their funding agreements with the Department for more detailed information about specific reporting requirements for these performance indicators.
Top of page

State Based Organisations Performance Indicators

Each SBO will also be required to comprehensively report on their achievements and activities undertaken against the Performance Indicators. These Performance Indicators include:

1. Improving Access
  • increase in access to medical services for residents of RACFs.
— divisional indicators aggregated at a State/Territory level; and
— descriptive information from the 6 Month Report and 12 Month Report.

2. Quality Improvement Strategies
  • an increase in the extent of an evidence base that demonstrates best practice at the State/Territory level.
    — descriptive information from 6 Month Report and 12 Month Report.
  • increase in RACFs satisfaction with the outcomes of GP and allied health service provider involvement in their quality improvement activities.
    — RACF survey undertaken by Department.

3. Effective Partnerships
  • support and assistance has been provided to members of the Divisions network in implementing, operating and developing the Panel Initiative arrangements.
    — descriptive information from the 6 Month Report and 12 Month Report.
  • awareness amongst all stakeholders at the State/Territory level of the Panels Initiative and its developments.
    — descriptive information from 6 Month Report and 12 Month Report.
  • communication and partnerships are established and maintained between aged care peak bodies, professional organisations and services at the State/Territory level.
    — advice from Aged Care Peak Bodies; and
    — descriptive information from 6 Month Report and 12 Month Report.
  • key State/Territory priorities to address needs have been identified.
    — descriptive information from 6 Month Report and 12 Month Report.
  • progress has been made towards addressing key State/Territory priorities under the Panels Initiative.
    — descriptive information from 6 Month Report and 12 Month Report.
  • The extent of participation and assistance in policy development at the State/Territory level.
    — descriptive information from 6 Month Report and 12 Month Report.
SBO’s should refer to their funding agreements with the Department for more detailed information about specific reporting requirements for these performance indicators.
Top of page

c) Evaluation

A review of the Panels Initiative will be conducted by Australian Healthcare Associates from May to September 2007.

The purpose of this review is to determine if the current program is adequately achieving its objectives. The reviewer will assess the effectiveness, appropriateness and efficiency of the Initiative.

Based on the results of this review, an evaluation framework will be developed. An evaluation is expected to be conducted using this framework in 2010-11.

A consultant will be engaged to undertake a survey of RACFs on a biennial basis from 2007-08 and undertake a survey of GPs and allied health service providers on a biennial basis from 2008-09 (on alternative years) in order to assess the progress of the Initiative.