Appendix 8: Evaluation Criteria Template for the Ministry’s Review of 2015/16 Public Health Unit (PHU) Annual Plan
A set of evaluation criteria for reviewing Public Health Unit (PHU) Annual Plans was developed and trialled by the Ministry last year. We received positive feedback from PHUs and Ministry colleagues on the value of this, and have refined the Evaluation Criteria Template below to use to review PHU Annual Plans for 2015/16.
Purpose of reviewing the PHU Annual Plans
PHU Annual Plans will be reviewed against the guidance provided in the 2015/16 Annual Plan Guidance to PHUs. The Ministry aims to provide constructive feedback to support PHUs to plan and deliver the optimal mix of core public health services for their population of coverage.
Purpose of the template below
The template is a tool that will enable Portfolio Managers and Ministry colleagues to review PHU Annual Plans.
About the template
The template is divided into the following review areas:
- DHB endorsement and PHU budget
- PHU Annual Plan structure and overview
- Improving Māori health and health equity
- Better Public Services Targets
- Health Targets
- New government initiative
- Non Health Targets
- Public Health Capacity Development.
We suggest that the reviewer look at the PHU Annual Plan and assess it against the ‘Evaluation criteria against 2015/16 Annual Plan Guidance for PHUs’ and ‘Questions for the reviewer to consider’ sections, and make relevant comments in the comments sections regarding the extent to which the PHU Annual Plan is meeting Ministry expectations: whether the PHU Annual Plan Mostly meets/Partially meets/Does not meet Ministry expectations; What is good about the Annual Plan and What needs to be improved and/or clarified. There is also a section at the beginning of the template for the Portfolio Manager to make some Overall comments about the PHU Annual Plan.
The Ministry is mindful that not all activities outlined in the Public Health Issues Update (Ministry guidance) will be relevant or appropriate for the PHU’s population of coverage and that PHUs may be required to prioritise some activities over others to ensure that existing resources are used most efficiently and effectively.What is important is for PHUs to ensure their service delivery is aligned with the strategic priorities of the Government, the Ministry and their DHB(s), and that all regulatory requirements are fulfilled. Please note that some core business-as-usual activities are not included in the Ministry guidance.
Indicative timeframe for reviewing PHU Annual Plans
- Draft PHU Annual Plans to be submitted by PHUs to the Ministry by 31 March 2015.
- Individual Ministry Portfolio Managers to evaluate the draft PHU Annual Plans and prepare draft feedback (using the template) by 20 April 2015.
- The draft feedback to be reviewed by Issues Leads in Public Health, National Purchasing Services and relevant Ministry colleagues by 27 April 2015.
- Portfolio Managers to send the final feedback to individual PHU service managers by 30 April 2015.
An example is given below:
Overall comments about the Public Health Unit (PHU) Annual Plan
General assessment: Overall, the PHU Annual Plan mostly meets the Ministry’s expectations, as set out in the Annual Plan Guidance for PHUs.
Integration: There is evidence of integration at many different levels (eg, integration with the DHBs’ programmes and activities, integrated approaches at a regional level between PHUs and at regional/local levels with other stakeholders.
Collaboration: There is evidence of collaborative approaches (ie, working with multiple stakeholders, including DHB, local government and other key stakeholders).
Public health approach: There is evidence that the PHU is using good public health approaches (eg, upstream preventative approaches) and has an appropriate mix of regulatory, and health promotion and other activities.
Regulatory work:The PHU Annual Plan shows that services are planned to meet all regulatory functions and obligations.
Better Public Services and health targets: There is evidence that the PHU will be contributing to these targets.
Resources:The financial and FTE information provided meets the Ministry’s expectations.
Areas for improvement:We look forward to working with the PHU on useful, meaningful and measurableKey Performance measures.
Overall comments about the Public Health Unit (PHU) Annual Plan (Portfolio Manager to provide relevant comments below)
Review area / Evaluation criteria against 2015/16 Annual Plan Guidance for PHUs / Questions for reviewer to consider / Reviewer / Date / Mostly meets/Partially meets/Does not meet Ministry expectations / What is good about the Annual Plan? / What needs to be improved and/or clarified?
1. DHB endorsement and budget
1.1 DHB/s endorsement / Has the PHU Annual Plan been endorsed by its DHB/s?
Note: Some PHUs may seek and obtain their DHB/s endorsement after the draft plan is submitted to the Ministry but before the final plan is approved. This is acceptable if the draft AP has been peer reviewed by their DHB Planning and Funding unit/s. /
- Is there evidence that the PHU Annual Plan been endorsed by its DHB(s)?
- Was the PHU Annual Plan submitted to the Ministry by 31 March 2015?
1.2 PHU Budget / Does the budget information provide a clear picture of how the Ministry funding will be applied? /
- Is the budget specified for each service line/grouping and/or core function deemed appropriate?
- Optional: Does the PHU receive additional funding outside the core contract from service level agreements with their DHB/s or other funding agencies? If so, is there an explanation as to how this work integrates with their core contract work?
2. PHU Annual Plan structure and overview
2.1 Format / Is the PHU Annual Planbased on the Results Based Accountability framework template agreed between the Ministry and the sector?
Note:The PHU may use the core functions model and/or specify its own service groupings. /
- Is there a logical flow that consists of:
- Short Term Outcomes
- Activities
- Key Performance Measures (How many; How well; Is anyone better off).
- In general, are the Activities appropriate, realistic and achievable and do they match the budgeted funding and FTE allocation?
- In general, are the Key Performance Measures useful, meaningful and measurable?
2.2 Context / Has the PHU provided useful context to introduce their PHU Annual Plan if there is no longer-term Strategic Plan in place? / Are the following areas considered in the PHU Annual Plan?
- The population served (including significant changes in population and demographics).
- How PHU has prioritised its service delivery according to Government/Ministry/DHB targets and priorities, and the needs of the population served.
- Any proposed major changes in the PHU’s strategic direction.
- An overview of any significant pressures/risks PHU is facing.
- The structure of their organisation, if there are any significant changes.
2.3 Alignment / Is the PHU Annual Plan aligned with key government targets and strategies, DHB plans and the Nationwide Services Framework LibraryPublic Health Service Specifications (when finalised)? / Is the PHU Annual Plan well aligned with:
- the Ministry’s Statement of Intent (2014 to 2018)
- He Korowai Oranga (2014)
- ‘Ala Mo’ui (2014-2018)
- DHB priorities, District Annual Plans, Māori Health Plans, Regional Services Plans and other relevant plans of the DHB(s) served by the PHU
- the Public Health Service Specifications in the Nationwide Services Framework Library?
2.4 Collaboration / Is collaboration with the wider sector demonstrated throughout the PHU Annual Plan? /
- Does the PHU demonstrate networks and collaboration with stakeholders, for example:
- their own DHB/s particularly Planning & Funding
- other PHUs, particularly in their region?
- all their Territorial Local Authorities?
- Māori and Iwi providers?
- NGO providers?
- Primary Health Care?
- appropriate Government agencies?
3. Improving Māori health and improving health equity
3.1 Improving Māori health / Does the PHU Annual Plan focus on improving Māori health? /
- Does the PHU Annual Plan clearly demonstrate:
- what the PHU intends to do to improve health outcomes for Māori communities
- why their chosen approach will succeed in achieving this
- how they will measure their success?
- Does this align with the DHB/s Māori Health Plan?
3.2 Improving health equity / Does the PHU Annual Plan focus on improving health equity? /
- Does the PHU Annual Plan clearly demonstrate:
- what the PHU intends to do to improve health outcomes for vulnerable communities (including Māori, Pacific, refugees and other vulnerable communities)
- why their chosen approach will succeed in achieving this
- how they will measure their success?
4. Better Public Services Targets
4.1 Increase infant immunisation rates / This section assesses the PHU’s role in relation to Immunisation, as appropriate.
Ministry guidance: Public Health Issues Update
Target population:
- Children and adults eligible for vaccines as recorded on the National Immunisation Schedule (including national influenza vaccine, adult boosters [Td] and those eligible for high risk programmes).
- Parents, guardians, whānau and community (including refugee and migrants) in promotion of immunisation campaigns.
- Specific health provider groups (eg, Lead Maternity Carers, authorised vaccinators, Primary Care providers and vaccinators, BCG vaccinators).
- Continue role in authorising vaccinators.
- Continue to support your respective DHBs/PHOs towards achieving the current immunisation health targets and the Government’s BPS targets.
- Key relationships to build (internal to PHU/DHB) include:
- DHB Immunisation Steering Committees
- PHO immunisation leads, general practice and pharmacists
- NIR and School Immunisation Programmes Administrators
- Immunisation Coordinators
- Outreach Immunisation Nurses
- Medical Officers of Health, Health Promoters and Public Health Nurses
- B4 School Check Coordinators
- Paediatricians and other clinicians involved in immunisation
- Well Child/Tamariki Ora providers
- Lead maternity carers and midwives.
- Your role, in terms of the support/advice you give to immunisation promotion, will be as agreed with the local DHB(s) and Immunisation Steering Committees. If you have a role in immunisation promotion, please indicate whether this is funded through the Well Child or Communicable Diseases service lines.
- Ensure all resources and media statements comply with appropriate Ministry documentation, priorities and views.
- With support from the Ministry, work towards eliminating measles in New Zealand.
- Has the PHU stated its role in Immunisation?
- Is the PHU focused on the target population group?
- Are Activities based on sound public health approaches and needs of the PHU’s population of coverage, and aligned with Ministry guidance?
- Are Activities placed in the appropriate core function (if the core functions model is adopted in the PHU Annual Plan) – please refer to the Public Health Issues Update as a guide?
- Are the Activities likely to contribute to achieving health outcomes, improving Māori health and improving health equity?
- Are the Key Performance Measures (How many; How well: Is anyone better off) useful, meaningful and measurable?
- Is the PHU Annual Plan information pitched at the ‘right’ level (please refer to the Alcohol and Physical Environments exemplars as a guide)?
4.2 Reduce the incidence of Rheumatic Fever / This section assesses the PHU’s role in relation to the DHB/s’ Rheumatic Fever Plan and any aspect of the National Rheumatic Fever Prevention Programme, as appropriate.
Ministry guidance: Public Health Issues Update
Target population: Priority populations are Māori and Pacific children and young people aged 4–19 years.
Health Promotion:
- Support DHBs to work in collaboration with local housing and social service agencies, and to implement actions that will increase “healthy homes” support for families with children at high risk of rheumatic fever.
- Support DHBs to balance the demand and supply of “healthy homes” services, including utilising the Ministry of Health’s definition of children at risk of rheumatic fever, as relevant to your local area.
- Support DHBs’ implementation of Rheumatic Fever Prevention Plans, including evaluation of effectiveness of interventions and application of any learning.
- Work with DHBs to ensure that all cases of acute rheumatic fever are notified to the Medical Officer of Health within seven days of hospital admission.
- Ensure the case report forms for rheumatic fever notifications are completed correctly and in full.
- Review rheumatic fever cases to identify and follow up known risk factors and system failure points, including:
- Documenting interactions with any school sore throat management programmes, rapid response services, housing services and Pacific engagement strategies.
- Supporting DHBs to ensure patients with a history of rheumatic fever receive antibiotics for secondary prevention not more than five days after their due date.
- Has the PHU stated its role in Rheumatic Fever Prevention?
- Is the PHU focused on the target population group?
- Are Activities based on sound public health approaches and needs of the PHU’s population of coverage, and aligned with Ministry guidance?
- Are Activities placed in the appropriate core function (if the core functions model is adopted in the PHU Annual Plan) – please refer to the Public Health Issues Update as a guide?
- Are the Activities likely to contribute to achieving health outcomes, improving Māori health and improving health equity?
- Are the Key Performance Measures (How many; How well: Is anyone better off) useful, meaningful and measurable?
- Is the PHU Annual Plan information pitched at the ‘right’ level(please refer to the Alcohol and Physical Environments exemplars as a guide)?
4.3 Reduce the number of assaults in children / This section assessesthe PHU’s role in contributing to Government priorities for reducing assaults on children and the Children’s Action Plan.
Ministry guidance: Public Health Issues Update
Target population: Priority populations for the PHU region, Māori and Pacific people, Asian populations, migrants and refugees, and disabled people.
Health Promotion:
- Implement the recommendations of the White Paper for Vulnerable Children through the Children’s Action Plan.
- Support DHB VIP community collaboration and action that will achieve health equity. Support Whānau Ora service providers and Iwi to promote family violence prevention programmes and services that are responsive to Māori and culturally competent.
- Continue support for primary prevention programmes, such as MSD-led It’s Not OK campaign and related projects (eg, White Ribbon Day, Te Rito Network activities, TLA partnerships, It’s Not OK Community Action Toolkit).
- Collaborate with key stakeholders on public health action that are focused on reducing alcohol-related harm and improving sexual health, including that instigated in the 16 Social Sector Trial areas around the country.
- Support Violence Implementation Programme (VIP) in DHBs.
- Support other population health approaches to injury prevention and mental health promotion that focus on primary prevention.
- Support DHB clinical units to develop and implement processes for capturing data on child and partner abuse identification, assessment and referrals.
- Has the PHU stated its role in Family Violence Prevention?
- Is the PHU focused on the target population group?
- Are Activities based on sound public health approaches and needs of the PHU’s population of coverage, and aligned with Ministry guidance?
- Are Activities placed in the appropriate core function (if the core functions model is adopted in the PHU Annual Plan) – please refer to the Public Health Issues Update as a guide?
- Are the Activities likely to contribute to achieving health outcomes, improving Māori health and improving health equity?
- Are the Key Performance Measures (How many; How well: Is anyone better off) useful, meaningful and measurable?
- Is the PHU Annual Plan information pitched at the ‘right’ level (please refer to the Alcohol and Physical Environments exemplars as a guide)?
5. Health Targets
5.1 Tobacco/Smokefree / This section assessesthe PHU’s role towards achieving Smokefree 2025 and supporting its respective DHB(s) towards achieving the ‘better help for smokers to quit’ targets in both secondary and primary care.
Ministry guidance: Public Health Issues Update
Target population: Priority population continues to be Māori and Pacific peoples and pregnant women. Any health promotion or education should be geared towards these priority populations, in particular young pregnant women.
Health Promotion:
- Contribute to your DHB(s)' Tobacco Control Plan(s) and Regional Service Plan(s), as appropriate. Continue to support your respective DHB(s) towards achieving the current more heart and diabetes checksand better help for smokers to quit targets in both secondary and primary care, and determine the role you play in achieving these specific targets.
- Work collaboratively and coordinate health promotion activities with Stop Smoking Services.
- Support collaborative approaches around youth smoking and reducing the uptake or ‘not starting’ campaigns.
- Work with Territorial Local Authorities and other organisations, such as large employers and/or educational institutions to implement smokefree policies in outdoor places (eg, central business districts and other outdoor public areas).
- Continue to allocate at least40 percent of current tobacco control budget towards regulatory activities. Note: Please demonstrate your funding allocation in your Annual Plan budget and six-monthly reporting to the Ministry.
- Ensure that your PHU has an up-to-date database of tobacco sellers, including addresses, to assist with planning of compliance and enforcement activities.
- Develop a plan for undertaking compliance/education visits of retailers – including a stated goal for the number of visits for the year. It is expected that all known tobacco sellers will be visited at leastonce within a five-year period.
- Develop a plan for undertaking controlled purchase operations – including a stated number of operations and premises to be visited for the year (this plan should be incorporated with the compliance/education visit plan).
- Undertake more proactive regulatory actions, including controlled purchase operations to monitor tobacco sales to minors. Ensure licensed and other premises are meeting their requirements to take “all reasonably practicable steps” to ensure that no person smokes in an internal area of the premises and other areas with legal responsibilities under the Smoke-free Environments Act 1990 and its amendments.
- Ensure at least five percent of identified tobacco sellers, within each Territorial Local Authority area, will be included in a controlled purchase operation.
- Participate in regional and national tobacco control networks and training /liaison days for Smoke-free Enforcement Officers.