Performance Management
WY-FI Teams
Year 4 Outcomes and KPI’s
1st June 2017 – 31st May 2018
Contents
Project Outcomes
Measuring and tracking project outcomes and the involvement of Service Users
WY-FI Key Performance Indicators
WY-FI Hub
WY-FI Navigator Teams
WY-FI Employment, Education and Training (Touchstone)
Project Outcomes
The table below sets out the Project outcomes and indicators of change over the lifetime of the project, these have been amended with agreement from the Big Lottery Fund in January 2016 and the following table encompasses these changes with the progress column showing the position as at 31.05.17.
No / Project Outcome / Indicator / Level / Timescale / Progress as at 31.05.171 / Adults with 3+ complex needs will experience improved physical and mental health, relationships, life-skills, housing, employability and reduced re-offending through access to person-centred and co-ordinated services / Adults with multiple needs report they;
- are better able to manage and maintain tenancy and accommodation
- have reduced their offending behaviour
- are better able to take responsibility and have improved motivation
- have improved their self-care and living skills
- are better able to manage money
- have improved relationships with their families and social networks
- have reduced their misuse of drugs and/or alcohol
- have improved physical health
- have improved emotional and mental health
- are engaged in meaningful activities
71
225
225
225
225
79
Total 1050
Beneficiaries report positive outcomes on completion of
Second Homelessness Outcome Star after 6 months Navigator support
8
100
200
200
200
200
Navigators record improved Chaos Index Score after 12 months Navigator support
71
225
225
225
225
79
Total 1050
Beneficiaries report increased scores in at least 6 areas of need at 2 year assessment point (or final if earlier) on Homelessness Outcome Star
15
105
225
225
225 / Year 1
Year 2
Year 3
Year 4
Year 5
Year 6
2nd HOS
Year 1
Year 2
Year 3
Year 4
Year 5
Year 6
Year 2
Year 3
Year 4
Year 5
Year 6
Post programme continuation
Year 2
Year 3
Year 4
Year 5
Year 6 / 130
200
223
553
Cumulative
8
75+ive 111
193+ive 325T
65
250+ve 378T
0
23 out of 47T
2 / Services for People with multiple needs are informed by service users themselves and become more accessible and provide a person- centred response allowing the service user choice and control / Service users will benefit from the development of a co-produced portable care plan ‘passport’ reducing the need to ‘repeat their story’ / 50 services and agencies sign up to the WY-FI Information Sharing Protocol and adopt the ‘passport’ by the end of year 4
8 in pilot Locality
12 with rollout in 2 Localities
30 with full roll out in West Yorkshire
Number of service users with a passport
100
225
225
75
Total 625 / Year 2
Year 3
Year 4
Year 3
Year 4
Year 5
Year 6 / Not achieved
Feasibility paper presented to and accepted by CPMB Apr 17. Actions outstanding due to extended process in recruitment of Co-Production Champions
0
Service Users report that local services;
- are more accessible, providing timely and flexible support
- provide a person- centred response to service user needs, allowing them choice and control
40
60
80
80
60 / Year 2
Year 3
Year 4
Year 5
Year 6 / 32
71
No / Project Outcome / Indicator / Level / Timescale / Progress as at 31.05.17
3 / People with 3+ complex needs will achieve positive outcomes in peer mentoring, volunteering, training and improved employability during the project. / People with multiple and complex needs achieve their self-defined employability goals as included in the individual support plan / 255 Service User are trained as Peer Mentors and support delivery of the programme collectively across all Localities
20
35
60
60
60
20 / Year 1
Year2
Year3
Year4
Year5
Year6 / 10
19
46
*cumulative yr1-3 = 75 completed from 110 starts
and 50 have started in
placements
People with multiple and complex needs benefit from pathways to employability through volunteering, training and work experience / 210 service users take up volunteering, employability or training
10
20
45
50
50
35
125 service users complete work placements in locality services
20
25
30
25
25
15 trainees recruited over lifetime of project with progression opportunities (using ethos of GROW model) / Year 1
Year2
Year3
Year4
Year5
Year6
Year2
Year3
Year4
Year5
Year6
Years 2-6 / Cumulative
84
149
0
6
9
No / Project Outcome / Indicator / Level / Timescale / Progress as at 31.05.17
4 / The basic requirements of individuals with multiple and complex needs are addressed through systemic change / Bespoke locality system change plans are effective working documents that fit with the local context and agencies in the localities actively participate in these / 5 Localities review system change plans annually
5
5
5
5
5 / Year 2
Year 3
Year 4
Year 5
Year 6 / 5
4
People with multiple and complex needs benefit from the Navigator practice of person-centred and co-ordinated multi-agency support which empowers sustainable engagement and outcomes. / Evaluation of Navigator Practice/model over time. CRESR submit
Baseline evaluation report
Interim evaluation report
Final evaluation report end / By end of Year 2
By end of Year 3
By end of Year 5 / Completed April 2016
Due 12 July from CRESR
Multi agency working is embedded as ‘usual’ working practice when delivering services to individuals with multiple and complex needs / Evaluation of the effectiveness of MARB from an agency perspective over time.
CRESR submit
Baseline evaluation report
Interim evaluation report
Final evaluation report end / By end of Year 2
By end of Year 3
By end of Year 5 / Completed December 2015
Consultative commissioning involves Beneficiaries and Experts in the design and procurement of services / Beneficiaries and Experts by experience are involved in the design and procurement of services
2
2
2
2
2 / Year 2
Year 3
Year 4
Year 5
Year 6 / 2
2
Beneficiaries and Experts by Experience evaluate effectiveness of Co-Production and Innovation Fund Pilots
Year 3 report
Year 4 report / 1 x Bradford
No / Project Outcome / Indicator / Level / Timescale / Progress as at 31.05.17
4 / The basic requirements of individuals with multiple and complex needs are addressed through systemic change / Culture Change – Perceptions and operational practices relating to individuals with multiple and complex needs are improved / Multi Agency Practice Development Groups are delivered with a minimum of 8 attendees at each session. Sessions:
2
6
6
6
6 / Year 2
Year 3
Year 4
Year 5
Year 6 / 0
5*
Principles of Co-Production and WY-FI learning are adopted and embedded in WY-FI Partners’ practice.
Consult and shape policy
Design and deliver Procurement processes
Train professionals
‘Experts for hire’ group established to support and deliver on the above / Years 3-6 / DISC Leadership Forum
Network involvement in Multi-Agency PDGs
Now have base for Network and work with Paula- Resolving Chaos
Measuring and tracking project outcomes and the involvement of Service Users
DISC, as the lead agency of the WY-FI partnership measures and tracks outcomes via a comprehensive data collection system, project planning, regular reviews, evaluation, measured impact and sustainability.
DISC's IT Team has developed a bespoke web-based Management Information System (MIS) based on project outcomes and those relating to the minimum dataset required by CFE and Sheffield University, the Big Lottery’s National Evaluation Partners.
Through documents and the MIS we track individual Service User journeys. Collecting data on the activities below contributes to Project Outcome 1 and the measurement of indicators in Outcome 1:
- Relevant personal details
- Consent to share information
- Details of the CHAOS Index and Homelessness Outcome Star Assessments
- Details of Risk Assessments
- Multi-agency support plans detailing key milestones to be achieved – shared with informed consent
- Timely Support Plan and assessment reviews
- Feedback questionnaires; QA and on planned exit
- Multi-agency involvement and specialist support
- Pre-engagement activity, all in-service activities and destination of service leavers
The activities below all contribute to Project Outcome 3 and the measurement of indicators in Outcome 3:
- Number/ type of meaningful activities and circles of participation service users are involved in
- Participation in Expert Group, Local Service User Fora and Focus Groups
- Training completed including peer mentoring
- Qualifications achieved
- Capacity Building and co-production activities
- No of employability activities undertaken; volunteering, work placements, employment outcomes
- Peer mentors in placement
- Peer research activity
Supported by policy, procedures and guidance DISC and the Core Partnership Management Board will have a range of management tools and forums to ensure the project meets its objectives, including:
•Core Partnership Management Board, Locality Groups and Network of Experts by Experience meetings
•SCAN meetings
•Membership of regional and local strategy and service delivery groups e.g. Health and Wellbeing Boards, Healthwatch, CCGs, Regional and Local Infrastructure Groups.
•Regular monitoring meetings as agreed in the Partnership Agreement
•Data collection and monitoring of monthly returns
•Workforce development activity to improve practice and delivery for service delivery staff and professionals, including co-ordinated WY-FI Navigator Practice Development groups, multi-agency Practice Development Groups, Training and support of “Champion” Navigators for Women and BME engagement.
•Quality Improvement support from the WY-FI Support Hub
•Navigator experience and feedback –PDGs, Case studies, WY-FI team meetings, meetings with Hub staff and other identified opportunities
•Compliments and Complaints
•Research and Evaluation including annual peer research, Insight surveys, project reports and local evaluation activity reports from WY-FI Evaluation Partner, CRESR (Sheffield Hallam University)
The activities listed above will contribute to the delivery of Project Outcome 4 by keeping public agencies engaged at local and regional level in the learning journey the project will undertake as well as providing evidence to influence system change.
We will use a range of appropriate and relevant approaches to involve Service Users and Experts by Experience in the review and continued development of both the programme and of the partnership including;
•Annual Peer research and Peer Audit of services-record on activity drop down box on MIS
•Minimum of 6 Expert/Network group meetings per year in addition to Locality Service User Fora and focus groups
•Beneficiary experience and feedback, QA and Insight questionnaires
•Experts by Experience/Beneficiary Insight Audit to assess the impact of service annually
•Quarterly monitoring of the Service User influence and Involvement Plan
•A minimum of 2 members on Core Partnership Management Board
•A minimum of 2 members on the Locality Group
•Involvement in national Service User Forum(National Expert Citizen Group)and activities to support National and Local Evaluation partners
1
WY-FI Key Performance Indicators
WY-FI Hub
No / Measured Activity / Evidence / Measured Activity / Link to outcomes in Table 11 / 50 services and agencies adopt the WY-FI ‘passport’ / Services and agencies sign up to the WY-FI Information Sharing Protocol and adopt the ‘passport’ /
- 8 agencies in pilot Locality - year 3
- 30 agencies with rollout in 2 Localities – year 4
2 / Personalisation Fund applications / Personalisation fund applications spreadsheet/ Evaluation reports /
- 6 monthly reporting of the impact of the Personalisation Fund applications
- Processed in a timely manner
3 / Co-produced research, evaluation, review and re-modelling of delivery and project plans completed / Business Review
Research and Evaluation Team Reports and position papers
Local Evaluation Partner Reports
SROI case studies / Business review event/revised planning/learning
Peer research undertaken
Annual insight research completed (Service User/ Expert involvement in evaluation of services and service user experience)
- 80- year 4
4 / Experts by experience support and influence the programme / Quarterly review of Expert Involvement and Influence Plan
Minutes of meetings
Expert reports / Engagement and Co-Production Workers and Navigator Teams to ensure:
- At least 2 service users attend each Locality Group meeting
- A minimum of 8 meetings per year
- 2 service users are supported to attend the CPMB meetings
- At least 2 service users from each Locality are engaged at all times with the Regional Experts Group
- 2 regional Experts attend each National Citizen meetings
5 / Workforce Development / Monitoring Forms /
- Annual programme of training
- Lead Navigators and Navigators attend joint WY-FI Case conferencing/Practice Development groups
- Lead Navigators attend practice development groups
- Administrators attend quarterly practice development groups
- To review training and support to BME, Prison Leaver (male and female) Champions trained in each Navigator Team
- Navigators attend/complete identified and relevant WY-FI training
- Multi-agency practice development groups (A minimum of 6 sessions per annum with 8 attendees at each session)
6 / Communications and Influencing plan impact / Quarterly report on media and communications activity /
- Quarterly reviews of the media and communications plan
- Monthly e-bulletin
- Events (learning/business review)
- Beneficiary story area on website
- 6 Case studies
- Blogs
- Social media activity
7 / Consultative commissioning processes involving Beneficiaries and Experts in the design and procurement of services / Report on Expert activity / Beneficiaries and members of the Network of Experts by Experience (EbE) evaluate the effectiveness of 5 Co-Production and Innovation Fund pilots
Experts for hire group explored / Outcome 4
8 / Consistent delivery across the partnership / MIS
Financial returns / Quarterly audit reports
Performance Management reports
Financial reviews
9 / Partnership and Governance structures are robust / Meeting minutes / Bi-monthly OMG meetings
Quarterly CPMB
Annual Learning Event
Annual Business review
Attend and support locality groups
10 / Policy and network development / Meeting minutes
Consultations
Policy updates / 4 West Yorkshire System Change Action Networks (SCAN) events held
Co-ordinate regional E&D and System Change Action Plans and support locally
8 responses to policy consultations
6 Policy briefings circulated annually
Prison Leaver Network established and supported
Commissioner Forum/Network established and supported
WY-FI Navigator Teams
Number / Measured Activity / Evidence / Measure Delivery Partner Activity / Link to Outcomes in Table 11 / 225 Beneficiary starts / On MIS from pre-navigation / Navigator Teams;
Bradford: 53 (cumulative 174)
Calderdale: 39 (cumulative 119)
Kirklees: 39 (cumulative 132)
Leeds: 68 (cumulative 219)
Wakefield: 39 (cumulative 132) / Outcome 1
Outcome 1
2 / 100% HOS Score (Initial): Collected for all Beneficiaries accepted onto Navigator Support / MIS / Bradford: 53 (cumulative 174)
Calderdale: 39(cumulative 119)
Kirklees: 39 (cumulative 132)
Leeds: 68 (cumulative 219)
Wakefield: 39 (cumulative 132)
3 / 100% HOS Score (2nd): 100% Beneficiaries complete within 6 – 8 months / MIS / Completed for all Beneficiaries after 6 months Navigator support
4 / 100% HOS Score: Beneficiaries complete at 2 year assessment point (or final if earlier) / MIS / Completed for all Beneficiaries after 2 years assessment
5 / CHAOS Index (2nd): 100% Beneficiaries complete after 12 months of Navigator support / MIS / Completed for all Beneficiaries after 12 months
6 / 80 Beneficiaries inform a customer insight process will run alongside our data auditing procedures / MIS / 16 Beneficiaries per locality / Outcome 2
7 / Monitoring of Local Co-Production and Innovation Fund funded services, reports completed as per Agreements / Research and evaluation Team and Locality group /
- 1 month into delivery, a project check in to check the project is up and running and the costs match delivery
- 6 months into delivery, a project report from the project to the WY-FI Hub that includes information about beneficiaries helped, expenditure to date and future sustainability of the project
- Between 6 and 9 months there will be a visit to the project from the WY-FI Hub Team and a mystery shopper or beneficiary insight exercise
- A 12 month project evaluation report to WY-FI Hub, to include information about expenditure, beneficiaries and service user evaluation to be shared with the WY-FI Local Evaluation Team based at Sheffield Hallam University (CRESR)
8 / 60 peer mentor trained / MIS / ETE delivery partner ensures;
60 service users complete peer mentor training (12 from each locality supported by Navigator teams) / Outcome 3
9 / Recruitment, selection and induction of 3 Trainee posts / Trainees in post / Navigator Teams / ETE team / Outcome 3
10 / Locality Partners signed up to provide 30 work placements / ETE activity / Each of the Delivery Partners provides at least one work placement with other opportunities provided by other Locality services / Outcome 3
11 / Co-produced research, evaluation, review and re-modelling of delivery and project plans completed / Research and Evaluation Team
Local Evaluation Partner / Peer research undertaken
80 Beneficiary/Expert involvement in evaluation of services and service user experience (Insight)
Navigator team support peer researchers to engage with beneficiaries -16 per Locality / Outcome 3 and 4
12 / EbE attending
- Locality meetings
- CPMB
- Experts Group
- National Citizens Group
- Multi-agency Review Boards
Minutes of meetings / Engagement and Co-Production Workers and Navigator Teams to ensure:
- At least 2 EbEs attend each Locality Group meeting
- 2 EbEs are supported to attend the CPMB meetings
- At least 2 EbEs from each Locality are engaged at all times with the Regional Experts Group
- 2 regional Experts attend each National Citizen meetings
- Multi- agency review board to be added
13 / Workforce development Activity
- At least 8 Regional Navigator Case conferencing/Practice Development group days
- Champion Navigators trained
Lead Navigators attend practice development groups
Administrators attend quarterly practice development groups
Review support to BME, Prison Leaver (male and female) Champions trained in each Navigator Team
Navigators attend/complete identified and relevant WY-FI training
14 / Local Equality and Diversity plans reviewed.
System change plans reviewed / Locality group minutes
Updated plans and completed actions / Revised Action Plan and Common Framework implemented
Monitoring completed quarterly
Reviewed by Q4 with revised annual plans submitted to the Policy and Networks Officer by 31st May 2018 / Outcome 4
15 / Communications / Completed actions on WY-FI Communications Plan / All delivery partners adhere to the Big Lottery Fund branding guidelines and support the WY-FI Communications Plan through partnership working with the Hub Media & Communications Officer.
Responding to quarterly targeted requests from the Media & Communications Officer to highlight good news stories, barriers flex etc.
Outcomes re: case studies, successes, challenges to be agreed by the end of Q1 with Media & Communications Officer.
WY-FI Employment, Education and Training (Touchstone)
No / Project Outcome / Indicator / Level – Figures shown are cumulative across Years 1-41 / People with 3+ complex needs will achieve positive outcomes in peer mentoring, volunteering, training and improved employability during the project. / People with multiple and complex needs achieve their self-defined employability goals as included in the individual support plan / 175 Service User are trained as Peer Mentors and support delivery of the programme collectively across all Localities
People with multiple and complex needs benefit from pathways to employability through volunteering, training and work experience / 125 service users take up volunteering, employability or training
100 service users complete work placements in locality services
15 trainees recruited over lifetime of project with progression opportunities (using ethos of GROW model)
1