Money Advice Performance Management Framework (MAPMF)
Indicator Guide v3
Contents
Introduction 2
Scope and aim 4
Benefits 5
Future Developments 6
Consultation 7
Data returns submitted by each Council 8
Indicators included within the framework 9
Supporting information 10
Collation, analysis and reporting of data returns 11
Appendix: 12
Definition of money advice 12
Overarching key outcomes for money advice 12
MAPMF indicators and definitions 13
Introduction
The Money Advice Performance Management Framework (MAPMF) seeks to capture key performance data for money advice services funded by local authorities on both an in-house and commissioned basis. By collecting this information, it is intended to achieve a consistent approach to reporting and measuring the performance of these services. The work is delivered by the Improvement Service’s Money Advice Outcomes (MAO) project, which is supported financially by the Money Advice Service.
This is the third iteration of the Indicator Guide, which sets out the measures used to demonstrate the nature and extent of money advice activities and which form the basis for assessing performance. It provides a definition and, where appropriate, simple guidance concerning how the data for each indicator should be recorded and reported. The Guide has been revised following workshops, consultations and discussions involving local authorities and other strategic partners.
A detailed rationale for the guide and the approach it takes can be found in the original version[1].
Background
The first year of recording in 2014-15 saw data returns submitted by 30 of the 31 local authorities that directly fund money advice services. These returns were analysed by the project team, and a report detailing the findings was produced[2]. In the second year of recording, 2015-16, data returns were submitted by all 31 Scottish local authorities providing or supporting money advice services and a second report was produced.
Considerable support and commitment has been demonstrated by local authorities throughout both iterations of the Framework. The 2014-15 data returns revealed, as expected, difficulties in achieving consistency in reporting. They also highlighted other matters, such as the need to further develop the framework and clarify expectations regarding several of the indicators. In light of these issues, and following further engagement with all 32 local authorities and their partners, an amended version of the Indicator Guide was produced[3].
While there were marked improvements in the consistency of reporting in 2015-16 compared to the 2014-15 recording period, further work was still required to solidify the Framework’s data collection requirements and indicators. The continuation of this stakeholder-led process of reflection and revision has resulted in the publication of this third version of the Indicator Guide.
Scope and aim
The aim of the MAPMF is to support local authorities to measure and report on the contribution they make to money advice services in Scotland. Ultimately, the focus of the framework is on the identification of the benefits the services deliver for their users. Ownership of the framework rests with local authorities, and the role of the Improvement Service is to facilitate and enable its use.
The MAO project team recognise the importance of co-ordinating the MAPMF in line with the reporting requirements of other national funders of money advice, as well as key stakeholders, to ensure the widest possible consensus in relation to its key indicators. By adopting this approach, the project team hope to encourage consistency and establish common reporting requirements from funders. This should reduce the overall data collection workload for local authorities.
It is essential to note from the outset that there are considerable variations as to how money advice services are delivered by local authorities. It is important to account for local needs, geography, and differing priorities. Consequentially, direct comparisons between one area and another are not always possible or sensible, due to the different contexts in which the services operate.
Benefits
The MAO project team acknowledge the active involvement of local authorities in the MAPMF, and recognise that it is essential this engagement continues. In the current times of financial constraints the performance management framework can play a key role in assisting local authorities to assess and evidence the contribution their investment makes at both local and national levels. It also helps inform future discussions with other national funders of advice, key stakeholders, and policymakers.
Future Developments
This is the third version of the Indicator Guide for the MAPMF. It will be reviewed on an annual basis to ensure that it reflects continuous improvement, and that the Framework indicators remain robust and relevant. A balance has to be struck between stability and certainty in relation to data collection, and the need to reflect changes in policy and practice. From this year onwards, it is intended that minimum changes and improvements to the Framework will be required. Nevertheless, it will continue evolving to reflect developments in the area of money advice.
As the MAPMF develops through an iterative process, it relies on ongoing commitment and support from all local authorities. The extent to which this exists has been evidenced by the fact that all local authorities who provide or support money advice services submitted information in 2015-16. Several local authorities that were unable to submit full data returns have agreed to work towards achieving this for future iterations. There is an acceptance and acknowledgement that the ultimate goal should be consistent reporting on all the agreed indicators. The MAO project team will continue to work closely with key stakeholders towards achieving this.
Specific indicators that were identified as requiring clarification or explanation have been adjusted following extensive consultations in which all local authorities have had the opportunity to participate. While the Framework does not currently include measures of the ‘softer’ outcomes experienced by service users, discussions are taking place with a view to adding them for the next iteration.
The MAPMF can be used for driving improvement and to help inform the targeting of services at a local level. Further exploration of how the Framework can be used to help proactively manage services will be undertaken with councils and other stakeholders over the course of the year.
Consultation
Following their involvement in its initial development, local authorities, their partners, and other stakeholders are regularly invited to contribute to the revision and improvement of the MAPMF. Each iteration of the Framework is subject to in- depth discussion on identified areas via workshops, to which all local authorities and key stakeholders are invited. Whilst frequent opportunities are offered for feedback, the workshops provide the main platform via which any difficulties regarding the current Framework can be expressed and possible solutions explored. Additional feedback is then sought before the implementation of any changes.
The draft annual report is circulated among local authorities and key stakeholders prior to publication, providing a further opportunity for comment. All comments and contributions are considered, and where consensus is not possible the majority view prevails.
Data returns submitted by each Council
Each Council will be asked to submit one data return detailing the performance information of all money advice services that are funded and/or provided by the Local Authority.
The period covered by the current return is 1st April 2016 – 31st March 2017. Data Returns should be submitted to the Improvement Service no later than 26th May 2017 using the MAPMF Data Return Excel Spreadsheet - issued with the Guide and also available to download from the IS website. Returns should be submitted to: .
Any queries relating to the data returns can be sent to the same e-mail address or can be discussed further with the following MAO project team members:
Karen Carrick
01506 283566
Paige Barclay
01506 283849
Indicators included within the framework
There are five types of indicator included within the MAPMF:
· Context
· Input
· Activity
· Output
· Outcome
While not measuring performance directly, the context indicators are required to collect essential information on the composition of services and types of clients within each Local Authority area. In simple terms, local authorities rely on inputs (e.g. staff and budgets) to deliver money advice services. These inputs allow a range of activities to take place (e.g. meetings with clients). In turn, these activities will deliver a range of outputs (e.g. the debt strategy agreed with a client). These outputs may result in a range of outcomes for individuals, communities and the economy (e.g. client financial gain). While client financial gain is an immediate outcome of the money advice provided to the individual, outcomes relating to financial capability and inclusion, such as coping well financially and building up savings are longer-term outcomes which money advice services can contribute to.
The Appendix of this Indicator Guide defines and summarises each indicator in the MAPMF.
Supporting information
In addition to the data provided by local authorities, the project team will consult national datasets and other sources of information. The inclusion of this additional data, where appropriate, will strengthen the report analysis and contextualise the findings.
For example, areas the project team are likely to consider including supporting data for include Scottish Legal Aid Board (SLAB) funding for money advice services, and household financial behaviours relating to savings and bank accounts.
Collation, analysis and reporting of data returns
The Money Advice Outcomes team at the Improvement Service will collate and analyse the data, as well as support the ongoing improvement of the Framework. A draft data analysis report will be issued to each Local Authority prior to publication in order to check factual accuracy. The final report will be published on the Improvement Service website.
Appendix:
Definition of money advice
Money advice, in the context of this Framework, refers to free-to-client advice. Most free-to-client money advice providers describe the service they offer as money or debt advice, with some elements of budgeting support, income maximisation, financial inclusion and financial education often included. It is recognised that service delivery models vary across local authorities in Scotland and therefore interpretation of what constitutes money advice can vary. In general, money advice aims to direct individuals away from over-indebtedness and financial exclusion towards better management of their finances, financial inclusion, financial education and financial capability. This Framework aims to capture the performance of all of the main services provided and funded by local authorities under the umbrella of money/debt advice.
Overarching key outcomes for money advice
Effectiveness and client outcomes:
The client’s situation has improved as a direct or indirect result of the money advice service’s intervention.
Operational and service delivery outcomes:
All citizens requiring it can access good quality money advice via the channel that meets their needs. Those who require face-to-face advice have access to it.
Efficiency outcomes:
The money advice service delivers good value for the resources invested in it.
Strategic outcomes:
The money advice service contributes to relevant local and national strategic outcomes.
Community and economic outcomes:
The money advice service contributes to outcomes which benefit the community and local economy.
1
MAPMF indicators and definitions
Indicator list
The indicators are categorised following a logic chain model of INPUT (I), ACTIVITY (A), OUTPUT (OP) and OUTCOME (OC) indicators. We have also included three CONTEXT (C) indicators. Local authorities are asked to provide only one data return. If a Council funds and/or provides more than one money advice service, the information should be aggregated locally before submission.
Context indicators
The context indicators are used to understand the make-up of money advice services and the people who access them within each Local Authority area. These indicators do not give performance information, but will help to explain the complexities surrounding money advice delivery across local authorities in Scotland.
REF / INDICATOR / DEFINITION / NOTESC1 / Money advice services and case management system/s in the local authority area / Local authorities should provide the total number and individual names of:
In-house money advice services
Externally-funded money advice providers
They should also list the case management systems used by money advice services in their area e.g. AdvicePro. / Where a Council funds a consortium containing several providers, each provider should be counted individually.
Outreach locations should not be counted as separate services.
C2 / Number of clients per demographic measure / Local authorities are required to provide the total number of clients dealt with per financial year, broken down into the following categories:
Sex / Male
Female
Not recorded
Year of Birth / 1937 and earlier
List of all years in between
2001 and later
Not recorded
Optional: Age / 0-15
16-24
25-34
35-44
45-59
60-74
75+
Not Recorded
Ethnicity / · White
· Mixed or Multiple Ethnic Groups
· Asian, Asian Scottish or Asian British
· African
· Caribbean or Black
· Other Ethnic Group
· Not recorded
Household Composition
· / A single adult household contains one adult (non-pensioner) and no children
A single pensioner household contains one pensioner and no children
A single parent household contains one adult (any age) and one or more children
A family household contains two adults (non-pensioner) and one or more dependent children
· Anadult familyhousehold contains two or more adults (non-pensioner) and no dependent children
An older adult family household contains at least one pensioner
· Not recorded
Disability or long-term condition / Yes
No
Not disclosed
Household Income
Note: income may be from a variety of sources-employment, welfare benefits, etc. / Net annual household income (after taxation and other deductions):
£6,000 or less
£6,001-£10,000
£10,001-£15,000
£15,001-£20,000
£20,001-£25,000
£25,001-£30,000
£30,001-£40,000
Over £40,000
Not recorded
Economic status
· / · Self-employed
· Employed full-time
· Employed part-time
· Looking after the home or family
· Permanently retired from work
· Unemployed and seeking work
· At school
· In further/higher education
· Government work or training scheme
· Permanently sick or disabled
· Unable to work because of short-term illness or injury
· Other
· Not recorded
Housing status / Owner occupier, which includes households who are buying their home with a mortgage or loan
·
· Tenant (Social Landlord), which includes tenants of local authorities and Housing Associations or Co-operatives
·
· Tenant (Private landlord)
·
· Othertenure, which includes any other category of tenure such as living rent free
Not recorded
/ An adult is anyone over the age of 16.
The definition of a ‘pensioner’ is a person for whom the majority of their income is derived from pension payments.
Reporting by year of birth was introduced as it was suggested that was offered the easiest and most consistent way of recording age. However, concerns have been expressed that providing data in this way would be challenging. As a result, an option to report by the existing age bandings has been included. Please include data in either category but not both. The preferred method of reporting is by year of birth.
C3 / Amount, number and type of debts owed by client / Local Authorities are required to provide the total amount of debt, associated with each category listed. The figures provided for this measure should relate to all clients when they make initial contact with the service (before receiving debt advice). It is accepted that in the course of getting advice further debts may be identified:
Benefit Overpayment
Council Tax arrears
Utility arrears
Credit, Store and Charge card debts
Catalogue debts
Unsecured personal loan (except payday loans)
Payday loan / High cost credit arrears
Bank and Building society overdrafts
Mortgage arrears
Rent arrears
Other (please specify)
/ The figures provided for this measure should include the debts of all clients who made initial contact in the current year. This should include clients whose cases have been closed within the financial year.
Input Indicators