Adult survey–spring 2017

Summary of survey results

About the survey

This short paper summarises the findings of an online surveyconducted by Skills for Careduring the period 20April to 5May2017. The focus of the survey reflectsthe range of activity that Skills for Care has been involved in / supported over the past six months.As this was the second survey in six months we took the opportunity to ask questions about a number of areas that we had not previously included in our regular surveys.The surveywas distributed via email to 339people and 93 responses were received.

Key messages from the survey

In summary, the key messages from the survey are as follows:

  • Levels of understanding of the current arrangements for the assessment of the ASYE (adults) against the KSS are high
  • Assessors and NQSWs find the holistic assessment outcomes and the exemplar Critical Reflection Log useful
  • The KSS is only partially embedded across the workforce (a third of employers have still not begun the process).
  • Levels of understanding amongst social workers (excluding NQSWs) of the KSS and its relevance to their practice was lower than anticipated. This could be improved with more support from senior leaders and ensuring that the KSS is embedded throughout the culture and policies of organisations
  • The consistency of assessment of direct observations is generally agreed upon, but could be improved with greater understanding of the skills required, enhanced assessment skills and improved guidance.
  • There is an appetite for a secure system for videoing direct observations to record practice, remove observer bias and support reflection.
  • Skills for Care’s internal moderation templates are being widely used and are generally agreed to be user friendly, relevant in supporting practice improvements and relevant in recording key information.
  • Those who have submitted evidence to the national moderation panel have found the feedback useful.
  • Most organisations have minimum requirements for their ASYE assessors and are confident in their capability.
  • The ASYE has had a positive impact on outcomes for people who receive care and support, as well as on managing the performance of NQSWs about whom there is a concern and also on NQSW recruitment and retention.
  • The biggest challenges in the coming 12-24 months are embedding the KSS throughout the workforce, improving the capacity of assessors and planning and developing an integrated workforce.
  • Support provided by Skills for Care in the form of tools, resources, support and guidance is well received.

Detailed findings and analysis

About the respondents

Seven out of tenrespondents (71%) were likely to have organisational responsibility for ASYE being either ASYE coordinators or learning and development leads, or both. 5% were Principal Social Workers. Those who ticked the ‘Other’ box included various management roles, (senior) social workers as well as advisors, service leads and development officers[see Chart 1].

Chart 1: Job role (n=86) Q4

Two-thirds (64%) of respondents work in adult services and a third (33%) work across adults and child and family services[see Chart 2].

Chart 2: Area of work (n=86)Q5

Four-fifths (81%) of respondents work for a Local Authority. 13% work for a voluntary/third sector organisation, 3% in the statutory health sector and 2% in the private sector [see Chart 3].

Chart 3: Type of organisation (n=93) Q1

Half of respondents (50%) work for organisations that operate in the North of England, slightly fewer (46%) work for organisations operating in the South and one in five (19%) for those operating in the Midlands[1][see Chart 4].

Chart 4: Geographic location (n=93) Q2

A fifth (18%) of respondents work for organisations employing up to 50 social workers, a third (33%) work for organisations employing 50-99 social workers and two-fifths (41%) work for organisations employing more than 100 social workers [see Chart 5].

Chart 5: Number of Social Workers employed (n=89) Q3

The survey results

Assessment of the ASYE against the PCF and the KSS

We asked a question to explore understanding of the current arrangements for the assessment of the ASYE (adults) against the KSS. Almost all (94%) of the respondents said that they understood the arrangements either ‘very well’ or ‘fairly well’ [see Chart 6].

Chart 6: How well do you understand the current arrangements for the assessment of the ASYE (adults) against the KSS? (n=83)Q6

When we asked the same question in the initial survey (April/May 2015) 78% said they understood the arrangements ‘very’ or ‘fairly well’. This increased to 92% in the second survey (July/August 2016). The increase to 94% in the current survey is not statistically significant.

We then asked about the usefulness of the holistic assessment outcomes for Assessors and NQSWs wanting to gather and assess evidence for the ASYE. Four-fifths of respondents said that both Assessors and NQSWs found them very or fairly useful (80% and 81% respectively) [see Chart 7].

Chart 7: Usefulness of the holistic assessment outcomes (n=75/73) Q7

We also asked about the usefulness of the exemplar critical reflection log. More than four-fifths of respondents said that both assessors and NQSWs found it very or fairly useful (86% each) [see Chart 8].

Chart 8: Usefulness of the exemplar Critical Reflection Log (n=72/71) Q8

Respondents were asked if there was any other guidance that would help to support assessors with the assessment against the PCF and the KSS (Q9). 50 people answered this question. The main area where further guidance was felt to be needed related to holistic assessment against the PCF and the KSS, followed by further information about the evidence that is required for scrutiny by the national moderation panel. Generally there was a plea for more practice examples and exemplars, with all information to be presented in a clear and succinct manner.

Respondents were asked if there was any other guidance that would help to support NQSWs with the assessment against the PCF and the KSS (Q10). 48 people answered this question. As with the needs of assessors, respondents felt that additional guidance about providing evidence against the PCF and the KSS would be helpful, as well as making a general plea for more practice examples.

Embedding the KSS across the social work workforce

Two-thirds (65%) of respondents said that their organisation had undertaken activity to embed the KSS across the whole of the social work workforce (Q11). 75 respondents gave examples of the activities undertaken. These ranged from embedding the KSS within job descriptions and performance management processes, to aligning learning and development with the KSS and promoting the KSS within supervisor/manager training. Other activities include a range of briefing/ awareness raising activities and the creation of a variety of audit tools. A couple of respondents indicated that their children services are more focussed on the KSS than adult services because of the National Accreditation and Assessment System (NAAS).

Levels of understanding amongst social workers (excluding NQSWs) of the KSS and its relevance to their practice was lower than anticipated. Over half (57%) said that the level of understanding was low, whilst two-fifths (41%) described the level of understanding as medium [see Chart 9].

Chart 9: Level of understanding amongst social workers of the KSS and its relevance to practice (n=74) Q12

In order to understand the support needed to improve levels of understanding respondents were asked to give their suggestions (Q13). 58 people answered this question. The most popular response referred to the importance of senior leaders understanding the point of the KSS and relaying this to their staff through a range of awareness raising opportunities. There was also a sense that the KSS needs to be embedded within job descriptions and performance management structures, reflective supervision practices and all learning and development activities and that social workers need to have clarity about the KSS in relation to the PCF. A significant number of respondents advocated the importance of external influencers such as linking the KSS with professional registration. It was also acknowledged the recruitment of NQSWs and the ASYE will naturally support the KSS being embedded across the workforce.

Direct observations

Seven in ten (71%) of respondents were fairly or very satisfied with the consistency of the assessment of Direct Observation of Practice in their organisation [see Chart 10].

Chart 10: Satisfaction with the consistency of the assessment of the Direct Observation of Practice (not NQSWs) (n=72) Q14

Respondents were then asked about a variety of things that have the potential to improve the quality of direct observations. For assessors the top three were: Understanding the skills required; developing overall assessment skills; and improved guidance. For NQSWs the top three were: Having an improved understanding of holistic assessment; Improved guidance; and tighter assessment criteria [see Chart 11].

Chart 11: Things that would improve the quality of Direct Observations (n=67) Q15

There is an appetite for introducing a secure solution for videoed direct observations. 16% of respondents said they would definitely use this if it were available and 52% said they would consider it. A third (32%) of respondents said they weren’t interested in this (Q16).

Those who indicated that they were interested in a potential videoing solution fordirect observations felt it would provide a clear record of practice, remove observer bias and support reflection, leading to a more robust learning and assessment experience. Those who rejected the idea were concerned with a range of practical matters including cost, time, consent issues and secure storage of data. They were worried also about the demands that this would place on the service user and the NQSW. Finally there were a small number of respondents who wished to reserve judgement until they had further information about the way in which this process would be managed (Q17).

Skills for Care’s Internal Moderation templates

The majority (88%) of respondents are using Skills for Care’s internal moderation summary report to summarise the outcomes of the moderation process and include recommendations for future assessments (Q18). Those who aren’t are relying on their own templates or have plans to start using the Skills for Care templates in the near future (Q19).

The internal moderation templates are generally well received: three-fifths (60%) of respondents agreed that they are user friendly; four-fifths (78%) agreed that they are relevant in supporting improvements in practice; and more than four-fifths (83%) agree that they are relevant in recording key information [see Chart 12].

Chart 12: Views on the Skills for Care Internal Moderation templates (n=63) Q20

The national moderation panel

Three-fifths (61%) of respondents said that their organisation has been asked to submit evidence to the national moderation panel (Q21). The majority of these respondents said that they had found the feedback from the Panel fairly or very useful (68% and 30% respectively) (Q22).

Half of the respondents (52%) said that they always read the key messages issued by the National Panel after each Panel meeting and a third (33%) said that they sometimes read. 16% said that they never read them (Q24). Of those who do read the key messages, the majority have found them fairly or very useful (60% and 30% respectively) (Q25).

Capability of assessors

Respondents were asked whether their organisation has minimum requirements / standards for ASYE assessors. The majority (84%) do [see Chart 13].

Chart 13: Whether organisations have minimum requirements/standards for ASYE assessors (n=64) Q26

The majority of respondents are fairly or very confident in the capability of the assessors in their organisation (70% and 17% respectively) (Q27).

There are a number of ways that organisations are supporting the development of their ASYE assessors. The most popular support mechanism is Assessor forums / briefings (77%), followed by development programmes linked to PEPs / PDEs (28%) [see Chart 14].

Chart 14: How the development of ASYE assessors is developed (n=60) Q28

Slightly more respondents said that they were planning and delivering assessor development as an ASYE partnership (54% compared with 46% who said that they weren’t doing this) (Q29).

The impact of the ASYE

The most positive impact of the ASYE seems to have been in relation to outcomes for people who receive care and support (86% agreed or strongly agreed with this statement). This was closely followed by it having a positive impact on the management of the performance of NQSWs about whom there is a concern (81% agreed or strongly agreed with this). Seven out of ten (70%) respondents agreed that the ASYE had had a positive impact on the recruitment of NQSWs. Finally, two-thirds (63%) of respondents agreed that the ASYE had had a positive impact on the retention of social workers beyond their first year and also the implementation of change [see Chart 15].

Chart 15: Agreement with the statement: The ASYE has had a positive impact on… (n=63) Q30

Respondents were asked to consider the challenges facing their organisation over the next 1-2 years:

In relation to the ASYE the challenges are (Q31):

  • Improving the capacity of assessors (76%)
  • Putting in place the support arrangements for the ASYE (48%)
  • Participation in the capability of assessors (24%)

In relation to the Continuing Professional Development the challenges are (Q32):

  • Embedding the KSS across the workforce (82%)
  • Supporting leaders and managers (77%)

In relation to the Other areas the challenges are (Q33):

  • Planning and developing an integrated workforce (75%)
  • Participation in teaching partnerships (57%)

Support from Skills for Care

Skills for Care offers a wide variety of support to the sector and it is useful to check that it is meeting a need. Whilst not all respondents have used all of the support on offer, feedback across the range overall is positive. The only support that scored below 90% was webinars.

Skills for Care webinars have only been used by a small number of respondents, but 9 out of 23 said that they were ‘not very useful’ so this is something for us to bear in mind in future and to evaluate on a case by case basis [see Chart 16].

Chart 16: Usefulness of various Skills for Care support over the past 6 months (n=23-59) Q35

Skills for Care put on a series of events called ‘Next steps in social work reform: Embedding the KSS’ in between 7thFebruary and 10thMarch 2017. 45% of respondents to this survey had attended the event (Q36). The event was well received by respondents who rated the relevance of the three workshops as follows (Q37):

  • The PCF – Past, Present and Future – 100% relevant (59% very relevant / 41% fairly relevant)
  • National assessment and accreditation system (NAAS) – 82%relevant (39% very relevant / 43% fairly relevant)
  • Developing and implementing the practice supervisors KSS – 100% relevant (67% very relevant / 33% fairly relevant)

We asked respondents about the actions they will be taking forward in their organisation as a result of attending the event (Q38). 23 respondents answered this question. Most spoke about the need to embed the KSS within the workforce, as well as supporting ASYEs and assessors through a period of change.

[1]NB: Percentages add up to more than 100% because 18 respondents indicated that they work across two or more areas.