ASA Awarding Body

ASA Awarding Body

Internal Verification Guide 2012

Introduction

What is internal verification?

What is the link between internal verification, external verification and centre review?

How to produce an effective internal verification process

Identifying effective Internal Verifiers

Producing an effective internal verification policy

Producing supporting documentation

Producing an internal verification schedule

Producing a training and standardisation plan

Producing an improvement plan

Hints, tips and other aspects to consider

Further training and support

Appendix 1: Internal Verification of Assessment Activities

Appendix 2: Internal Verification of Assessment Decisions

Appendix 3: Example of Internal Verification of Assessment Activities

Appendix 4: Example of Internal Verification of Assessment Decisions

Appendix 5: Internal Verification Schedule

Appendix 6: Example of Internal Verification Schedule

Appendix 7: Internal Verification Improvement Plan

Appendix 8: Example of Internal Verification Improvement Plan

Introduction

All Approved Centres (AC) offering ASA qualifications must have effective internal verification processes in place to ensure that learners are assessed fairly and consistently, and that national standards are being met. The AC decides on the internal verification processes that are implemented. The ASA Awarding Body (AB) can offer guidance and support however it is the responsibility of the AC to decide how they implement internal verification to ensure it is effective.

The AB will check that effective internal verification processes are in place through both the centre review and external verification systems.

This guide is to support the AC in developing effective internal verification processes. It offers information, guidance and examples of practices that could be used either as they are, or amended to suit the needs of the individual AC.

Please note: Internal verification can be called internal quality assurance or moderation. For the purpose of this document the term internal verification will be used.

What is internal verification?

There are many aspects to consider when setting up internal verification processes. These could differ from one AC to another. The processes chosen should depend on the individual needs of the AC.Whatever processes are chosen they should aim to achieve the following two critical areas:

That the learners receive a quality experience
That resulting is accurate and safe

Page | 1

Internal verification processes can include quality checks on all working practices. Some of these are highlighted in Figure 1.

Again the AB will not tell the AC what they need to do or what needs to be included. It is up to the AC to choose what suits them best. However the minimum requirements are that there must be a system for internal verification of:

Assessment activities: to ensure all are effective and accurate
Assessment decisions: to ensure accuracy.

What is the link between internal verification, external verification and centre review?

Internal verification, external verification and centre review are all quality assurance processes. External verification and centre review are completed by the AB about the AC. Internal verification is completed by the AC and required by the AB.

External verification is completed at course level and includes sampling of assessment activities, assessment decisions and internal verification on specific courses. It focuses on the:

Accuracy and effectiveness of assessment activities produced by the AC
Accuracy and effectiveness of assessment decisions made by the AC
Effectiveness of internal verification completed by the AC.

Centre Review is completed on site at the AC and includes visits which focus on:

The practices and processes of the AC
Continuous improvement is also a critical aspect of this process.

There are nine sections that are reviewed within this process-key to this is assessment (section 2) and internal verification (section 3).

Internal verification, external verification and centre review are complimentary systems. It is strongly recommended that the AC views all these processes together to ensure that their value is maximised.

Please click on the following links for further information relating to External Verification and Centre Review. Alternatively please email Quality Assurance on .

How to produce an effective internal verification process

To establish a successful internal verification process, the following aspects should be completed:

Identify effective Internal Verifiers who are responsible for implementing these processes. If necessary identify a coordinating Internal Verifier who manages the process. This could be the Key Contact (KC)
Produce an effective internal verification policy
Produce supporting documentation that shows a clear audit trail of decision making and action
Produce an internal verification schedule of assessment activities and assessment decisions
Produce a training and standardisation plan for all those involved in internal verification
Produce an improvement plan.

To assist the AC in producing effective internal verification systems, this guide will work through the aspects listed above.

Identifying effective Internal Verifiers

It is the responsibility of the AC to recruit an effective internal verification team. This could be one person or a team, and could also include the role of being the coordinator. Again it is up to the AC to decide what suits them best.

The Internal Verifier should:

Have experience of effective assessment
Have experience of the subject matter of the learning programme
Understand the purpose and requirements of the AC internal verification policy
Have effective resources to carry out the internal verification policy and processes effectively
Be able to give effective feedback leading to improvement
Be able to support effective decision making with appropriate sanctions where needed.

There are some IV qualifications which are desirable, including:

1st4sport Level 3 Certificate in Internal Verification Practice in Sport
Level 4 Award in the Internal Quality Assurance of Assessment Processes and Practice (which replaces the previous V1 qualification)
Or the equivalent such as D34, V1 and so on.

Producing an effective internal verification policy

Every AC should have an internal verification policy, which should be distributed to all relevant parties. It should also be reviewed on a regular basis.

An effective internal verification policy should outline the process that the AC will implement. Key details should be included, such as:

The name of the Centre
Who will complete internal verification
The frequency and quantity of internal verification to be completed

An example of an internal verification policy could be:

ABC Approved Centre is committed to the effective internal verification of all learning programmes. Appropriate systems are in place with all Tutors, Assessors and Internal Verifiers receiving effective training and standardisation to ensure effective implementation. All learning programmes will be internally verified. This will include both assessment activities and assessment decisions. The frequency and quantity of internal verification will be dependent on performance – which will be detailed in the internal verification schedule.

Producing supporting documentation

Remember each AC offering ASA qualifications needs to have effective internal verification processes in place to ensure that learners are assessed fairly and consistently, and that national standards are being met. Supporting documentation should be completed to show that the AC is doing this. The AB will want to review these documents as part of external verification and centre review. Ofqual, the regulatory body could ask to do this too.

The documents need to show as a minimum:

That assessment activities are fit for purpose, ensuring learners have the opportunity to generate evidence that meets both the assessment criteria and covers the unit content
That assessment decisions are accurate and consistent
That remedial action is taken where necessary
That all those involved are supported and developed where necessary
That sanctions can be enforced where necessary.

The following appendices offer examples of documentation that will meet these requirements.

Appendix 1Internal Verification of Assessment Activities

Appendix 2Internal Verification of Assessment Decisions

Appendix 3An Example of Internal Verification of Assessment Activities

Appendix 4An Example Internal Verification of Assessment Decisions

Producing an internal verification schedule

Internal verification is a planned process. Planning should:

Be short, medium and long term
Include all assessors
Include all units over a period of time
Include a range of learners
Include all courses, disciplines and levels

Furthermore, internal verification should include some random sampling. These spot checks can confirm effective practices and offer further support leading to improvement. Random checks also assist in guarding against malpractice.

This planning process should be recorded in an internal verification schedule. A template is included for your guidance (Appendix 5) along with a completed example (Appendix 6).

Producing a training and standardisation plan

All of those involved in assessment should be offered training and standardisation to allow for development and continuous improvement.

Standardisation is an activity to ensure that all Assessors are marking to national standards consistently. This process maximises both reliability and accuracy of certification. This can be done through a series of activities, such as:

Dual Assessment: This is where two Assessors assess the same learner and compare and contrast assessment decisions. This could also be where the Internal Verifier observes a practical assessment in real time or through video and discusses assessment decisions. It is good practice for internal verification of practical activities to be included within the internal verification schedule. This could be completed though dual assessment.

Blind Assessment: This is where Assessors all assess the same evidence independently and then compare responses. Development plans can then be produced to support those that need it. Furthermore any Assessors that are unsuccessfully standardised could then either not assess or only assess under supervision until the required standard is met.

Cross Assessment: This is where Assessors exchange marked learner evidence and comment accordingly. Again remedial action can be identified and actioned as appropriate.

It is also worth noting that the ASA AB carries out a standardisation test for all Assessors and Internal Verifiers. This information is then communicated to the AC so that they are aware of the level of accuracy of assessment for the Assessors they decide to use.

The AC chooses how they wish to standardise their workforce.

Producing an improvement plan

An integral part to internal verification is continuous improvement. Given all the documentation and processes highlighted in this guide already, the final step is to put together an action plan to ensure that the learning programme and the learner experience improves year on year.

The action plan could include:

Short, medium and long terms targets
A rationale for these targets
Timescales and milestones
Responsibility
The opportunity for review
Those involved
Outcomes

Atemplate of an improvement plan is included (Appendix 7) along with an example (Appendix 8)

Hints, tips and other aspects to consider

The following hints and tips will help you set up and implement an effective internal verification process:

An Internal Verifier cannot internally verify either assessment activities they have produced or assessment decisions they have made.
Internal verification is supportive and should aid development. It should be approached constructively and not used as a method of reproach.
Internal verification can be completed face to face or remotely-the AC can decide which method.
All learners should know at the start of their learning programme that certification is subject to internal verification (and external verification too).
The quantity and frequency of internal verification can depend on the performance of the Assessor-previous records can guide this.
If an Assessor disagrees with the decisions made by the Internal Verifier, the AC should have a process and personnel to deal with this.
Internal verification documentation should be securely stored so that trend analysis can occur and remedial action can be taken where needed.
Sufficient time should be allocated to complete the internal verification process fully.

Further training and support

The ASA AB offers a full programme of training, which includes training on internal verification. Please see the specific timetable and agendas. The training programme is advertised on the ASA website and is regularly updated. Each AC will receive notification of training in the AC update.

Appendix 1: Internal Verification of Assessment Activities

THIS IS AN EXAMPLE OF AN IV PROFORMA THAT APPROVED CENTRES MAY WISH TO USE OR THEY MAY DEVELOP THEIR OWN.

Assessment decisions will need to be sampled by the IV prior to distribution to the learners. In addition, any changes to the accuracy of the agreed assessment activity must be authorised by the IV.

Qualification:
Unit:
Task:
Criteria being targeted?
Type of activity:
Issue date:
Produced by:
Internally Verified by:
Date:

Accessibility, Attractiveness and Learning Styles

Comments
Please comment on the attractiveness of assessment activity to the learners.
Please comment on the suitability of the language.
Yes/No / Comments
Overall, is the assessment activity interesting and engaging for the learners?
Is the assessment activity ready to be used/issued?

Accuracy

Yes/No / Comments
Is the level of activity correct (is the verb the same as stated in the criteria)?
Is the content reflective of what is specified in the unit?
Overall, does the activity generate the evidence required to meet the assessment criteria?
Key strengths of the assessment activity are:
Key areas for development of the assessment activity are:
Please identify any remedial action (by who, when, what):
Has remedial action been taken?
Internal Verifier Signature:
Date:

Appendix 2: Internal Verification of Assessment Decisions

THIS IS AN EXAMPLE OF AN IV PROFORMA THAT APPROVED CENTRES MAY WISH TO USE OR THEY MAY DEVELOP THEIR OWN.

Assessment decisions made by all assessors will be sampled by the IV. Please refer to your IV schedule for timing, frequency and size. This will depend on the qualifications and experience of the assessor.

Qualification:
Unit:
Task:
Assessment criteria being assessed?
Assessor:
Internal Verifier:
Date of Assessment:
Learner:
Yes/No / Comments
Is the evidence accurately assessed in terms of:
Level (the verb)
Content (the syllabus)
Accuracy
Is the learner’s work their own?
Please add any other comments:
Internal Verifier Signature:
Date:
Please identify any remedial action: (by who, when, what)
Review of the remedial action:

Appendix 3: Example of Internal Verification of Assessment Activities

Assessment decisions will need to be sampled by the IV prior to distribution to the learners. In addition, any changes to the accuracy of the agreed assessment activity must be authorised by the IV.

Qualification: / Level 1 Award in Teaching Aquatics (QCF)
Unit: / 101: Understanding the FUNdamentals of coaching/teaching sport
Task: / Communication is the Key
Criteria being targeted? / 101.1.1 & 101.1.2
Type of activity: / Worksheet/Written Evidence
Issue date: / 14/06/2012
Produced by: / From H20 Zone website
Internally Verified by: / Lindsi Lewis
Date: / 03/06/2012

Accessibility, Attractiveness and Learning Styles

Comments
Please comment on the attractiveness of assessment activity to the learners. / The assessment activity is fine and has a relevant context if issued in conjunction with the introduction sheet. It will appeal to learners who like to produce evidence in this format – although others may prefer alternative methods.
Please comment on the suitability of the language. / The language is fine – easy to follow & understand.
Yes/No / Comments
Overall, is the assessment activity interesting and engaging for the learners? / Yes / See comments on previous page
Is the assessment activity ready to be used/issued? / Yes

Accuracy

Yes/No / Comments
Is the level of activity correct (is the verb the same as stated in the criteria)? / Yes / The assessment verbs used in both tasks are the same as those required in the criteria.
Is the content reflective of what is specified in the unit? / Yes / The content is reflective – although specific examples have been identified in the first task when flexibility is allowed. I understand why this approach has been taken – although this point needs to be taken into account when assessing learners.
Overall, does the activity generate the evidence required to meet the assessment criteria? / Yes
Key strengths of the assessment activity are:

Work related scenario and tasks
Clear and concise

Key areas for development of the assessment activity are:

Consider allowing learners flexibility in Task 1 – giving possible options available to them.
Alternative approaches need to be considered for learners with differing assessment preferences.

Please identify any remedial action (by who, when, what):
The above points need to be taken into account prior to this assessment activity being used on subsequent programmes...although it is fine to use it on this occasion.
Has remedial action been taken?
N/A
Internal Verifier Signature: / Lindsi Lewis
Date: / 03/06/2012

Appendix 4: Example of Internal Verification of Assessment Decisions

Qualification: / Level 1 Award in Teaching Aquatics (QCF)
Unit: / 101: Understanding the FUNdamentals of coaching/teaching sport
Task: / Accidents, Emergencies, Injuries and Illnesses
Assessment criteria being assessed? / 101.3.4 & 101.3.5
Assessor: / Juliet Judd
Internal Verifier: / Lindsi Lewis
Date: / 19/06/2012
Learner: / Iain Innis
Yes/No / Comments
Is the evidence accurately assessed in terms of:
Level (the verb) / See comments / Task 1 – no, as the importance has not been explained
Task 2 – yes, the verb is identify and this has been done
Content (the syllabus) / Yes
Accuracy / Yes
Is the learner’s work their own? / Yes / The learners signature is on the assessment
Please add any other comments:
The learner could have been questioned regarding the issue with Task 1.
Internal Verifier Signature: / Lindsi Lewis
Date: / 21/06/2012
Please identify any remedial action: (by who, when, what)
The learner needs to be re-assessed on task 1 – ensuring they explain the importance of dealing with accidents & emergencies promptly, calmly and correctly.
This can be done verbally (and recorded) accordingly.
Review of the remedial action:
The annotation on the learners work confirms the above has been completed to a satisfactory standard. It’s good to see the level of detail included by the assessor – making the IV decision easy to complete.

Appendix 5: Internal Verification Schedule