ASA Awarding Body

ASA Awarding Body

Internal Verification Guide 2012

Introduction

What is internal verification?

What is the link between internal verification, external verification and centre review?

How to produce an effective internal verification process

Identifying effective Internal Verifiers

Producing an effective internal verification policy

Producing supporting documentation

Producing an internal verification schedule

Producing a training and standardisation plan

Producing an improvement plan

Hints, tips and other aspects to consider

Further training and support

Appendix 1: Internal Verification of Assessment Activities

Appendix 2: Internal Verification of Assessment Decisions

Appendix 3: Example of Internal Verification of Assessment Activities

Appendix 4: Example of Internal Verification of Assessment Decisions

Appendix 5: Internal Verification Schedule

Appendix 6: Example of Internal Verification Schedule

Appendix 7: Internal Verification Improvement Plan

Appendix 8: Example of Internal Verification Improvement Plan

Introduction

All Approved Centres (AC) offering ASA qualifications must have effective internal verification processes in place to ensure that learners are assessed fairly and consistently, and that national standards are being met. The AC decides on the internal verification processes that are implemented. The ASA Awarding Body (AB) can offer guidance and support however it is the responsibility of the AC to decide how they implement internal verification to ensure it is effective.

The AB will check that effective internal verification processes are in place through both the centre review and external verification systems.

This guide is to support the AC in developing effective internal verification processes. It offers information, guidance and examples of practices that could be used either as they are, or amended to suit the needs of the individual AC.

Please note: Internal verification can be called internal quality assurance or moderation. For the purpose of this document the term internal verification will be used.

What is internal verification?

There are many aspects to consider when setting up internal verification processes. These could differ from one AC to another. The processes chosen should depend on the individual needs of the AC.Whatever processes are chosen they should aim to achieve the following two critical areas:

1. That the learners receive a quality experience
2. That resulting is accurate and safe

Page | 1

Internal verification processes can include quality checks on all working practices. Some of these are highlighted in Figure 1.

Again the AB will not tell the AC what they need to do or what needs to be included. It is up to the AC to choose what suits them best. However the minimum requirements are that there must be a system for internal verification of:

1. Assessment activities: to ensure all are effective and accurate
2. Assessment decisions: to ensure accuracy.

What is the link between internal verification, external verification and centre review?

Internal verification, external verification and centre review are all quality assurance processes. External verification and centre review are completed by the AB about the AC. Internal verification is completed by the AC and required by the AB.

External verification is completed at course level and includes sampling of assessment activities, assessment decisions and internal verification on specific courses. It focuses on the:

1. Accuracy and effectiveness of assessment activities produced by the AC
2. Accuracy and effectiveness of assessment decisions made by the AC
3. Effectiveness of internal verification completed by the AC.

Centre Review is completed on site at the AC and includes visits which focus on:

1. The practices and processes of the AC
2. Continuous improvement is also a critical aspect of this process.

There are nine sections that are reviewed within this process-key to this is assessment (section 2) and internal verification (section 3).

Internal verification, external verification and centre review are complimentary systems. It is strongly recommended that the AC views all these processes together to ensure that their value is maximised.

Please click on the following links for further information relating to External Verification and Centre Review. Alternatively please email Quality Assurance on .

How to produce an effective internal verification process

To establish a successful internal verification process, the following aspects should be completed:

1. Identify effective Internal Verifiers who are responsible for implementing these processes. If necessary identify a coordinating Internal Verifier who manages the process. This could be the Key Contact (KC)
2. Produce an effective internal verification policy
3. Produce supporting documentation that shows a clear audit trail of decision making and action
4. Produce an internal verification schedule of assessment activities and assessment decisions
5. Produce a training and standardisation plan for all those involved in internal verification
6. Produce an improvement plan.

To assist the AC in producing effective internal verification systems, this guide will work through the aspects listed above.

Identifying effective Internal Verifiers

It is the responsibility of the AC to recruit an effective internal verification team. This could be one person or a team, and could also include the role of being the coordinator. Again it is up to the AC to decide what suits them best.

The Internal Verifier should:

1. Have experience of effective assessment
2. Have experience of the subject matter of the learning programme
3. Understand the purpose and requirements of the AC internal verification policy
4. Have effective resources to carry out the internal verification policy and processes effectively
5. Be able to give effective feedback leading to improvement
6. Be able to support effective decision making with appropriate sanctions where needed.

There are some IV qualifications which are desirable, including:

1. 1st4sport Level 3 Certificate in Internal Verification Practice in Sport
2. Level 4 Award in the Internal Quality Assurance of Assessment Processes and Practice (which replaces the previous V1 qualification)
3. Or the equivalent such as D34, V1 and so on.

Producing an effective internal verification policy

Every AC should have an internal verification policy, which should be distributed to all relevant parties. It should also be reviewed on a regular basis.

An effective internal verification policy should outline the process that the AC will implement. Key details should be included, such as:

1. The name of the Centre
2. Who will complete internal verification
3. The frequency and quantity of internal verification to be completed

An example of an internal verification policy could be:

ABC Approved Centre is committed to the effective internal verification of all learning programmes. Appropriate systems are in place with all Tutors, Assessors and Internal Verifiers receiving effective training and standardisation to ensure effective implementation. All learning programmes will be internally verified. This will include both assessment activities and assessment decisions. The frequency and quantity of internal verification will be dependent on performance – which will be detailed in the internal verification schedule.

Producing supporting documentation

Remember each AC offering ASA qualifications needs to have effective internal verification processes in place to ensure that learners are assessed fairly and consistently, and that national standards are being met. Supporting documentation should be completed to show that the AC is doing this. The AB will want to review these documents as part of external verification and centre review. Ofqual, the regulatory body could ask to do this too.

The documents need to show as a minimum:

1. That assessment activities are fit for purpose, ensuring learners have the opportunity to generate evidence that meets both the assessment criteria and covers the unit content
2. That assessment decisions are accurate and consistent
3. That remedial action is taken where necessary
4. That all those involved are supported and developed where necessary
5. That sanctions can be enforced where necessary.

The following appendices offer examples of documentation that will meet these requirements.

Appendix 1Internal Verification of Assessment Activities

Appendix 2Internal Verification of Assessment Decisions

Appendix 3An Example of Internal Verification of Assessment Activities

Appendix 4An Example Internal Verification of Assessment Decisions

Producing an internal verification schedule

Internal verification is a planned process. Planning should:

1. Be short, medium and long term
2. Include all assessors
3. Include all units over a period of time
4. Include a range of learners
5. Include all courses, disciplines and levels

Furthermore, internal verification should include some random sampling. These spot checks can confirm effective practices and offer further support leading to improvement. Random checks also assist in guarding against malpractice.

This planning process should be recorded in an internal verification schedule. A template is included for your guidance (Appendix 5) along with a completed example (Appendix 6).

Producing a training and standardisation plan

All of those involved in assessment should be offered training and standardisation to allow for development and continuous improvement.

Standardisation is an activity to ensure that all Assessors are marking to national standards consistently. This process maximises both reliability and accuracy of certification. This can be done through a series of activities, such as:

1. Dual Assessment: This is where two Assessors assess the same learner and compare and contrast assessment decisions. This could also be where the Internal Verifier observes a practical assessment in real time or through video and discusses assessment decisions. It is good practice for internal verification of practical activities to be included within the internal verification schedule. This could be completed though dual assessment.

1. Blind Assessment: This is where Assessors all assess the same evidence independently and then compare responses. Development plans can then be produced to support those that need it. Furthermore any Assessors that are unsuccessfully standardised could then either not assess or only assess under supervision until the required standard is met.

1. Cross Assessment: This is where Assessors exchange marked learner evidence and comment accordingly. Again remedial action can be identified and actioned as appropriate.

It is also worth noting that the ASA AB carries out a standardisation test for all Assessors and Internal Verifiers. This information is then communicated to the AC so that they are aware of the level of accuracy of assessment for the Assessors they decide to use.

The AC chooses how they wish to standardise their workforce.

Producing an improvement plan

An integral part to internal verification is continuous improvement. Given all the documentation and processes highlighted in this guide already, the final step is to put together an action plan to ensure that the learning programme and the learner experience improves year on year.

The action plan could include:

1. Short, medium and long terms targets
2. A rationale for these targets
3. Timescales and milestones
4. Responsibility
5. The opportunity for review
6. Those involved
7. Outcomes

Atemplate of an improvement plan is included (Appendix 7) along with an example (Appendix 8)

Hints, tips and other aspects to consider

The following hints and tips will help you set up and implement an effective internal verification process:

1. An Internal Verifier cannot internally verify either assessment activities they have produced or assessment decisions they have made.
2. Internal verification is supportive and should aid development. It should be approached constructively and not used as a method of reproach.
3. Internal verification can be completed face to face or remotely-the AC can decide which method.
4. All learners should know at the start of their learning programme that certification is subject to internal verification (and external verification too).
5. The quantity and frequency of internal verification can depend on the performance of the Assessor-previous records can guide this.
6. If an Assessor disagrees with the decisions made by the Internal Verifier, the AC should have a process and personnel to deal with this.
7. Internal verification documentation should be securely stored so that trend analysis can occur and remedial action can be taken where needed.
8. Sufficient time should be allocated to complete the internal verification process fully.

Further training and support

The ASA AB offers a full programme of training, which includes training on internal verification. Please see the specific timetable and agendas. The training programme is advertised on the ASA website and is regularly updated. Each AC will receive notification of training in the AC update.

Appendix 1: Internal Verification of Assessment Activities

THIS IS AN EXAMPLE OF AN IV PROFORMA THAT APPROVED CENTRES MAY WISH TO USE OR THEY MAY DEVELOP THEIR OWN.

Assessment decisions will need to be sampled by the IV prior to distribution to the learners. In addition, any changes to the accuracy of the agreed assessment activity must be authorised by the IV.

Accessibility, Attractiveness and Learning Styles

Accuracy

Appendix 2: Internal Verification of Assessment Decisions

THIS IS AN EXAMPLE OF AN IV PROFORMA THAT APPROVED CENTRES MAY WISH TO USE OR THEY MAY DEVELOP THEIR OWN.

Assessment decisions made by all assessors will be sampled by the IV. Please refer to your IV schedule for timing, frequency and size. This will depend on the qualifications and experience of the assessor.

Appendix 3: Example of Internal Verification of Assessment Activities

Assessment decisions will need to be sampled by the IV prior to distribution to the learners. In addition, any changes to the accuracy of the agreed assessment activity must be authorised by the IV.

Accessibility, Attractiveness and Learning Styles

Accuracy

1. Work related scenario and tasks
2. Clear and concise

1. Consider allowing learners flexibility in Task 1 – giving possible options available to them.
2. Alternative approaches need to be considered for learners with differing assessment preferences.

Appendix 4: Example of Internal Verification of Assessment Decisions

Assessment decisions made by all assessors will be sampled by the IV. Please refer to your IV schedule for timing, frequency and size. This will depend on the qualifications and experience of the assessor.

Appendix 5: Internal Verification Schedule