Piloting new qualifications

Piloting new qualifications

14.1 New and revised qualifications will be introduced from time to time. Some proposed new qualifications may include much that is familiar, tried and tested and can be introduced with little significant risk to standards, to public confidence or to learners. Other qualification proposals, particularly if they include new approaches to assessment or are intended to be taken by large numbers of candidates, may present more of a risk.

14. 2 In May 2009 we published draft principles for piloting new or changed national qualifications.1 We would welcome more feedback on the principles, which are set out below.

When should qualifications be piloted?

14.3 We propose that we should consider the need for piloting when:

  • a national qualification (or group of qualifications) has a radically different structure or an innovative approach to assessment and/or subject content and/or
  • the qualification is eventually expected to be taken by large numbers of candidates and/or
  • the qualification is part of a national suite (such as GCSE), but is on a different timeline from the rest of the suite, and one or both of the other indicators are present.

Who decides when qualifications should be piloted?

14.4We propose that an awarding organisation, the government, or QCDA should make proposals to Ofqual for the introduction of a new qualification and that we should consider whether piloting is appropriate before adopting the criteria or agreeing that the qualification should be regulated.

If a pilot is to be launched, what principles should govern it?

14.5We propose that the following principles should govern any piloting arrangements:

  • learners taking a pilot qualification should not be advantaged or disadvantaged by the fact that they are participating in a pilot
  • there must be a clear purpose for the pilot
  • pilot qualifications should be explained to the public, to promote public confidence and support
  • the size of the pilot and the arrangements made should be decided to strike an appropriate balance across the following considerations:
    • the number of candidates and centres participating in pilots must be limited, so that those involved can be safeguarded should problems be identified
    • the number of examiners should be sufficient to assess and review all candidates’ work to ensure that consistent and appropriate standards are applied
    • the sample of candidates should, as far as possible, be representative of the range of centres, their geographical location and the diversity and ability range of candidates ultimately expected to take the qualification
    • the evaluation of a pilot should include an evaluation of the value for money of the qualification.

When can a piloted qualification be offered nationally?

14.6We propose that all pilots should run for sufficient time to allow a thorough testing of the aspects being piloted; normally this will take two years (plus the time required for evaluation). We propose that all pilots must be evaluated against their stated purpose.

14.7The evaluation would be conducted independently of QCDA or the awarding organisation and be reported to Ofqual. Evaluations of pilot national qualifications should be published.

14.8If QCDA or the awarding organisation decide, on the basis of the evaluation, that they wish to roll the qualification out, Ofqual would need to be satisfied that this was appropriate on the basis of the evidence from the evaluation.

Questions:

Loading...

  1. The first report of the Chief Regulator of Qualifications and Examinations, May 2009 [↩]

Comments are closed.