<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Regulating for confidence in standards</title>
	<atom:link href="http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/feed/" rel="self" type="application/rss+xml" />
	<link>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards</link>
	<description>Consultation on the regulation of qualifications, examinations and assessments</description>
	<lastBuildDate>Tue, 09 Mar 2010 00:55:33 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9.2</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>The five common assessment criteria</title>
		<link>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/annexe-b/the-five-common-assessment-criteria/</link>
		<comments>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/annexe-b/the-five-common-assessment-criteria/#comments</comments>
		<pubDate>Fri, 11 Dec 2009 07:08:19 +0000</pubDate>
		<dc:creator>admin</dc:creator>
				<category><![CDATA[Annexe B]]></category>

		<guid isPermaLink="false">http://comment.ofqual.gov.uk/ascl/?p=530</guid>
		<description><![CDATA[Quality of assessment outcomes
We have developed the following definitions of five criteria that allow stakeholders and Ofqual to evaluate assessments. The definitions have been debated widely and we will refine them again in light of suggestion we receive during the consultation.
Validity
Validity is the central concept in evaluating the quality of assessment outcomes.  It is the [...]]]></description>
			<content:encoded><![CDATA[<h2>Quality of assessment outcomes</h2>
<p>We have developed the following definitions of five criteria that allow stakeholders and Ofqual to evaluate assessments. The definitions have been debated widely and we will refine them again in light of suggestion we receive during the consultation.</p>
<strong>Validity</strong>
<p>Validity is the central concept in evaluating the quality of assessment outcomes.  It is the overarching concept and subsumes the other concepts.  Validity is a multi-faceted, but unitary concept – other concepts such as reliability, comparability and minimising bias are aspects of validity, but validity remains one whole, indivisible concept.  However, aspects of validity can be in conflict; for instance, to make more reliable test scores, one might make a test longer, but this would tend to make the test less manageable.</p>
<p>Validity pertains to the arguments or interpretations placed on assessment outcomes, results or scores. It does not relate to the test or other assessment procedure itself, nor to the scores generated by that assessment. So, in evaluating validity, one would be evaluating arguments such as the following.</p>
<ul>
<li>‘The results of this assessment provide a sound basis for selecting students to enter university.’</li>
<li>‘The results of this assessment provide useful information for teachers in succeeding years to understand pupils’ strengths and weaknesses.’</li>
</ul>
<p>The evaluation of validity will amount to working out whether the outcomes of the assessment procedure (grades, profile of the child and so on) provide adequate information to sustain the argument being made.  One needs to evaluate validity separately for each interpretation that is made.</p>
<p>Validity will rarely be an absolute condition; for example, one would be more likely to decide that ‘the outcomes from this assessment are <em>sufficiently</em> valid’ rather than saying they are valid in absolute terms.</p>
<strong>Reliability</strong>
<p>Reliability relates to the propensity of an assessment procedure to generate consistent outcomes.  If an assessment procedure tends to give the same result when repeated, then it will tend to be reliable.  Reliability is a property of the assessment outcomes (such as scores, grades and levels), not of the test itself.</p>
<p>Reliability is a necessary condition for validity; if an assessment procedure is not measuring consistently, in effect it is not measuring at all. Achieving this with teacher assessment is dependent on the quality of criteria, moderation processes and exemplification and guidance, for example.<sup>1</sup></p>
<strong>Comparability</strong>
<p>Comparability relates to the extent to which several (different) assessment procedures generate consistent outcomes.  For example, one might consider comparability between:</p>
<ul>
<li>years (was this year’s test easier or harder than last year’s?)</li>
<li>subjects/ areas of learning (is the standard in key stage 2 Maths higher or lower than in key stage 2 Science?).</li>
</ul>
<p>Like reliability, comparability relates to assessment outcomes such as scores or grades rather than the test or assessment itself.  Like validity, aspects of comparability can be conflict: for example, one may have to choose whether to retain comparability between years or seek to improve the moderation of assessments.  One may not be able to guarantee both.</p>
<strong>Manageability</strong>
<p>An assessment can be deemed manageable if it is possible to carry it out, given known practical constraints such as: time, budget or numbers of pupils. Unlike validity, reliability and comparability, manageability <em>does</em> relate to the assessment procedure itself; for example, one could have a very long test that produced very reliable results, yet was not sufficiently manageable.</p>
<strong>Minimisation of bias</strong>
<p>An assessment can be said to minimise bias in so far as it does not produce unreasonably adverse outcomes for a group of learners with given social characteristics (for example, gender, age, disability, sexuality, ethnic origin, socio-economic status and so on).  Minimising bias as a characteristic of assessment is closely related to statutory equality duties.</p>
<ol class="footnotes"><li id="footnote_0_530" class="footnote">The word 'reliable' is used in the Act in Ofqual's qualifications and assessment standards objectives, but the use of the word there should not be interpreted in a technical sense.</li></ol>
]]></content:encoded>
			<wfw:commentRss>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/annexe-b/the-five-common-assessment-criteria/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>About Ofqual</title>
		<link>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/foreword/about-ofqual/</link>
		<comments>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/foreword/about-ofqual/#comments</comments>
		<pubDate>Fri, 11 Dec 2009 04:03:28 +0000</pubDate>
		<dc:creator>admin</dc:creator>
				<category><![CDATA[Foreword]]></category>

		<guid isPermaLink="false">http://comment.ofqual.gov.uk/ascl/?p=464</guid>
		<description><![CDATA[Ofqual is the regulator of qualifications, examinations and assessments in England. Ofqual will regulate vocational qualifications in Northern Ireland. Ofqual aims to ensure that children, young people and adult learners get the results their work deserves, that standards are maintained and that the qualifications learners receive count now and in the future.


Ofqual’s legal status


The Qualifications and [...]]]></description>
			<content:encoded><![CDATA[<p>Ofqual is the regulator of qualifications, examinations and assessments in England. Ofqual will regulate vocational qualifications in Northern Ireland. Ofqual aims to ensure that children, young people and adult learners get the results their work deserves, that standards are maintained and that the qualifications learners receive count now and in the future.</p>


<h2>Ofqual’s legal status</h2>


<p>The Qualifications and Curriculum Authority (QCA) is currently operating its regulatory functions under the name Office of the Qualifications and Examinations Regulator (Ofqual). The legal entity remains QCA, established under the Education Act 1997. QCA is an exempt charity under the Charities Act 1993.</p>

<p>The Apprenticeships, Skills, Children and Learning Act 2009<sup>1</sup> will establish Ofqual (The Office of Qualifications and Examinations Regulation) as a separate statutory body and, upon commencement, scheduled for 1 April 2010, Ofqual will become the independent regulator of qualifications, examinations and assessments in England and of vocational qualifications in Northern Ireland.</p>

<p>Publication of this document marks the start of a consultation process commenced by QCA, in the name of Ofqual, at the direction of the Secretary of State.</p><ol class="footnotes"><li id="footnote_0_464" class="footnote"><a href="http://www.opsi.gov.uk/acts/acts2009/pdf/ukpga_20090022_en.pdf" target="_blank">http://www.opsi.gov.uk/acts/acts2009/pdf/ukpga_20090022_en.pdf</a></li></ol>
]]></content:encoded>
			<wfw:commentRss>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/foreword/about-ofqual/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Foreword</title>
		<link>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/foreword/foreword/</link>
		<comments>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/foreword/foreword/#comments</comments>
		<pubDate>Fri, 11 Dec 2009 03:59:53 +0000</pubDate>
		<dc:creator>admin</dc:creator>
				<category><![CDATA[Foreword]]></category>

		<guid isPermaLink="false">http://comment.ofqual.gov.uk/ascl/?p=461</guid>
		<description><![CDATA[Kathleen Tattersall, Chair of Ofqual
As Chief Regulator, I am delighted to announce the launch of the consultation into how Ofqual should meet its objectives and exercise its duties and powers. Ofqual is the new independent regulator of qualifications, examinations and assessments. Ofqual’s remit in England covers regulated qualifications and assessments taken by learners of all [...]]]></description>
			<content:encoded><![CDATA[<h2>Kathleen Tattersall, Chair of Ofqual</h2>
<p>As Chief Regulator, I am delighted to announce the launch of the consultation into how Ofqual should meet its objectives and exercise its duties and powers. Ofqual is the new independent regulator of qualifications, examinations and assessments. Ofqual’s remit in England covers regulated qualifications and assessments taken by learners of all ages, ranging from assessments of pre-school children to qualifications taken by retired people looking to widen their skills. In Northern Ireland our remit covers vocational qualifications. Ofqual aims to ensure that these qualifications and assessments are reliable, fit for purpose and will retain their worth. We want to support and safeguard qualifications which learners, parents, carers, employers and universities can rely on as a true indicator of achievement. As someone who believes in the power of qualifications to change lives, this subject is close to my heart and I understand the value of working closely with our stakeholders to ensure we have the best regulatory model in place.</p>
<p>Ofqual was created in interim form in April 2008. Before this, regulation of qualifications was carried out by the Qualifications and Curriculum Authority (QCA). The Apprenticeships, Skills, Children and Learning (ASCL) Act, which will make Ofqual an independent body, has now passed through Parliament. We expect that Ofqual will be established as a statutory independent body in April 2010.</p>
<p>Initially we will use transitional and interim measures to enable us to carry forward established approaches to regulation, while we complete our consultations and introduce our new regulatory model in a managed way.</p>
<p>The Act sets out five clear objectives for Ofqual – to secure the standards of regulated qualifications; to promote standards of regulated assessments; to promote public confidence in qualifications and assessment arrangements; to promote awareness and understanding of regulated qualifications and to secure efficiency and value for money in qualifications. Overall, learners are at the heart of all Ofqual does.</p>
<p>To help ensure we meet the objectives set out in the ASCL Act and provide the best service possible, we are now carrying out a full consultation with our stakeholders. We value your views, which we will use to shape the future of Ofqual and the regulation of the qualifications and assessment systems.</p>
<h2>What we are consulting on</h2>
<p>We would like your feedback on how we should meet our objectives, fulfil our duties and use our powers. The themes of our consultation are set out in this document. Areas covered include our approach to recognising awarding organisations; how we will monitor awarding organisations and the regulated qualifications they offer; the steps we will take when we identify problems and how we will keep all aspects of statutory national curriculum and early years foundation stage (EYFS) assessment arrangements under review.</p>
<h2>Consultation period</h2>
<p>The consultation period will last from 11 December 2009 to 8 March 2010. During this time we will be speaking to as many stakeholder groups as possible. Ofqual’s aim is to build up strong relationships with our stakeholders which will last after this consultation has ended.</p>
<h2>Next steps</h2>
<p>After the close of this consultation we will reflect carefully on the responses we receive. As our initial proposals are developed and refined we will undertake further consultations where appropriate.</p>
<h2>Giving your feedback</h2>
<p>You can give us your feedback in a number of ways.  We would prefer you to respond using the online form <a href="http://www.ofqual.gov.uk/consultation">www.ofqual.gov.uk/consultation</a>.</p>
<p>We will also accept responses by email sent to: <a href="mailto:consultationresponses@ofqual.gov.uk">consultationresponses@ofqual.gov.uk</a> or by post to:</p>
<p>Regulatory Policy Team, Spring Place, Coventry  Business Park, Herald Avenue, Coventry,  CV5 6UB.</p>
<p>The last date for responses is 8 March 2010.</p>
<p>I do hope to hear from as many of you as possible and would welcome comments on any part of our proposals. I hope together we can support and maintain qualifications and assessments of which we can all be proud.</p>
<p></em>Kathleen Tattersall<em></p>

]]></content:encoded>
			<wfw:commentRss>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/foreword/foreword/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Regulation of national curriculum and EYFS assessments</title>
		<link>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/regulation-of-national-curriculum-and-early-years-foundation-stage-assessments/regulation-of-national-curriculum-and-eyfs-assessments/</link>
		<comments>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/regulation-of-national-curriculum-and-early-years-foundation-stage-assessments/regulation-of-national-curriculum-and-eyfs-assessments/#comments</comments>
		<pubDate>Thu, 10 Dec 2009 12:06:58 +0000</pubDate>
		<dc:creator>admin</dc:creator>
				<category><![CDATA[Regulation of statutory national curriculum and EYFS assessments]]></category>

		<guid isPermaLink="false">http://comment.ofqual.gov.uk/ascl/?p=287</guid>
		<description><![CDATA[
What the legislation says
Ofqual’s objective is to promote the development and implementation of regulated assessments which give a reliable indication of achievement and indicate a consistent level of attainment (including over time) between comparable assessments. We must also promote public confidence in regulated assessment arrangements.
Ofqual must keep under review all aspects of statutory national curriculum [...]]]></description>
			<content:encoded><![CDATA[<div class="aside">
<h2>What the legislation says</h2>
<p>Ofqual’s objective is to promote the development and implementation of regulated assessments which give a reliable indication of achievement and indicate a consistent level of attainment (including over time) between comparable assessments. We must also promote public confidence in regulated assessment arrangements.</p>
<p>Ofqual must keep under review all aspects of statutory national curriculum and EYFS assessment arrangements.</p>
<p>Ofqual has the power to require, at any time, information which it considers necessary for the performance of its functions from specified persons, including the Secretary of State for Children, Schools and Families and national curriculum / EYFS responsible bodies<sup>1</sup></p>
<p>Ofqual has a duty to notify the Secretary of State and national curriculum and EYFS responsible bodies, where appropriate, if it appears that there is or is likely to be significant failings in the assessment arrangements.</p>
<p>Ofqual must produce assessment regulatory frameworks relating to national curriculum and EYFS assessment arrangements and responsible bodies must have regard to these frameworks when performing their functions.</p>
</div>
<h2>Roles and responsibilities in relation to national curriculum Assessments</h2>
<p><span>22.1</span>There are a number of bodies who have a role in national curriculum and EYFS assessments. These are set out below.</p>
<p><span>22.2</span><strong>Local authorities </strong>have a statutory duty to monitor the administration of national curriculum assessments in their schools in line with the statutory requirements, and moderate teacher assessments at key stage 1.</p>
<p><span>22.3</span><strong>Head teachers and governing bodies</strong> are responsible for ensuring that the statutory national curriculum assessments are administered to all eligible pupils. Head teachers are responsible for ensuring that the tests are administered according to the published statutory assessment arrangements.</p>
<p><span>22.4</span><strong>QCDA</strong> will be responsible, under a remit given to it by the Department for Children, Schools and Families, for producing national curriculum assessments and for setting in place procedures to ensure that the standards defined by QCDA are maintained in each core subject assessment, across key stages and from year to year. QCDA is also required to ensure that schools receive timely information and materials to administer the national curriculum assessments.</p>
<p><span>22.5</span><strong>Department for Children, Schools and Families</strong> sets arrangements for assessment and testing. It also receives data from QCDA on how the national cohort of pupils has performed in the national curriculum assessments at the end of each key stage, and uses this for the publication of Achievement and Attainment tables.</p>
<p><span>22.6</span><strong>Ofsted</strong> uses the aggregated attainment and progress data which is generated by end of key stage tests and teacher assessment as a key evidence base for its inspection judgements.</p>
<h2>Roles and responsibilities in relation to the EYFS</h2>
<p><span>22.7</span><strong>Local authorities</strong> are responsible for ensuring their schools and private, voluntary and independent settings (PVI settings) administer the statutory framework and reporting arrangements appropriately. They must ensure their schools and PVI settings understand and follow the requirements. Local authorities have a statutory responsibility for moderating EYFS profile judgements to secure consistent standards in the assessment.</p>
<p><span>22.8</span><strong>Head teachers</strong> and heads of EYFS settings must make sure that their schools comply with all aspects of the EYFS. All foundation schools and PVI settings must provide parents/guardians with a written summary of a child’s progress against the early learning goals and assessment scales.</p>
<p><span>22.9</span><strong>Practitioners</strong> have the responsibility of ensuring the consistency and accuracy of their EYFS profile assessments through:</p>
<ul>
<li>participating in internal moderation with practitioners in their own school/setting</li>
<li>attendance at implementation and moderation training where appropriate</li>
<li>attendance at moderation events at least annually.</li>
</ul>
<p><span>22.10</span><strong>QCDA </strong>is responsible for monitoring the local authorities’ moderation process and providing local authorities with guidance and examples of good practice.</p>
<p><span>22.11</span><strong>Ofsted</strong> inspects the quality of the delivery of the EYFS and how well providers are meeting the welfare, learning and development requirements. Ofsted also checks that arrangements are in hand for completion of the EYFS profile for children in the final year of EYFS.</p>
<p><span>22.12</span><strong>The Children’s Workforce Development Council (CWDC)</strong> is responsible for defining qualifications and training requirements acceptable for registration as an early years practitioner and for regulatory purposes.</p>
<p><span>22.13</span><strong>The Department for Children, Schools and Families</strong> is responsible for determining the nature and extent of the assessment arrangements and collects EYFS profile achievement. These data are used to gain an overview of improvements in young children’s achievements to meet national targets and how children are performing against the early learning goals.</p>
<h2>Promoting the development and implementation of regulated assessment arrangements which maintain standards</h2>
<p><span>22.14</span>The Secretary of State for Children, Schools and Families is responsible for specifying in statutory regulations the arrangements for pupil assessments in relation to each of the key stages of the national curriculum, and the arrangements required for assessing the achievements of children in relation to the learning and development requirements of the EYFS.</p>
<p><span>22.15</span>We are required to keep under review all aspects of the national curriculum and EYFS assessment arrangements that have been specified by the Secretary of State in statutory orders.<sup>2</sup></p>
<p><span>22.16</span>We have a statutory objective to <em>promote</em> the development and implementation of assessment arrangements which give a reliable indication of achievement, and indicate a consistent level of attainment (including over time) between comparable assessments. We will achieve this by adopting a regulatory approach in line with the principles of good regulation.</p>
<p><span>22.17</span>We will work closely with stakeholders who share our agenda to ensure the development and implementation of high quality assessments. We will share and promote the good practice that we identify.</p>
<h2>The changing assessment landscape</h2>
<p><span>22.18</span>The regulation of assessment arrangements has previously focused on the end of key stage statutory national curriculum tests. However, with the ending of all national tests at key stage 3 and science tests at key stage 2, coupled with the move towards facilitating reliable formative and summative teacher assessments, the assessment landscape has changed markedly in recent years.</p>
<p><span>22.19</span>Although the Secretary of State is responsible for specifying the assessment arrangements, reflecting his/her policy objectives, he/she must now consult Ofqual before making any changes to them. When responding to such consultation requests, we will evaluate the proposed changes in terms of whether they are likely to allow for assessments which are valid, reliable, comparable, manageable and minimise bias. Our responses will be evidence-based, informed by our monitoring and stakeholder engagement activities.</p>
<h2>Expert Group on Assessment</h2>
<p><span>22.20</span>We have a duty to have regard to the specified purposes of regulated assessment arrangements when we review the arrangements. Formally, there is only one purpose for national curriculum assessment, which is to ascertain what pupils have achieved in relation to attainment targets for the relevant key stage. Under the Act, the Secretary of State may specify additional purposes. However, we note that the Secretary of State’s Expert Group on Assessment report <a href="http://publications.dcsf.gov.uk/eOrderingDownload/Expert-Group-Report.pdf" target="_blank">http://publications.dcsf.gov.uk/eOrderingDownload/Expert-Group-Report.pdf</a>, published in May 2009, identified the purposes of national curriculum assessments as being:</p>
<ul>
<li>to optimise the effectiveness of pupils’ learning and teachers’ teaching</li>
<li>to hold individual schools accountable for their performance</li>
<li>to provide parents with information about the child’s progress</li>
<li>to provide reliable information about national standards over time.</li>
</ul>
<p><span>20.21</span>The focus of the Expert Group’s recommendations is on bringing about reliable and consistent assessments which support learning and can command public confidence. To achieve this objective, a wide range of summative and formative assessment is proposed. We will need to consider carefully, given resources available to us, which aspects of statutory assessment we should focus on.</p>
<h2>Assessment regulatory frameworks</h2>
<p><span>22.22</span>The Act requires us to develop and publish regulatory frameworks for national curriculum and EYFS assessments which:</p>
<ul>
<li>describe how Ofqual intends to keep under review all aspects of national curriculum and EYFS assessment arrangements and</li>
<li>provide guidance to those bodies that have responsibility for the development, implementation and monitoring of national curriculum and EYFS on how to perform their functions; those bodies are required to have regard to the frameworks.</li>
</ul>
<p><span>22.23</span>To meet our assessments standards objective, our approach needs to secure that:</p>
<ul>
<li>assessment approaches used are valid, reliable and manageable</li>
<li>assessments are designed and delivered in a way that is capable of delivering the statutory purposes of assessments</li>
<li>the content of assessments (knowledge, skills and understanding) accurately reflect the subject criteria which are set for each statutory assessment by Ofqual and agreed with QCDA</li>
<li>surveys indicate that teachers, parents, pupils, local authorities and other stakeholders have confidence in the outcomes of national curriculum and EYFS assessments</li>
<li>there is comparability in the assessment outcomes between institutions and year-on-year</li>
<li>no pupil working at the level of the assessment is disadvantaged or excluded because of their social background, culture, race, gender, ability or disability.</li>
</ul>
<h2>Criteria for national curriculum and EYFS assessments</h2>
<p><span>22.24</span>To ensure our approach is consistent and transparent, we will apply the following criteria when reviewing the development, delivery, marking and reporting of externally assessed tests, internally assessed tasks, and the moderation of teacher assessment and EYFS profile judgements where these are statutory all aspects of national curriculum and EYFS assessment arrangements:</p>
<ul>
<li> <strong>Validity – </strong> the assessments must generate results that provide a valid measure of pupils’ knowledge, skills and understanding as defined by the national curriculum and subject criteria. </li>
<li><strong>Reliability –</strong> the assessments must generate results that provide a reliable measure of pupils’ performance.</li>
<li><strong>Comparability –</strong> the assessments must generate results that provide comparability of standards.</li>
<li><strong>Manageability – </strong>the assessment system must be manageable.</li>
<li><strong>Minimise bias –</strong> the assessments must generate outcomes that minimise bias differentiating on the basis of pupils’ ability to meet the requirements.</li>
</ul>
<p>A fuller explanation of the criteria is included in Annexe B of this document.</p>
<h2>Subject criteria</h2>
<p><span>22.25</span>Ofqual will review the subject criteria for each statutory assessment, including:</p>
<p>We will expect assessments to meet both the common and subject criteria.</p>
<ul>
<li>the structure of the assessment</li>
<li>how achievement will be recognised within the assessment</li>
<li>curriculum coverage and balance across the programme of study</li>
<li>question or task types and contexts</li>
<li>permitted equipment and information.</li>
</ul>
<p>We will expect assessments to meet both the common and subject criteria.</p>
<h2>Keeping national curriculum and EYFS assessment arrangements under review</h2>
<p><span>22.26</span>We will adopt an approach to keeping assessment arrangements under review whereby we consider:</p>
<ul>
<li>the development and implementation of assessment arrangements against our criteria of validity, reliability, comparability, manageability and minimising bias</li>
<li>the objectives of the assessment arrangement</li>
<li>the role that parents, practitioners, teaching assistants and other bodies play in the conduct and quality assurance of the assessment arrangements</li>
<li>how the outcomes of the assessments are used</li>
<li>how the sharing of good practice which encourages high quality assessment can be promoted</li>
<li>how regulation can add value and avoid regulatory burden.</li>
</ul>
<h2>Monitoring</h2>
<p><span>22.27</span>We will undertake specific monitoring activities based on those areas where our risk assessment indicates there is most concern. The risk assessment would be used to determine the nature, scope and frequency of our review activities and will be informed by consideration of the following factors:</p>
<ul>
<li>changes to how the assessment arrangements are conducted</li>
<li>changes to the processes and systems in relation to the assessment arrangement</li>
<li>the issue of new national guidance and support material, which is designed to ensure assessments are reliable and consistent</li>
<li>analysis of assessment outcomes data and how data is used</li>
<li>outcomes of self assessment exercises undertaken by responsible bodies and our previous monitoring</li>
<li>complaints we have received concerning the assessment arrangements and feedback from Ofsted and other relevant bodies</li>
<li>the need to ensure our monitoring activities are appropriately targeted and add value</li>
<li>feedback from parents and practitioners. </li>
</ul>
<h2>Monitoring activities</h2>
<p><span>22.28</span>Informed by our risk assessment we would undertake one or more of the following monitoring activities:</p>
<p><strong> Systems audit</strong></p>
<ul>
<li>reviewing the fitness for purpose of the systems and processes that are intended to ensure the implementation of assessment arrangements which are valid, reliable, comparable, manageable and minimise bias.</li>
</ul>
<p><strong> Guidance and training materials</strong></p>
<ul>
<li>evaluating the quality of national guidance and training materials intended to help practitioners and teachers make reliable and consistent assessments</li>
<li>reviewing materials against our common criteria</li>
<li>providing feedback to responsible bodies.</li>
</ul>
<p><strong>Moderation</strong></p>
<ul>
<li>evaluating the effectiveness of arrangements for monitoring local authority assessment moderation arrangements</li>
<li>observing the local authority moderation process in a sample of areas in order to validate the effectiveness of the moderation model</li>
<li>evaluating the effectiveness of the delivery of moderation training to practitioners, for example, review of the training in a variety of EYFS settings including private, voluntary, independent and school-based settings</li>
<li>consulting on improvements to existing processes.</li>
</ul>
<p><strong>Assessment outcomes data</strong></p>
<p>Analysing nationally collected data to:</p>
<ul>
<li>establish whether assessment outcomes are being used in a way which meets the intended purposes of the assessment arrangements</li>
<li>understand how the use of assessment outcomes data by local authorities, heads of settings, practitioners, DCSF and Ofsted impacts on assessment practice, and the validity and reliability of the assessment arrangements.</li>
</ul>
<br />
<p><span>22.29</span>We will publish our annual programme of monitoring. Over time this programme will cover all the stages of the assessment process including the development and delivery of the assessment, suppliers’ delivery systems, teacher and practitioner assessment and moderation</p>
<p><span>22.30</span>We may re-focus our published programme of monitoring if risks have been identified that threaten the quality or delivery of assessments, or if issues have arisen during a review or health check of a responsible body, its suppliers or their systems.</p>
<h2>Guidance for national curriculum and EYFS responsible bodies</h2>
<p><span>22.31</span>We will produce guidance which reflects the purpose of the assessment arrangements and how they are implemented. We will have due regard to the guidance which is produced by other bodies. We will work in partnership with responsible bodies and public authorities to ensure the guidance we produce is consistent and that we do not create an unnecessary burden by, for example, duplicating existing guidance.</p>
<br />
<p><span>22.32</span>The guidance we produce will be designed to allow flexibility in approach to ensure it does not become out of date too quickly, for example by failing to facilitate the transition between bodies that have responsibility for developing or delivering national curriculum tests. The guidance will define the roles and responsibilities of all those involved in the assessment arrangements and the outcomes expected, rather than prescribing a particular process.</p>
<br />
<h2>Information requirements</h2>
<p><span>22.33</span>To enable us to carry out our role effectively we have the power to require the Secretary of State, national curriculum and EYFS responsible bodies and Ofsted to provide specific information.</p>
<p><span>22.34</span>When we request information we require we will:</p>
<ul>
<li>provide a clear rationale for the information being requested</li>
<li>provide reasonable notice/timetable to the body from which the information is being requested</li>
<li>avoid creating unnecessary burden by duplicating information that is already requested or collected by other bodies</li>
<li>work with responsible bodies to establish effective ways of sharing information</li>
<li>have due regard to the quality of data and the organisation’s data collection process</li>
<li>have due regard to the views of teachers, practitioners and other stakeholders when evaluating nationally collected information.</li>
</ul>
<h2>Notification of significant failings</h2>
<p><span>22.35</span>One of the recommendations in Lord Sutherland’s inquiry report<sup>3</sup> into the problems with the delivery of national curriculum tests in 2008 was that Ofqual should have a duty to inform the DCSF if it had concerns about the delivery and quality of national curriculum tests. Reflecting this recommendation, the Act requires us to notify the Secretary of State, and the responsible bodies, of a significant failing in the assessment arrangements when we judge there is sufficient evidence to indicate there is, or is likely to be, a failure to achieve one or more of the specified purposes of the assessment arrangements. We will, of course, provide feedback and information to the Secretary of State even when there is not a significant failing, as appropriate.</p>
<p><span>22.36</span>We propose to consider the following when we assess the likelihood of a significant failing occurring:</p>
<ul>
<li>the potential impact on pupils and public confidence in the assessment arrangements</li>
<li>evidence that responsible bodies are unable to demonstrate that the requirements of the regulatory framework are being satisfactorily met</li>
<li>any failure of a responsible body to provide information requested by Ofqual in line with the provisions of the Act</li>
<li>evidence from stakeholder engagement activities indicates the purposes of the assessment arrangements are not being met</li>
<li>any significant changes to the assessment model and associated quality assurance/moderation arrangements</li>
<li>substantiated complaints received</li>
<li>concerns based on relevant and objective information provided by Ofsted. </li>
</ul>
<p><span>22.37</span>Examples of circumstances in which we might notify the Secretary of State and the responsible body of a significant failing in relation to national curriculum assessments include:</p>
<ul>
<li>if it became evident to us that there was a risk that significant numbers of test results would be delayed, and that the results would not therefore provide pupils, schools or the government with timely information about the attainment and progress of pupils, where the provision of this information is one of the specified purposes of the assessment; or</li>
<li>if a new type of national curriculum assessment was being developed which we judged would not provide a reliable assessment of a pupil’s level of attainment.</li>
</ul>
<p><span>22.38</span>Examples of circumstances in which we might notify the Secretary of State and the responsible body of a significant failing in EYFS assessments include:</p>
<ul>
<li>moderation arrangements do not ensure EYFS assessments give a reliable indication of achievement</li>
<li>there are shortcomings in the guidance and materials provided to settings which could result in significant variances in the way assessment arrangements are implemented between local authorities, and in turn call into question the consistency of assessments</li>
<li>stakeholder feedback indicates a lack of confidence in the validity and reliability of assessment outcomes.</li>
</ul>
<h2>Involving stakeholders</h2>
<p><span>22.39</span>The successful delivery of national curriculum and EYFS assessments depends on the involvement of a range of organisations and individuals.  Good regulation depends on putting those who are involved in developing, implementing and receiving the outcomes of the assessment process at the centre of the regulatory process. This approach involves working closely with stakeholders to help identify the focus of our monitoring activities, as well as facilitating the promotion of assessments that meet our criteria. The diagram below illustrates this proposed approach.</p>
<p><span>22.40</span>We propose to have regular contact with stakeholders (such as QCDA, DCSF, local authorities, Children’s Workforce Development Council, Ofsted, teacher associations, Chartered Institute of Educational Assessors) to:</p>
<ul>
<li>gather evidence and feedback on the development and implementation of national curriculum and EYFS assessment arrangements. We would evaluate this evidence against the common criteria of validity, reliability, comparability, manageability and minimising bias, and use it to inform the focus of our monitoring activities</li>
<li>encourage responsible bodies to develop effective self-assessment mechanisms</li>
<li>review how the assessment arrangements work in practice against our common criteria and achieve their intended purposes and outcomes</li>
<li>identify where improvements to existing assessment arrangements could be made</li>
<li>provide feedback on the outcome of our regulatory activities and share good practice</li>
<li>identify areas to focus our monitoring for future years.</li>
</ul>
<h2>Parental engagement</h2>
<p><span>22.41</span>One of the key purposes of assessment identified by the Secretary of State’s Expert Group on Assessment is to provide parents with information about their child’s progress.  The views and experiences of parents/guardians/carers will therefore be important to us when we make judgements about the validity and reliability of national curriculum and EYFS assessment arrangements. We will:</p>
<ul>
<li>engage with parents through a suitable range of mechanisms (focus groups, questionnaires etc) to generate evidence concerning their experience of the implementation of national curriculum and EYFS assessment arrangements</li>
<li>seek opinions of practitioners and teachers</li>
<li>evaluate the extent of parental understanding and engagement with the outcomes of the assessments</li>
<li>evaluate the level of public confidence in the assessment arrangements and their outcomes.</li>
</ul>
<p><span>22.42</span>We will also establish a network of specialists which will be used to:</p>
<ul>
<li>inform and validate the focus of our monitoring activities and approach</li>
<li>provide a link to practitioner and teacher networks</li>
<li>review and validate the outcomes of our regulatory activities prior to dissemination.</li>
</ul>
<h2>Developing our proposals</h2>
<p><span>22.43</span>The assessment regulatory framework will be finalised in light of responses to both this consultation and further more specific consultations we will undertake.  We will also need to consult on our role in relation to complaints and appeals about assessments.</p>
<!--h2&gt;-->Questions:</h2>
<p>Loading...</p>
<ol class="footnotes"><li id="footnote_0_287" class="footnote">‘NC responsible body’ means a person who under or by virtue of an order made under section 87(3)(c) of the Education Act 2002 has functions in relation to the development, implementation or monitoring of NC assessment arrangements. ‘EYFS responsible body’ means a person who under or by virtue of an order made under section 39(1)(a) of the Childcare Act 2006 has functions in relation to the development, implementation or monitoring of EYFS assessment arrangements.</li><li id="footnote_1_287" class="footnote">The assessment arrangements that fall within Ofqual’s scope are those which are specified by or by virtue of section 87 of the Education Act 2002 and sections 39 to 42 of the Childcare Act 2006.</li><li id="footnote_2_287" class="footnote">Lord Sutherland (2008), The Sutherland Inquiry: An independent report into the delivery of national curriculum tests in 2008, London: The Stationary Office</li></ol>
]]></content:encoded>
			<wfw:commentRss>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/regulation-of-national-curriculum-and-early-years-foundation-stage-assessments/regulation-of-national-curriculum-and-eyfs-assessments/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>What we are consulting on</title>
		<link>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/uncategorized/what-we-are-consulting-on/</link>
		<comments>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/uncategorized/what-we-are-consulting-on/#comments</comments>
		<pubDate>Tue, 08 Dec 2009 17:25:22 +0000</pubDate>
		<dc:creator>admin</dc:creator>
				<category><![CDATA[Uncategorized]]></category>

		<guid isPermaLink="false">http://comment.ofqual.gov.uk/ascl/?p=156</guid>
		<description><![CDATA[We would like your feedback on how we should meet our objectives, fulfil our duties and use our powers. The themes of our consultation are set out in this document. Areas covered include our approach to recognising awarding organisations; how we will monitor awarding organisations and the regulated qualifications they offer; the steps we will [...]]]></description>
			<content:encoded><![CDATA[<p>We would like your feedback on how we should meet our objectives, fulfil our duties and use our powers. The themes of our consultation are set out in this document. Areas covered include our approach to recognising awarding organisations; how we will monitor awarding organisations and the regulated qualifications they offer; the steps we will take when we identify problems and how we will keep all aspects of statutory national curriculum and early years foundation stage (EYFS) assessment arrangements under review. <a href="http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/foreword/foreword/">Read more.</a></p>
<h2>How to respond</h2>
<p>This consultation closed to respondents at 23:59 on the 8th March 2010.</p>
<p><a href="http://www.ofqual.gov.uk/files/2009-12-11-consultation-regulating-for-confidence-in-standards.pdf"><img src="http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/files/2009/12/pdf-icon.gif" border="0" alt="PDF" width="30" height="30" /></a> A <a href="http://www.ofqual.gov.uk/files/2009-12-11-consultation-regulating-for-confidence-in-standards.pdf">PDF version of this consultation</a> is also available to download.</p>

]]></content:encoded>
			<wfw:commentRss>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/uncategorized/what-we-are-consulting-on/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Summary of questions</title>
		<link>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/annex-a/summary-of-questions/</link>
		<comments>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/annex-a/summary-of-questions/#comments</comments>
		<pubDate>Tue, 08 Dec 2009 13:47:03 +0000</pubDate>
		<dc:creator>admin</dc:creator>
				<category><![CDATA[Annexe A]]></category>

		<guid isPermaLink="false">http://comment.ofqual.gov.uk/ascl/?p=141</guid>
		<description><![CDATA[
This consultation has now closed to responses.

]]></description>
			<content:encoded><![CDATA[<p><!--div style="margin-top: -10px;"&gt;Loading...&lt;/div-->
<p>This consultation has now closed to responses.</p>

]]></content:encoded>
			<wfw:commentRss>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/annex-a/summary-of-questions/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>How to respond</title>
		<link>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/responding-to-the-consultation-summary-of-questions/how-to-respond/</link>
		<comments>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/responding-to-the-consultation-summary-of-questions/how-to-respond/#comments</comments>
		<pubDate>Tue, 08 Dec 2009 13:46:39 +0000</pubDate>
		<dc:creator>admin</dc:creator>
				<category><![CDATA[Responding to the consultation & summary of questions]]></category>

		<guid isPermaLink="false">http://comment.ofqual.gov.uk/ascl/?p=139</guid>
		<description><![CDATA[How to respond
23.1We would prefer you to respond using the online forms provided within each section or the full listing of all questions.
We will also accept responses by email sent to: consultationresponses@ofqual.gov.uk or by post to Regulatory Policy Team, Spring Place, Coventry Business Park, Herald Avenue, Coventry, CV5 6UB.
The last date for responses is 8 [...]]]></description>
			<content:encoded><![CDATA[<h2>How to respond</h2>
<p><span>23.1</span>We would prefer you to respond using the online forms provided within each section or the <a href="http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/annex-a/summary-of-questions/">full listing of all questions</a>.</p>
<p>We will also accept responses by email sent to: <a href="mailto:consultationresponses@ofqual.gov.uk">consultationresponses@ofqual.gov.uk</a> or by post to Regulatory Policy Team, Spring Place, Coventry Business Park, Herald Avenue, Coventry, CV5 6UB.</p>
<p>The last date for responses is 8 March 2010.</p>
<p><span>23.2</span>We do not expect everyone who responds to answer every question. You are welcome to respond only to those questions that are most relevant to your interests.</p>
<h2>What happens next</h2>
<p><span>23.3</span>The responses will be analysed by an independent body. The report on the responses will be published.</p>
<p><span>23.4</span>Our Board, which is due to be appointed as from 1 April 2010, will consider the responses and decide how to proceed with the introduction of our new ways of working.</p>
<h2>Confidentiality</h2>
<p><span>23.5</span>If you do not wish your response to be published you must indicate clearly that you are submitting your response on a confidential basis. All responses will, however, be made available to the external organisation appointed to analyse the responses.</p>

]]></content:encoded>
			<wfw:commentRss>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/responding-to-the-consultation-summary-of-questions/how-to-respond/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Promoting awareness of the benefits of regulated qualifications</title>
		<link>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/regulating-qualifications/promoting-awareness-of-the-benefits-of-regulated-qualifications/</link>
		<comments>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/regulating-qualifications/promoting-awareness-of-the-benefits-of-regulated-qualifications/#comments</comments>
		<pubDate>Tue, 08 Dec 2009 13:45:29 +0000</pubDate>
		<dc:creator>admin</dc:creator>
				<category><![CDATA[Regulating Qualifications]]></category>

		<guid isPermaLink="false">http://comment.ofqual.gov.uk/ascl/?p=137</guid>
		<description><![CDATA[
What the legislation says
It is Ofqual’s objective to promote awareness and understanding of: 

the range of regulated qualifications available
the benefits of regulated qualifications
the benefits of recognition to awarding organisations.

It is Ofqual’s objective to promote public confidence in regulated qualifications and regulated assessment arrangements. 
Ofqual will be required to publish: 

a register of recognised awarding organisations [...]]]></description>
			<content:encoded><![CDATA[<div class="aside">
<h2>What the legislation says</h2>
<p>It is Ofqual’s objective to promote awareness and understanding of:<strong> </strong></p>
<ul>
<li>the range of regulated qualifications available</li>
<li>the benefits of regulated qualifications</li>
<li>the benefits of recognition to awarding organisations.</li>
</ul>
<p>It is Ofqual’s objective to promote public confidence in regulated qualifications and regulated assessment arrangements.<strong> </strong></p>
<p>Ofqual will be required to publish:<strong> </strong></p>
<ul>
<li>a register of recognised awarding organisations and the qualifications they offer<strong> </strong></li>
<li>a qualifications regulatory framework setting out how it will perform its monitoring and enforcement duties<strong> </strong></li>
<li>an annual report setting out how it has performed its functions that year.</li>
</ul>
</div>
<p><span>21.1</span>  Effective and transparent regulation of qualifications and assessments will underpin our efforts to promote understanding of the benefits of, and confidence in, regulated qualifications and assessments. Learners and those who make use of regulated qualifications should be confident that an awarding organisation has been judged to be fit to offer trustworthy qualifications.</p>
<p><span>21.2</span>We will build on the work we have already undertaken to explain the structure and regulation of certain qualifications, to open up discussions about standards and reliability and to learn more about learners’ concerns and interests.<sup>1</sup> We will target information through a communication strategy. Our use of media such a Youtube and Twitter will be developed further.</p>
<p>We will continue to undertake research and surveys into levels of understanding and public confidence in regulated qualifications and assessments and respond accordingly.</p>
<p><span>21.3</span>We  propose that we should use surveys of, among others, learners, parents, carers, teachers, employers and higher education institutions to help us measure our success in achieving our objectives. We will refine the approaches we have taken in response to the findings from such studies. We will continue to learn from panels of representative groups who have views on regulated qualifications and assessments. We will develop a plan for spreading awareness amongst employers of the benefits of regulation, including the opportunities provided by recognition as an awarding organisation within the QCF.</p>
<h2>The register of awarding organisations</h2>
<p><span>21.4</span>We will publish a register of recognised awarding organisations. For each organisation this will include:</p>
<ul>
<li>the qualifications in respect of which it is recognised</li>
<li>the forms of those qualifications which are being awarded</li>
<li>where appropriate, the number of guided learning hours attached to those qualifications.</li>
</ul>
<p><span>21.5</span>We may include other information on the register and we seek views on this.</p>
<p><span>21.6</span>We intend that the register should be maintained online, be readily accessible to learners and the public, and be capable of interrogation by users so that they can find the information that they require. The register should provide links to awarding organisations so that individuals are able to find out more information about a qualification in which they are interested. It could include search facilities and tools to allow comparisons.</p>
<!--h2&gt;-->Questions:</h2>
<p>Loading...</p>
<ol class="footnotes"><li id="footnote_0_137" class="footnote">See for example, our guides to qualifications, our animation on our reliability project and videos of meetings with learner panels.</li></ol>
]]></content:encoded>
			<wfw:commentRss>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/regulating-qualifications/promoting-awareness-of-the-benefits-of-regulated-qualifications/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Economic regulation</title>
		<link>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/regulating-qualifications/economic-regulation/</link>
		<comments>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/regulating-qualifications/economic-regulation/#comments</comments>
		<pubDate>Tue, 08 Dec 2009 13:45:15 +0000</pubDate>
		<dc:creator>admin</dc:creator>
				<category><![CDATA[Regulating Qualifications]]></category>

		<guid isPermaLink="false">http://comment.ofqual.gov.uk/ascl/?p=135</guid>
		<description><![CDATA[
What the legislation says
One of Ofqual’s objectives is to secure the efficient provision of regulated qualifications and in particular that payments to awarding organisations for awarding or authenticating qualifications represent value for money.
The legislation allows Ofqual to impose a fee capping condition on an awarding organisation. It can only do so if it is satisfied [...]]]></description>
			<content:encoded><![CDATA[<div class="aside">
<h2>What the legislation says</h2>
<p>One of Ofqual’s objectives is to secure the efficient provision of regulated qualifications and in particular that payments to awarding organisations for awarding or authenticating qualifications represent value for money.</p>
<p>The legislation allows Ofqual to impose a fee capping condition on an awarding organisation. It can only do so if it is satisfied this is necessary to secure value for money. A fee-cap can limit the amount of a fee chargeable by an awarding organisation in respect of:</p>
<ul>
<li>the award of a qualification it is recognised to offer and</li>
<li>the provision of any service in connection with such a qualification.</li>
</ul>
<p>Before imposing such a condition Ofqual must give an awarding organisation notice setting out:</p>
<ul>
<li>its reasons for proposing to impose such a condition</li>
<li>how and when the organisation can make representations.</li>
</ul>
<p>Ofqual must have regard to the representations made by the awarding organisation.</p>
<p>An awarding organisation can request a review of a decision to impose a fee-cap. Ofqual must arrange for such a review to be undertaken by an independent person who has appropriate skills to do so.</p>
<p>In performing its functions in relation to fee capping Ofqual must have regard to any guidance published by the Secretary of State.</p>
</div>
<h2>Introduction</h2>
<p><span>20.1</span>We propose that the steps we take to fulfil the efficiency objective should be informed by an understanding of:</p>
<ul>
<li>how choices are made between regulated qualifications</li>
<li>how efficient purchasing and funding decisions can be encouraged</li>
<li>the impact on awarding organisations’ costs of our own activities and the decisions of policy makers; and</li>
<li>the competitiveness of the qualifications markets.</li>
</ul>
<p><span>20.2</span>A fee-capping condition will be used only where we are satisfied this is necessary to ensure value for money. Such a decision would be evidence based.</p>
<h2>Promoting efficient purchasing decisions</h2>
<p><span>20.3</span>We propose that centres and employers should have ready access to information on the costs they would incur and the services they would receive in respect of a qualification awarded by a particular awarding organisation. We have commissioned a study on the costs and benefits of requiring awarding organisations to provide information on prices and services in a specified format and to a specified timetable. If the benefits of awarding organisations providing transparent information on fees and other charges outweigh the costs we propose that we should make this a general condition of the recognition of an awarding organisation. We will publish the report of this study.</p>
<h2>The impact of regulatory requirements and policy decisions</h2>
<p><span>20.4</span>The requirements we place on an awarding organisation could have an impact on its costs. Where our requirements could significantly change an awarding organisation’s costs we propose that a regulatory impact assessment should be undertaken.</p>
<p><span>20.5</span>Similarly, we propose that we should explore and comment on the impact of Government policy decisions on the efficiency of the qualifications market.</p>
<h2>Monitoring the market for signs of a lack of competition</h2>
<p><span>20.6</span>Recent guidance<sup>1</sup> from the Office of Fair Trading sets out the principle that effective competition in properly regulated markets can deliver lower prices, better quality goods and services and greater choice for consumers. We start from the presumption that a competitive market is more likely to be efficient and one in which fees and other charges are fair and reasonable. We will therefore monitor the market for signs of a lack of competition.</p>
<p><span>20.7</span>We will use a range of information to inform this monitoring, including publicly available information, complaints and expressions of concerns. We will consider other information where we are satisfied that the costs of providing the information will not outweigh the benefits of collecting it.</p>
<p><span>20.8</span>We propose to monitor the market shares of individual awarding organisations, as this is an important factor in assessing dominance. Data that will inform this monitoring is already being collected by us. In order to work out market shares it is first necessary to define the market. This is not a simple matter. We have engaged consultants to investigate the definition of the qualifications market and hope to use their work in our future market reports and calculations of market shares.</p>
<p><span>20.9</span>The level of fees and charges might be an indicator of an uncompetitive market, for example if fees or charges increased markedly or if they changed up or down in response to entry into or exit from the market. We will therefore monitor fees and charges and how they change.</p>
<p><span>20.10</span>High profits sustained over a lengthy period might also signal a lack of competition. Many awarding organisations do not seek to maximise their profits. It does not necessarily follow that they will be offering value for money, as they might not be operating efficiently and their costs might therefore be high. We propose to review awarding organisations’ published accounts or the published accounts of the entities of which an awarding organisation is part. These accounts might not always reveal the costs or profitability of providing qualifications. Where this is the case for a large or potentially dominant organisation we may require the provision of disaggregated accounting data.</p>
<p><span>20.11</span>We have commissioned a study into the costs and benefits of the provision of disaggregated accounting data. This study will be published and will inform our decision about the information we require awarding organisations to provide.</p>
<p><span>20.12</span>The behaviour of those who are deciding which qualifications to purchase might also affect the degree of competition. Compared with many other markets, purchasers of qualifications may be less price sensitive and more concerned about perceived and actual quality. This may be partly because the choice of qualification may be taken by a person who is not directly linked to the purchasing organisation’s system of financial control. The competitiveness of a market might also be affected by the costs of switching awarding organisations, for example because of the need to buy new teaching and learning resources.</p>
<h2>Further analysis of the market</h2>
<p><span>20.13</span>If we have concerns about the operation of the market we propose that we should undertake a detailed economic analysis, or market study. We would either undertake the study ourselves or appoint an external and appropriately qualified body to do so.</p>
<p><span>20.14</span>Before deciding to undertake a market study we would consider:</p>
<ul>
<li>the likely costs of doing so, to awarding organisations, ourselves and others</li>
<li>the possible benefits that we might obtain</li>
<li>the extent to which the outcome of the study might promote our ability to achieve the efficiency objective.</li>
</ul>
<p><span>20.15</span>We propose that any awarding organisation that would be affected by a decision to undertake a market study should be notified of our intention to do so. We propose that we would publish our reasons. Any representations made would be considered before a final decision was taken.</p>
<p><span>20.16</span>We would give notice to the awarding organisation of the information we would need and the timetable for its provision. This would be backed up by conditions if necessary.</p>
<p><span>20.17</span>The market study would involve an evidence-based investigation to determine whether there was sufficient competition in the market and whether the fees and other charges in question were fair and reasonable. Fees and charges would be judged to be fair and reasonable if they enabled the awarding organisation(s) to recover the efficiently incurred costs of providing the qualifications, including the cost of capital.</p>
<p><span>20.18</span>We propose that market study reports should be published.</p>
<h2>Promoting competition</h2>
<p><span>20.19</span>If we found evidence of a lack of competition within the market we would seek to implement the least intrusive regulatory mechanism to achieve our objectives.</p>
<p><span>20.20</span>We could attempt to promote competition; this could take a number of forms. We could make efforts to make purchasers more aware of the options open to them and highlight the benefits of encouraging those responsible for purchasing decisions to be more responsive to costs. Associated with this would be the improvements we could require to enhance the quality and accessibility of information available to centres and training providers.</p>
<p><span>20.21</span>Barriers to entry to the market could be assessed and, where possible, removed. This may involve consideration of issues such as the cost of regulation, the impact of cross subsidy or the existence of anti-competitive practices.</p>
<p><span>20.22</span>A dominant organisation could be restricted by further conditions which would limit its actions or place on it new obligations. For example, Ofqual could require it to provide more detailed accounting information or financially to ring-fence its awarding activities, or a sub-set of them, in areas in which it was dominant. We could also refer it to the Office of Fair Trading, if appropriate.</p>
<h2>Fee-capping</h2>
<p><span>20.23</span>A fee-cap condition can only be used if we are satisfied this is necessary to secure value for money. We propose that we should consider the use of a fee-cap condition if we have evidence that an awarding organisation’s fees are not ‘fair and reasonable’ for the service provided. The power to cap fees is the type of power other regulators have in markets where there is a potential for market failure.</p>
<p><span>20.24</span>We will take into account:</p>
<ul>
<li>the competitiveness of the market</li>
<li>the trend in fee levels over time</li>
<li>an assessment of the efficient costs of providing the qualification on offer, including the cost of capital</li>
<li>how the awarding organisation allocates its common costs to its range of qualifications</li>
<li>the models an awarding organisation might adopt for recovering costs across a range of subjects.</li>
</ul>
<p><span>20.25</span>We propose that if we were concerned that an awarding organisation was not delivering value for money we would conduct an investigation to inform a decision on the level, form and term of the fee-cap(s) to be applied. The investigation would consider, for example:</p>
<ul>
<li>whether fees should be capped for individual qualifications or components of qualifications</li>
<li>whether there should be a cap on the rate of increase (or decrease) in a weighted basket of fees for qualifications or components of qualifications</li>
<li>for what period fees should be capped</li>
<li>other approaches on the form of the fee-cap to the extent permitted under the legislation.</li>
</ul>
<p><span>20.26</span>We would also consider the time for which the cap would apply.</p>
<h2>The proposed process for fee-capping</h2>
<p><span>20.27</span>Where our market studies suggest that a fee-cap is the appropriate remedy to address a concern about value for money we must comply with the provisions of the Act which require us to:</p>
<ul>
<li>give notice to an awarding organisation of our proposals and explain our reasons</li>
<li>allow a period for representations from the awarding organisation</li>
<li>have regard to those representations</li>
<li>arrange for the review of the decision by an independent and suitably skilled person, should the awarding organisation request one; and</li>
<li>have regard to any guidance published by the Secretary of State.</li>
</ul>
<p><span>20.28</span>A detailed timetable would be given to the awarding organisation when notice was given. A decision to impose a fee-cap could not take effect until the expiry of the period in which a review could be requested and any review had been undertaken.</p>
<h2>Independent review of a decision to apply a fee-capping decision</h2>
<p><span>20.29</span>If an awarding organisation requests a review of a decision to impose a fee capping condition we must appoint an independent person, who has the appropriate skills, to undertake the review.</p>
<p><span>20.30</span>It is proposed that the independent reviewer should consider the evidence that informed the original decision and any representations made by the awarding organisation. The independent reviewer may also seek advice from experts, but the decision would be taken by the reviewer alone.</p>
<p><span>20.31</span>We propose that a request for a review would have to be submitted in writing no more than 30 working days after receipt of the decision to impose a fee-capping condition. The review of the decision would normally be completed within 60 working days of receipt from the awarding organisation of a request for a review of the decision.</p>
<p><span>20.32</span>We propose that the independent reviewer would consider whether:</p>
<ul>
<li>the process used to make the original decision to impose a fee-cap was fair and reasonable</li>
<li>the decision was unreasonable in light of the information available at the time the decision was taken.</li>
</ul>
<p><span>20.33</span>We propose that the independent reviewer should be able to:</p>
<ul>
<li>confirm that the process by which the original decisions was taken was fair and reasonable</li>
<li>direct that the matter be reconsidered by Ofqual and make any specific directions to Ofqual to consider particular evidence or remedy any defects in its process.</li>
</ul>
<h2>Next steps</h2>
<p><span>20.34</span>We are building on previous work undertaken by the QCA to develop our understanding of the qualifications market(s). This preparatory work will enable the Ofqual Board to give early consideration to the efficiency of the market(s) and whether there is a need to take regulatory action to secure value for money.</p>
<!--h2&gt;-->Questions:</h2>
<p>Loading...</p>
<ol class="footnotes"><li id="footnote_0_135" class="footnote"><em>Government in markets: Why competition matters – a guide for policy makers</em> September 2009.</li></ol>
]]></content:encoded>
			<wfw:commentRss>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/regulating-qualifications/economic-regulation/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Entry and inspection condition</title>
		<link>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/regulating-qualifications/entry-and-inspection-condition/</link>
		<comments>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/regulating-qualifications/entry-and-inspection-condition/#comments</comments>
		<pubDate>Tue, 08 Dec 2009 13:45:04 +0000</pubDate>
		<dc:creator>admin</dc:creator>
				<category><![CDATA[Regulating Qualifications]]></category>

		<guid isPermaLink="false">http://comment.ofqual.gov.uk/ascl/?p=133</guid>
		<description><![CDATA[
What the legislation says
The legislation will also allow Ofqual to impose an entry and inspection condition requiring permission to enter an awarding organisation’s premises to inspect and copy documents if Ofqual deems it necessary in order to:

satisfy itself that appropriate standards are being maintained in the award of a qualification or
determine whether or not to [...]]]></description>
			<content:encoded><![CDATA[<div class="aside">
<h2>What the legislation says</h2>
<p>The legislation will also allow Ofqual to impose an entry and inspection condition requiring permission to enter an awarding organisation’s premises to inspect and copy documents if Ofqual deems it necessary in order to:</p>
<ul>
<li>satisfy itself that appropriate standards are being maintained in the award of a qualification or</li>
<li>determine whether or not to impose a fee capping condition.</li>
</ul>
<p>However, permission need only be granted by the awarding organisation if:</p>
<ul>
<li>the premises are not used as a private dwelling</li>
<li>entry is by an authorised person</li>
<li>reasonable notice has been given to the awarding organisation and</li>
<li>entry is at a reasonable time.</li>
</ul>
</div>
<h2>Entry and inspection</h2>
<p><span>19.1</span>Cooperation from awarding organisations is normally expected; it is proposed that all awarding organisations should be subject to a general condition to cooperate with Ofqual. However, the Act allows us to set an entry and inspection condition to enable us to enter premises to inspect and copy documents when cooperation is not otherwise forthcoming. Such a condition may be used to allow us to seek assurances that standards are being maintained or to secure information that will help us determine whether a fee capping condition should be imposed, and, if so, what that condition should be.</p>
<p><span>19.2</span>The legislation places certain limits on the situations in which an awarding organisation would be required to permit entry under an entry and inspection condition. These include:</p>
<ul>
<li>the premises must be used by an awarding organisation and not be used as a private dwelling</li>
<li>entry must be by an authorised person</li>
<li>reasonable notice has been given to the awarding organisation</li>
<li>entry must be at a reasonable time.</li>
</ul>
<h2>Situations when an entry and inspection condition may be set</h2>
<p><span>19.3</span>We would normally expect to obtain the information we need with the agreement of the awarding organisation and without having to impose an entry and inspection condition. We would aim to give awarding organisations sufficient notice and details of the information that we require, and ensure our monitoring activities are planned with awarding organisations being notified in advance. Where we need to visit premises, for example to observe a meeting, view learners’ work or inspect documents, this would normally be arranged in agreement with the awarding organisation.</p>
<p><span>19.4</span>Where agreement cannot be reached, and entry and inspection is needed for specific purposes, it may be necessary for us to impose an entry and inspection condition. Potential situations may include those where:</p>
<ol start="1">
<li>we have grounds to believe that an awarding organisation has been involved in malpractice or maladministration in relation to the award or authentication of a regulated qualification and it is important for us to preserve the integrity of evidence</li>
<li>we need to inspect or copy documents which have previously been requested but the awarding organisation has been unable or has refused to supply<sup>1</sup></li>
<li>we have not otherwise been able to obtain information needed to inform a decision to impose a fee-capping condition</li>
<li>we are responding to incidents, for example security breaches with live question papers, which could affect the maintenance of standards and undermine public confidence. We may wish to visit at short notice to inspect an awarding organisation’s arrangements for the storage of live question papers</li>
<li>we need to gain access to computer records that are key to the maintenance of standards of a regulated qualification and that can only be accessed at the awarding organisation’s premises.</li>
</ol>
<h2>Arrangements for approving the setting of an entry and inspection condition</h2>
<p><span>19.5</span>We propose to put in place a process for approving the setting of an entry and inspection condition on an awarding organisation. A decision to set an entry and inspection condition will only be taken:</p>
<ul>
<li>where there are reasonable grounds to believe there is an on-going risk to the maintenance of standards in relation to the award or authentication of a qualification and in connection with the potential need to cap fees and</li>
<li>after reasonable attempts to gather the information voluntarily have been exhausted.</li>
</ul>
<p><span>19.6</span>We propose that a decision to impose an entry and inspection condition should be made by a member of our staff who is authorised by the Chair of Ofqual’s Board to impose such a condition. That person would consider the information being sought, a justification as to why the setting of an entry and inspection condition is necessary, details of any previous attempts to obtain the information by agreement and the amount of notice that is proposed to be given to the awarding organisation.</p>
<p><span>19.7</span>If it is agreed that an entry and inspection condition would be appropriate, a copy of the signed permission would be sent to the awarding organisation in advance of the entry and inspection condition being imposed. The method of delivery of the notice will be determined by the urgency of visit and the notice that is therefore being given. The notice will set out the reasons for entry and the information/documentation/process which we wish to inspect. If entry is required in order to access computer systems, notice of the need to provide suitably trained personnel to enable us to access records will be given.</p>
<p><span>19.8</span>We would expect to have access to any premises where an awarding organisation conducts its business but not to a private dwelling house.</p>
<h2>Access to centres</h2>
<p><span>19.9</span>The purpose of the entry and inspection condition is to enable us to inspect and copy documents held by the awarding organisation. Where the information/documents which we require are held by a centre or a third party contracted by the awarding organisation to support the delivery of qualifications, we would expect the awarding organisation to cooperate and obtain the necessary information/documents from these parties.</p>
<p><span>19.10</span>To enable us to carry out our normal monitoring and enforcement functions, an awarding organisation will need to ensure that each centre agrees to provide both it and us with access to premises, people and records, and to cooperate with the awarding organisation’s own monitoring activities and ours. We propose that this should be covered by a general recognition condition.</p>
<p><span>19.11</span>As we will not have the authority to access private dwellings it is proposed that it should be a condition of recognition that awarding organisations must operate out of business, that is, non residential premises.</p>
<h2>Authorised persons</h2>
<p><span>19.12</span>Entry to premises must be by an authorised person. An ‘authorised person’ is defined as being a member of Ofqual’s staff who is authorised (generally or specifically) for this purpose.</p>
<p><span>19.13</span>We will maintain a record of all staff who are authorised to enter awarding organisations’ premises. Authorisation will normally be restricted to staff who are routinely engaged in monitoring or complaint investigation activities. All staff visiting an awarding organisation will have information on the purpose of the visit. The awarding organisation should be able to contact us for confirmation that the member of staff is authorised by Ofqual to enter premises under an entry and inspection condition.</p>
<h2>Reasonable notice</h2>
<p><span>19.14</span>The amount of notice that we would give an awarding organisation may depend on the nature and potential impact of the issue. In giving an awarding organisation notice that we wish to enter its premises, we would have to balance the requirement to act reasonably with the need to preserve the integrity of the information/evidence being sought and the urgency of any remedial action. This will be particularly important in cases where we may have grounds to believe an awarding organisation has been involved in malpractice in relation to the award of a regulated qualification.</p>
<p><span>19.15</span>We would normally ensure the awarding organisation is given a minimum of five working days’ notice of the arrangements for the visit, but this may need to be reduced if there is an urgent need to access information in order to ensure the maintenance of standards or public confidence in the qualification arrangements.</p>
<p><span>19.16</span>The period of notice that entry will be required that we will consider reasonable will depend on, and be relative to, the urgency of gaining entry to carry out an inspection. In instances where we need to enter premises at short notice, for example in response to allegations of serious malpractice, we propose that a minimum of 24 hours’ notice will normally be given.</p>
<h2>Reasonable hours</h2>
<p><span>19.17</span>We would normally expect to be permitted to have access whenever an awarding organisation is conducting its business. We would expect to have access during office hours, but would also expect access when an organisation is holding meetings or undertaking other activities later in the day or at the weekend.</p>
<!--h2&gt;-->Question:</h2>
<p>Loading...</p>
<ol class="footnotes"><li id="footnote_0_133" class="footnote">An awarding organisation would be able to exclude from inspection any documents that were subject to legal privilege, that is, communications with its lawyers.</li></ol>
]]></content:encoded>
			<wfw:commentRss>http://comment.ofqual.gov.uk/regulating-for-confidence-in-standards/regulating-qualifications/entry-and-inspection-condition/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
	</channel>
</rss>

