Research and analysis

Reliability of assessment: compendium

Research papers published as Ofqual's 'Reliability Compendium' looking at the reliability of education assessment.

• From: Ofqual
• Published: 16 May 2013

Applies to England, Northern Ireland and Wales

Documents

Introduction to the concept of reliability

HTML

Ofqual's reliability programme: overview

HTML

Partial Estimate of Reliability: Parallel Form Reliability in the KS2 Science Tests: Summary

HTML

Ref: Ofqual/09/4553

PDF, 438 KB, 40 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Classification accuracy in results from KS2 National Curriculum Tests: Summary

HTML

Ref: Ofqual/11/4830

PDF, 211 KB, 22 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Classification accuracy and consistency in GCSE and A Level examinations offered by the Assessment and Qualifications Alliance (AQA) November 2008 to June 2009: Summary

HTML

Ref: Ofqual/11/4823

PDF, 530 KB, 44 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Component reliability in GCSE and GCE: Summary

HTML

Ref: Ofqual/11/4780

PDF, 1.6 MB, 86 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Estimates of reliability of qualifications: Summary

HTML

Ref: Ofqual/11/4826

PDF, 1.77 MB, 106 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Ref: Ofqual/11/4824

PDF, 2.03 MB, 52 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

A focus on teacher assessment reliability in GCSE and GCE: Summary

HTML

Ref: Ofqual/11/4807

PDF, 421 KB, 58 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Parallel universes and parallel measures: estimating the reliability of test results: Summary

HTML

Ref: Ofqual/10/4709

PDF, 757 KB, 67 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Conceptualising and interpreting reliability: Summary

HTML

Ref: Ofqual/10/4706

PDF, 632 KB, 67 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Estimating the reliability of composite scores: Summary

HTML

Ref: Ofqual/10/4703

PDF, 193 KB, 39 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

International survey of results reporting: Summary

HTML

Ref: Ofqual/10/4705

PDF, 2.12 MB, 56 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Reporting of measurement uncertainty and reliability for US educational and licensure tests: Summary

HTML

Ref: Ofqual/10/4759

PDF, 419 KB, 19 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Summary of the technical seminar report

HTML

Ref: Ofqual/09/4638

PDF, 58.1 KB, 13 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

No news is good news? Talking to the public about the reliability of assessment: Summary

HTML

PDF, 19.6 KB, 5 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Public perceptions of reliability in examinations: Summary

HTML

PDF, 134 KB, 46 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Public perceptions of reliability: Summary

HTML

Ref: Ofqual/10/4708

PDF, 745 KB, 36 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

A Quantitative Investigation into Public Perceptions of Reliability in Examination Results in England: Summary

HTML

Ref: Ofqual/10/4769

PDF, 466 KB, 68 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Summary of the final report of the Technical Advisory Group

HTML

Ref: Ofqual/11/4825

PDF, 1.2 MB, 80 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Summary of the policy advisory group's final report

HTML

Ref: Ofqual/11/4829

PDF, 161 KB, 20 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Summary of the final report

HTML

Ref: Ofqual/11/4828

PDF, 1.02 MB, 61 pages

This file may not be suitable for users of assistive technology.

Request an accessible format.

If you use assistive technology (such as a screen reader) and need a version of this document in a more accessible format, please email publications@ofqual.gov.uk. Please tell us what format you need. It will help us if you say what assistive technology you use.

Appendix 1: Ofqual바카라 사이트™s reliability programme remit

HTML

Appendix 2: Reliability Programme Technical Advisory Group and Policy Advisory Group members

HTML

Appendix 3: compendium authors

HTML

Appendix 4: contributing authors

HTML

Appendix 5: seminar participants

HTML

Appendix 6: glossary of terms

HTML

Details

Public exams have to be fair. It is Ofqual바카라 사이트™s job to make sure that candidates get the results they deserve, and that their qualifications are valued and understood in society. Ensuring examination reliability is a key part of this - making sure that candidates obtain a fair result, irrespective of:

• who marks their paper
• what types of questions are used (multiple choice or essay questions)
• which topics are set or chosen to be answered
• when the examination is taken

This consistency of exam results is referred to as reliability: the repeatability of results from one assessment to the next, whether they are assessments taken on different days, or from one year to the next.

In everyday use, 바카라 사이트˜reliable바카라 사이트™ means 바카라 사이트˜that which can be relied on바카라 사이트™, but the technical definition in educational assessment is narrower. In assessment, the definition is 바카라 사이트˜the extent to which a candidate would get the same test result if the testing procedure was repeated바카라 사이트™. The technical definition of reliability is a sliding scale, not black or white, and encourages us to consider the degree of differences in candidates바카라 사이트™ results from one instance to the next.

Published 16 May 2013