In times of crisis it is good to look back. Not only is it comforting, but better understanding of events in our past can inform decision-making and help us find direction at uncertain times. COVID-19 may have presented new challenges, but this exploration of historical disruptions to school exams highlights themes and a recognisable human spirit.…

It is time to replace the examination regime at 16 and 18 by something more appropriate. The coalition government has been solidifying its place by its Baccalaureate reforms at both ages, but this is a move in quite the wrong direction. Whatever the wider purposes that the examination system may serve, its core aim is to find out how well students…

The commentary (1) uses the U. S. National Assessment of Educational Progress (NAEP) as a prototype for examining standardized reading achievement tests at the item level, and (2) sketches an alternative based on an initiative underway in the United Kingdom.

How to compute and report subscores for a test that was originally designed for reporting scores on a unidimensional scale has been a topic of interest in recent years. In the research reported here, we describe an application of multidimensional item response theory to identify a subscore structure in a test designed for reporting results using a…

As the brain sciences make advances in our understanding of how the human brain functions, many educators are looking to findings from the neurosciences to inform classroom teaching methodologies. This paper takes the view that the neurosciences are an excellent source of knowledge regarding learning processes, but also provides a warning…

Background: Political devolution occurred in the UK in 1998-99, following many years in which some degree of policy administration had been devolved to the four nations. Since devolution, all four countries of the UK have pursued increasingly divergent education policies. This is true in England in particular, where diversity, choice and…

At the heart of most assessments lies a set of questions, and those who write them must achieve "two" things. Not only must they ensure that each question elicits the kind of performance that shows how "good" pupils are at the subject, but they must also ensure that each mark scheme gives more marks to those who are…

This study compared higher education dental undergraduate student performance in online assessments with performance in traditional paper-based tests and investigated students' perceptions of the fairness and acceptability of online tests, and showed performance to be comparable. The project design involved two parallel cross-over trials, one in…

This brief research report gives an overview of a visually based methodology that has recently been used to shed light on situated decision-making in a high stakes educational assessment environment. Looking carefully at the feedback interactions taking place between senior and less senior examiners, the project aim was to gain insight into the…

Much of the argument about comparability of examination standards is at cross-purposes; contradictory positions are in fact often both defensible, but they are using the same words to mean different things. To clarify this, two broad conceptualisations of standards can be identified. One sees the standard in the observed phenomena of performance…

Paul Newton (2010), with his characteristic concern about theory, has set out two different ways of thinking about the basis upon which equivalences of one sort or another are established between test score scales. His reason for doing this is a desire to establish "the defensibility of linkages lower on the continuum than concordance."…

The rank-ordering method for standard maintaining was designed for the purpose of mapping a known cut-score (e.g. a grade boundary mark) on one test to an equivalent point on the test score scale of another test, using holistic expert judgements about the quality of exemplars of examinees' work (scripts). It is a novel application of an old…

Robert Coe has claimed that three broad conceptions of comparability can be identified from the literature: performance, statistical and conventional. Each of these he rejected, in favour of a single, integrated conception which relies upon the notion of a "linking construct" and which he termed "construct comparability".…

This article recognises the well-established processes available to educators for the validation of competence, however acquired, and suggests that these mechanisms could be deployed more frequently in future. This proposition is based on employers' adoption of work-based learning strategies that focus on learning outcomes rather than on…

There is a growing body of literature discussing evidence-based education, practice, policy, and decision-making from a critical perspective. In this article, drawing on the literature and policy documents related to evidence-based education in the USA, Britain, and Canada, I join this critique and offer an anticolonial perspective. I argue that…