There are two major myths concerning A level exam standards in England. First, the Ancient Myth, which insists that standards were norm-referenced until the 1980s, when they transitioned to being criterion-referenced. Second, the Modern Myth, which insists that standards transitioned again, during the 2010s, to being based upon the comparable…

For many practical purposes, it is often assumed that the quality of a marker is directly related to their seniority. At its extreme, the assumption is that the most senior marker (the Principal Examiner) is always right even in cases where large numbers of junior markers have a collectively different opinion regarding the mark that should be…

In a context of international concern about academic standards, the practice of external examining is widely admired for its role in defending standards. Yet a contradiction exists between this faith in examining and continuing concerns about standards. This article argues that external examining rests on assumptions about standards which are…

Examiner effects and content specificity are two well known sources of construct irrelevant variance that present great challenges in performance-based assessments. National medical organizations that are responsible for large-scale performance based assessments experience an additional challenge as they are responsible for administering…

In the UK and elsewhere, large-scale educational assessment agencies are shifting the mode of school examination marking towards having examiners mark examination scripts on screen rather than on paper. This shift has prompted questions about whether the mode of marking might influence examiner marking accuracy, particularly in relation to…

The authors examined the difference in standardized test performance when familiar versus unfamiliar examiners tested 26 preschool and elementary-aged children with autism. The children were matched by age, severity, and developmental level and then randomly placed into familiar and unfamiliar examiner groups. Familiarity with the examiner was…

The PhD viva has been described as mysterious (Burnham 1994; Morley et al. 2002), unpredictable (Rugg & Petre 2004) and potentially frightening for students (Delamont et al. 2004), with its form and duration a function of the predilections of individual examiners as well as a function of differences across disciplines. Despite its myriad…

This report outlines the final recommendations of the review of external examining arrangements undertaken by UUK and GuildHE and chaired by Professor Dame Janet Finch, former Vice-Chancellor of Keele University. The review found that, on the whole, external examining arrangements in the UK are working well, but the report offers recommendations…

The question of what a doctorate is has been looked at before. The author argues that the issue of "doctorateness" is a recurring debate which needs to kept alive and revisited regularly. The aim of this article is to suggest five different areas or arenas in which the question can be addressed, forming a framework which can perhaps be…

The judgement processes underpinning examination marking are central to achieving fair assessment but are under-researched. This article draws on existing literature and uses additional analysis of data collected in a previous article "Exploring the nature of examiner thinking during the process of examination marking", to start to piece together…

This paper first analyzed two studies on rater factors and rating criteria to raise the problem of rater agreement. After that the author reveals the causes of discrepencies in rating administration by discussing rater variability and rater bias. The author argues that rater bias can not be eliminated completely, we can only reduce the error to a…

In case of an emergency, a fast and structured patient management is crucial for patient's outcome. The competencies needed should be acquired and assessed during medical education. The objective structured clinical examination (OSCE) is a valid and reliable assessment format to evaluate practical skills. However, traditional OSCE stations examine…

Objective: The authors investigated whether curriculum change could produce improved performance, despite a reduction in clerkship length from 8 to 4 weeks. Methods: The exam performance of medical students completing a 4-week clerkship in psychiatry was compared to national data from the National Board of Medical Examiners' Psychiatry Subject…

Accurate marking is crucial to the reliability and validity of public examinations, in England and internationally. Factors contributing to accuracy have been conceptualised as affecting either marking task demands or markers' personal expertise. The aim of this empirical study was to develop this conceptualisation through investigating the…

This article presents a review of the "Wechsler Adult Intelligence Scale-Fourth Edition" (WAIS-IV), an individually administered measure of cognitive ability for individuals aged 16 years, 0 months to 90 years, 11 months. The WAIS-IV was designed with a number of specific goals including updated norms, increased user friendliness,…