It has long been established that marking accuracy in public examinations varies considerably among subjects and markers. This is unsurprising, given the diverse cognitive strategies that the marking process can entail, but what makes some questions harder to mark accurately than others? Are there distinct but subtle features of questions and…

Despite the abundant literature on educational measurement there has been relatively little work investigating the psychological processes underpinning marking. This research investigated the processes involved when examiners mark examination responses. Scripts from two geography A-level examinations were used: one requiring short and medium…

Multiple factors have influenced testing agencies to more carefully consider the manner and frequency in which pretest item data are collected and analyzed. One potentially promising development is judges' estimates of item difficulty. Accurate estimates of item difficulty may be used to reduce pretest samples sizes, supplement insufficient…

Objective: The authors examined the effects of medical student assignment to U.S. Department of Veterans Affairs (VA) Medical Center inpatient and outpatient psychiatry clerkship sites versus other university and community sites on the performance outcome measure of National Board of Medical Examiners (NBME) subject examination scores. Methods:…

This article investigates whether verbal protocol analysis is a sound methodology in the context of researching examination marking processes. As part of a larger study, six examiners marked fifty scripts at home and some further scripts during meetings (some silently and some whilst thinking aloud) for two A level examinations. Some scripts were…

Background: "Thinking aloud" is a well-established method of data collection in education, assessment, and other fields of research. However, while many researchers have reported their views on its usage, the first-hand experiences of research participants have received less attention. Purpose: The aim of this exploratory study was to…

The examination of doctoral theses controls an important academic threshold, yet practices are often private, codes non-specific, and individuals isolated. This article adds to recent investigation of the examination culture by reporting informal panel discussion amongst a total of 23 University of Auckland (New Zealand) faculty members as to…

This paper reports on the results of a 3-year study conducted at the Centre for Schooling and Learning Technologies (CSaLT) at Edith Cowan University in collaboration with the Curriculum Council of Western Australia which concerns the potential to use digital technologies to represent the output from assessment tasks in the senior secondary…

It is particularly important that GCSE and A-level marking is valid and reliable as it affects the life chances of many young people in England. Current developments in marking technology are coinciding with potential changes in procedures to ensure valid and reliable marking. In this research the effectiveness of procedures to facilitate the…

The EdD (Doctor in Education) is a professional doctorate that provides a framework for experienced professionals to examine and develop their practice through research and engagement with relevant theoretical perspectives and professional academic literature. This type of doctorate provides the opportunity for professionals to develop their…

The use of pair work in speaking assessment may encourage collaboration in the classroom and has other advantages (Saville & Hargreaves, 1999; Taylor, 2000) but from a measurement perspective, the paired oral format may be problematic because a partner may unfairly influence an examinee's performance or otherwise bias scores. In this study,…

The purpose of the current study was to compare students' oral reading fluency (ORF) skills before and after summer break. This study examined whether students whose ORF regressed would regain those skills within a month of returning to school. In particular, the study examined differences between students with and without specific learning…

Objective: The authors examine associations of personality characteristics, National Board of Medical Examiners subject examination performance, and Objective Structured Clinical Examination performance with clinical evaluations of third-year medical students in a psychiatry clerkship. Methods: Students completed the Revised NEO Personality…

This article focuses on the assessment system at Western Governors University from the perspective of candidate assessment and performance and on the way in which this system is presented to the Board of Examiners of the National Council for Accreditation of Teacher Education (NCATE). Central to a successful review by the NCATE Board of Examiners…

The argument made in this essay is that it is necessary to theorize a form of assessment--the academic viva in higher education. It is threatened with extinction because of its high cost compared with written exams, multiple choice and other forms of assessment. However, little empirical research, both in Norway and internationally, has been…