This brief research report gives an overview of a visually based methodology that has recently been used to shed light on situated decision-making in a high stakes educational assessment environment. Looking carefully at the feedback interactions taking place between senior and less senior examiners, the project aim was to gain insight into the…

Little research has been conducted on teaching children with autism spectrum disorders to be compliant with dental procedures. This study evaluated a behavioral package to train children with autism spectrum disorders to be compliant with an 8 component oral assessment. After a dental hygienist performed an assessment pretest, noncompliance on…

Sex differences in disruptive behavior and sensitivity to social context are documented, but the intersection between them is rarely examined empirically. This report focuses on sex differences in observed disruptive behavior across interactional contexts and diagnostic status. Preschoolers (n = 327) were classified as nondisruptive (51%),…

The oral examination is an important component of the high-stakes "O" Level examination in Singapore taken by 16-17 year olds whose first language may or may not be English. In spite of this, there has been sparse research into the examination. This paper reports findings of an exploratory study which attempted to determine whether there…

Technological developments are impacting upon UK assessment practices in many ways. For qualification awarding bodies, a key example of such impact is the ongoing shift towards examiners marking digitally scanned copies of examination scripts on screen rather than the original paper documents. This digitisation process has obvious benefits,…

There is a growing body of research literature that considers how the mode of assessment, either computer-based or paper-based, might affect candidates' performances. Despite this, there is a fairly narrow literature that shifts the focus of attention to those making assessment judgements and which considers issues of assessor consistency when…

This article presents an interview with Dr. Paul Nolting, a national expert in assessing individual math learning problems, developing effective student learning strategies, and assessing institutional variables that affect math success. Since his dissertation in 1986 on improving math success with study skills Dr. Nolting has consulted with over…

The article draws on findings from the "PhD Examination Project" at the SORTI Research Centre of The University of Newcastle, Australia. It focuses on an analysis of the roles of examiner and supervisor, in relation to the candidate, as seen through the lens of Habermas's "Ways of Knowing" theory. On the basis of this, it has…

The authors assessed the reliability of the Autism Diagnostic Interview (ADI-R). Seven Clinical Examiners evaluated a three and one half year old female toddler suspected of being on the Autism Spectrum. Examiners showed agreement levels of 94-96% across all items, with weighted kappa (K[subscript w]) between 0.80 and 0.88. They were in 100%…

Objective: To examine prospectively the emergence of behavioral signs of autism in the first years of life in infants at low and high risk for autism. Method: A prospective longitudinal design was used to compare 25 infants later diagnosed with an autism spectrum disorder (ASD) with 25 gender-matched low-risk children later determined to have…

External music examiners play a significant role in assessing, verifying and maintaining musical standards. Educational output endorsed by external examiners serves to verify, modify and legitimise internal behaviour. This article examines some of the "inside practices" of external music examiners in the context of quality assurance. It…

It has long been established that marking accuracy in public examinations varies considerably among subjects and markers. This is unsurprising, given the diverse cognitive strategies that the marking process can entail, but what makes some questions harder to mark accurately than others? Are there distinct but subtle features of questions and…

Despite the abundant literature on educational measurement there has been relatively little work investigating the psychological processes underpinning marking. This research investigated the processes involved when examiners mark examination responses. Scripts from two geography A-level examinations were used: one requiring short and medium…

Objective: The authors examined the effects of medical student assignment to U.S. Department of Veterans Affairs (VA) Medical Center inpatient and outpatient psychiatry clerkship sites versus other university and community sites on the performance outcome measure of National Board of Medical Examiners (NBME) subject examination scores. Methods:…

Multiple factors have influenced testing agencies to more carefully consider the manner and frequency in which pretest item data are collected and analyzed. One potentially promising development is judges' estimates of item difficulty. Accurate estimates of item difficulty may be used to reduce pretest samples sizes, supplement insufficient…