Quantitative measures of systematic differences in OSCE scoring across examiners (often termed examiner stringency) can threaten the validity of examination outcomes. Such effects are usually conceptualised and operationalised based solely on checklist/domain scores in a station, and global grades are not often used in this type of analysis. In…

Intelligence tests are used in a variety of settings such as schools, clinics, and courts to assess the intellectual capacity of individuals of all ages. Intelligence tests are used to make high-stakes decisions such as special education placement, employment, eligibility for social security services, and determination of the death penalty.…

This study examined the scoring errors across three widely used achievement tests (Kaufman Test of Educational Achievement--Second Edition [KTEA-2], Woodcock--Johnson Tests of Achievement--Third Edition [WJ-III], and the Wechsler Individual Achievement Test--Third Edition [WIAT-III]) by novice examiners. A total of 114 protocols were evaluated for…

It is widely accepted dogma that consequential decisions are better made with multiple measures, because using but a single one is thought more likely to be laden with biases and errors that can be better controlled with a wider source of evidence for making judgments. Unfortunately, advocates of using multiple measures too rarely provide detailed…

A total of 51 Wechsler Intelligence Scale for Children, Fourth Edition (WISC-IV) protocols, administered by graduate students in training, were examined to obtain data describing the frequency of examiner errors and the impact of errors on resultant test scores. Present results were generally consistent with previous research examining graduate…