Our aim was to deepen understanding of public examinations, exploring how marking task demands influence examiners' cognition and ultimately their marking accuracy. To do this, we identified features of examinations that trigger or demand the use of cognitive marking strategies entailing "reflective" judgements. Kelly's Repertory Grid…

The judgement processes underpinning examination marking are central to achieving fair assessment but are under-researched. This article draws on existing literature and uses additional analysis of data collected in a previous article "Exploring the nature of examiner thinking during the process of examination marking", to start to piece together…

The Task-based Language Teaching (TBLT) method has been the proposed teaching method under the current national English curriculum since 2001. However, few studies have investigated in-service teachers' response to this proposed language teaching method. In this study, thirty public school English teachers were recruited in Beijing across school…

Over recent years, UK medical schools have moved to more integrated summative examinations. This paper analyses data from the written assessment of undergraduate medical students to investigate two key psychometric aspects of this type of high-stakes assessment. Firstly, the strength of the relationship between examiner predictions of item…

The read-aloud accommodation is one of the most frequently used accommodations. Many educators need training to more confidently select, implement, and evaluate the use of the read-aloud accommodation. Planning by special education leaders can help ensure that test day goes smoothly for students who need the read-aloud accommodation.

This paper first analyzed two studies on rater factors and rating criteria to raise the problem of rater agreement. After that the author reveals the causes of discrepencies in rating administration by discussing rater variability and rater bias. The author argues that rater bias can not be eliminated completely, we can only reduce the error to a…

Ultrasound imaging was used to investigate the articulation of the voiceless velar stop [k] in five speakers with compensatory articulation related to cleft palate. The perceptual evaluation of the acoustic realization and the visual assessment of the tongue movement for the target sound were made by three examiners. The analysis revealed a…

To evaluate the implications of deliberate practice when teaching test administration skills, novice, but trained, graduate student examiners administered intelligence tests to a convenience sample of volunteer school-age examinees assigned to a first test session. A second, different convenience sample of volunteer school-age examinees were…

This study investigated factors that could affect inter-examiner reliability in the pronunciation assessment component of speaking tests. We hypothesized that the rating of pronunciation is susceptible to variation in assessment due to the amount of exposure examiners have to nonnative English accents. An inter-rater variability analysis was…

In case of an emergency, a fast and structured patient management is crucial for patient's outcome. The competencies needed should be acquired and assessed during medical education. The objective structured clinical examination (OSCE) is a valid and reliable assessment format to evaluate practical skills. However, traditional OSCE stations examine…

In popular culture, the inventor is often portrayed as a lone tinkerer who emerges from a workshop with some magnificent new device. In reality, most inventions are the collaborative effort of scientists and engineers--usually researchers affiliated with a college or corporation--that result in the discovery, creation, or improvement of either…

The question of whether marking speed is related to marking accuracy is important for training examiners and planning realistic marking schedules. We explored marking speed in the context of a past examination for an international biology qualification for 14- to 16-year-olds. Forty-two markers with differing backgrounds experimentally marked 23…

Objective: The authors investigated whether curriculum change could produce improved performance, despite a reduction in clerkship length from 8 to 4 weeks. Methods: The exam performance of medical students completing a 4-week clerkship in psychiatry was compared to national data from the National Board of Medical Examiners' Psychiatry Subject…

Accurate marking is crucial to the reliability and validity of public examinations, in England and internationally. Factors contributing to accuracy have been conceptualised as affecting either marking task demands or markers' personal expertise. The aim of this empirical study was to develop this conceptualisation through investigating the…

Introduction: Medical student concern that the submission of named examination scripts to examiners could cause bias initiated a study on the effect of identified and de-identified scripts on assessment outcome. Methods: Data were collected from a convenience examination sample of Year 1 (n = 88 students; n = 29 questions) and Year 2 scripts (n =…