Parents participating in a prospective longitudinal study of infants with older siblings with autism completed an autism screening questionnaire and were asked about any concerns relating to their child's development, and children were administered an interactive assessment conducted by a researcher at 14 months. Scores on the parent questionnaire…

For many practical purposes, it is often assumed that the quality of a marker is directly related to their seniority. At its extreme, the assumption is that the most senior marker (the Principal Examiner) is always right even in cases where large numbers of junior markers have a collectively different opinion regarding the mark that should be…

In April 2021, The Association for Assessment and Research in Counseling Executive Council commissioned a time-referenced task group to revise the Responsibilities of Users of Standardized Tests (RUST) Statement (3rd edition) published by the Association for Assessment in Counseling (AAC) in 2003. The task group developed a work plan to implement…

It is widely accepted dogma that consequential decisions are better made with multiple measures, because using but a single one is thought more likely to be laden with biases and errors that can be better controlled with a wider source of evidence for making judgments. Unfortunately, advocates of using multiple measures too rarely provide detailed…

The present investigation explores Cognitive Test Anxiety (CTA) in a high-stake oral examination, taking into consideration how face-to-face and computer-based examination formats affect test-takers' anxiety and consequently language performance. Two speaking tests -- face-to-face and computer-based -- were developed for a Spanish university's…

The growing demand placed upon educators has taken a toll on the profession (Walker, 2014). Teacher burnout, stress, and unhappiness may be predestined unless administrators recognize how to prevent these from happening (Elias, 2012). The intent of this quantitative study was to survey teachers in southwest Missouri to determine their level of job…

Examiner effects and content specificity are two well known sources of construct irrelevant variance that present great challenges in performance-based assessments. National medical organizations that are responsible for large-scale performance based assessments experience an additional challenge as they are responsible for administering…

Protocols from 108 administrations of the Reynolds Intellectual Assessment Scales were evaluated to determine the frequency of examiner errors and their impact on the accuracy of three test composite scores, the Composite Ability Index (CIX), Verbal Ability Index (VIX), and Nonverbal Ability Index (NIX). Students committed at least one…

The manual is presented in the form of a policy grid. The grid includes a consolidated list of General Educational Development (GED) Testing Service policies regarding the GED® test and overall GED® program. The grid combines all of the policies into one unified table and supersedes any prior policy manual.

Effects of test administrator's gender on test takers' self-estimated verbal general knowledge and de facto verbal general knowledge were investigated. Based on three theories previously applied in research dealing with the effects of test administrator's ethnicity, it was expected male and female test takers to show higher scores under female…

Objective: Medical students' satisfaction with the psychiatry clerkship, sense of preparedness for an institutional Objective Structured Clinical Exam (OSCE), expressed likelihood of choosing psychiatry as a specialty, and National Board of Medical Examiners (NBME) psychiatry shelf-examination scores were compared after a curriculum based on…

Some methods of determining grade boundaries within examinations, such as awarding, paired comparisons, and rank ordering, entail expert judgements of script quality. We aimed to identify the features of examinees' scripts that most influence judgements in the three methods. For contrasting examinations in biology and English, a Latin square…

We use a natural experiment to show that the presence of an external examiner has both a direct and an indirect negative effect on the performance of monitored classes in standardized educational tests. The direct effect is the difference in the test performance between classes of the same school with and without external examiners. The indirect…

This paper first analyzed two studies on rater factors and rating criteria to raise the problem of rater agreement. After that the author reveals the causes of discrepencies in rating administration by discussing rater variability and rater bias. The author argues that rater bias can not be eliminated completely, we can only reduce the error to a…

Competency based medical education involves assessing physicians-in-training in multiple roles. Training programs are challenged by the need to introduce appropriate yet feasible assessment methods. We therefore examined the utility of a structured oral examination (SOE) in the assessment of the 7 CanMEDS roles (Medical Expert, Communicator,…