Human raters are normally involved in L2 performance assessment; as a result, rater behavior has been widely investigated to reduce rater effects on test scores and to provide validity arguments. Yet raters' cognition and use of rubrics in their actual rating have rarely been explored qualitatively in L2 speaking assessments. In this study three…

Thirty-two children aged 7 to 12 participated in a study to determine the reliability of the Ekwall Reading Inventory (ERI) and the Classroom Reading Inventory (CRI). The children were randomly assigned to take one of the two inventories, which were administered by four different specially trained teachers. The study used a test-retest design, in…

A study compared student evaluations made by residency directors and deans in 2 medical schools, using 3 standard methods of ranking 20 students per school. Ordinal ranking showed substantial agreement for 15 of 16 residency directors. Two methods of clustering into fixed groups gave high agreement only for top students. (Author/MSE)

Problems inherent in the holistic scoring of essay examinations written by limited-English-speakers are examined, particularly in the context of one California state college in which English writing skills, holistically assessed, are required for graduation. These problems include lack of interrater reliability, raters' perceptions of their role,…