Raters are central to writing performance assessment, and rater development--training, experience, and expertise--involves a temporal dimension. However, few studies have examined new and experienced raters' rating performance longitudinally over multiple time points. This study uses operational data from the writing section of the MELAB (n =…

Information provided by examination of the skills that underlie holistic scores can be used not only as supporting evidence for the validity of inferences associated with performance tests but also as a way to improve the scoring rubrics, descriptors, and benchmarks associated with scoring scales. As fluency is considered a critical, perhaps…

The study reported here examined the evaluation criteria used to assess the proficiency and effectiveness of the language produced in an oral performance test of English conducted in an American university context. Empirical methods were used to analyze qualitatively and quantitatively transcriptions of the Oral English Tests (OET) of 44…

Language performance assessments typically require human raters, introducing possible error. In international examinations of English proficiency, rater language background is an especially salient factor that needs to be considered. The existence of rater language background-related bias in writing performance assessment is the object of this…

Suggests that language testing should be more performance-based and realigned with a current and richer understanding of the language teaching and learning processes. This kind of testing has questionable validity until a wide range of variables are successfully defined and delimited. (CB)

Examined the validity of aural and oral self-report scales for determining the Fiji Hindi proficiency of new adolescent immigrants in New Zealand. Participants completed self-reports and performance tests (oral interviews, listening-comprehension tests, and vocabulary tests). Performance tests correlated strongly with self-reports. Respondents…

Discusses a recently developed post-admissions testing battery, for Ontario colleges and universities, that tests students' listening, speaking, reading, and writing skills through integrated texts and tasks that simulate academic language use. The battery yields placement and diagnostic information about students' readiness to undertake academic…