Researchers frequently evaluate rater judgments in performance assessments for evidence of differential rater functioning (DRF), which occurs when rater severity is systematically related to construct-irrelevant student characteristics after controlling for student achievement levels. However, researchers have observed that methods for detecting…

There is emerging evidence that collocation use plays a primary role in determining various dimensions of L2 oral proficiency assessment and development. The current study presents the results of three experiments which examined the relationship between the degree of association in collocation use (operationalized as t scores and mutual…

This cross-sectional study used assessments developed by the Center for Applied Linguistics to examine the oral proficiency of 218 K-8 English-proficient students in 4 Spanish immersion programs. Following a comprehensive review of assessment results for English-proficient immersion learners, the article reports findings from statistical analyses.…

The article addresses some problems and options in setting standards on language tests and examinations. More specifically, it reports on a set of three workshops conducted in the European context where standard setting in language education typically concerns linking tests and examinations to the Council of Europe's "Common European…

The increasing influence of sociocultural theories of learning on assessment practices in second language education necessitates an expansion of the knowledge base that teacher-assessors need to develop (what teachers need to know) and related changes in the processes of language teacher education (how they learn and develop it). Teacher assessors…

This paper reports a case study of the nature and extent of progress in speaking skills made by a group of upper intermediate instructed learners, and also assessors' perceptions of that progress. Initial and final interview data were analysed using several measures of Grammatical and Lexical Complexity, Language Accuracy and Fluency. These…

This article describes an alternative approach to setting standards for performance assessments. The procedure was designed for use in low-budget, relatively low-stakes contexts where it is not possible to bring expert judges together. The procedure that allowed participant judges to work individually throughout the process was an effort to…

Starting from the premise that the teaching profession tends to view formal assessment procedures with some misgivings, the following article attempts to develop the argument that the problem is, at least in part, one of too narrow a perspective. A case study is first described involving the trialling of a vocabulary test at a language teaching…

Sheds light on some of the possibilities and pitfalls of question design for examinations, referring to a specific academic setting as an illustrative case study. A narrative account is presented of a staff "consciousness raising" workshop in which the presenters drew on writing prompts that examiners judged to have work or not work in practice.…