This study evaluated the efficacy of two proposed methods in an operational standard-setting study conducted for a high-stakes language proficiency test of the U.S. government. The goal was to seek low-cost modifications to the existing Yes/No Angoff method to increase the validity and reliability of the recommended cut scores using a convergent…

Over the past decade, testing and assessing spoken-language interpreting has garnered an increasing amount of attention from stakeholders in interpreter education, professional certification, and interpreting research. This is because in these fields assessment results provide a critical evidential basis for high-stakes decisions, such as the…

As access to smartphones and emerging technologies has become ubiquitous in our daily lives and in language learning, technology-mediated social interaction has become common in teaching and assessing L2 speaking. The changing ecology of L2 spoken interaction provides language educators and testers with opportunities for renewed test design and…

Argues that a growing awareness of the fundamentally social character of language assessment challenges a rethinking of priorities and responsibilities in language testing research. This awareness is the result of the treatment of the social character of educational assessment in Messick's (1989) work on validity and by actual changes triggered by…

Considers the ecological validity of tests in predicting the effects of speech and language impairment on communicative performance in real-world settings and the need for systematic observation of communicative behaviors, particularly of individuals from other cultures. Discusses whether standardized testing and systematic observation are…