This commentary argues that the OET research raises inescapable contradictions in trying to separate "language" from "communication" within a weak performance test and advocates for reconceptualizing the legitimate domain of "language" more widely, reclaiming the full potential of the communicative competence…

In recent years, continuing advances in technology have increased the capacity to automate the extraction of a range of linguistic features of texts and thus have provided the impetus for the substantial growth of corpus linguistics. While corpus linguistic tools and methods have been used extensively in second language learning research, they…

In this article, the author begins by discussing four challenges on the concept of validity. These challenges are: (1) the appeal to logic and syllogistic reasoning; (2) the claim of reliability; (3) the local and the universal; and (4) the unitary and the divisible. In language testing validity cannot be achieved directly but only through a…

According to Kane (2006), the argument-based framework is quite simple and involves two steps. First, specify the proposed interpretations and uses of the scores in some detail. Second, evaluate the overall plausibility of the proposed interpretations and uses. Based on experience gained in developing that validity argument, Chapelle, Enright, and…

This paper presents the author's response to Xiaoming Xi's article titled "How do we go about investigating test fairness?" In this response, the author focuses on test fairness and Toulmin's model of argument structure, Xi's proposal, and the challenges the proposal brings. Xi proposes an approach to investigating test fairness to guide…

This paper presents the author's critique on Xiaoming Xi's article, "How do we go about investigating test fairness?," which lays out a broad framework for studying fairness as comparable validity across groups within the population of interest. Xi proposes to develop a fairness argument that would identify and evaluate potential fairness-based…

Just like buildings, tests are designed and built for specific purposes, people, and uses. However, both buildings and tests grow and change over time as the needs of their users change. Sometimes, they are also both used for purposes other than those intended in the original designs. This paper explores architecture as a metaphor for language…

The paper by Wilson and Moore (this volume), based on the Messick Lecture delivered in 2006 at the annual Language Testing Research Colloquium in Melbourne, may present a familiar challenge to some language testers: of reading outside one's comfort zone. The distinctive character of language testing lies in its combination of two primary fields of…

This article presents the author's response to Xiaoming Xi's paper titled "How do we go about investigating test fairness?" In the paper, Xi offers "a means to fully integrate fairness investigations and practice". Given the current importance accorded to fairness in the language testing community, Xi makes a case for viewing fairness as an aspect…

In this speech, the author covers a lot of ground. In the first half of his speech, the author gives a brief summary of the last 40 years of the history of language testing, from his perspective. The author reviews these years more or less by decade. Additionally, he discusses the evolution of the profession of language testing during this period,…

Discusses how to tackle the problem of determining a meaningful score for yes-no tests used to measure the size of receptive vocabulary. Signal Detection Theory is applied, and a new more accurate index is suggested. (Author/VWL)

Discusses problems in task-based language assessment, including the definition and sampling of tasks, generalizations across tasks, interpretations about broad ability and language use domains, and the notion of task difficulty. (Author/VWL)

Explores the effect on pair-task performance of test-takers' familiarity with their partner. Japanese learners performed a series of tasks, once with a friend and again with a person who was not familiar to them. Results support findings in the literature that suggest learners vary their language when interacting with familiar or unfamiliar…

Describes a working model used to determine the target language use in a language for specific purpose test project: the Listening Summary Translation Exam in Taiwanese (LSTE/T). The purpose of the LSTE/T was to evaluate the summary translation ability of applicants who want to work as linguists in law enforcement agencies in the United States.…

Examines ways in which meaning is extracted in authentic language contexts and claims that whatever level of language people use deviates from some putative ideal. Such deviant use of language is common to everyday conversation. Examines two common contexts in which authentic but deviant language is the medium of communication. (Author SED)