In recent years, continuing advances in technology have increased the capacity to automate the extraction of a range of linguistic features of texts and thus have provided the impetus for the substantial growth of corpus linguistics. While corpus linguistic tools and methods have been used extensively in second language learning research, they…

According to Kane (2006), the argument-based framework is quite simple and involves two steps. First, specify the proposed interpretations and uses of the scores in some detail. Second, evaluate the overall plausibility of the proposed interpretations and uses. Based on experience gained in developing that validity argument, Chapelle, Enright, and…

This article presents the author's response to Xiaoming Xi's paper titled "How do we go about investigating test fairness?" In the paper, Xi offers "a means to fully integrate fairness investigations and practice". Given the current importance accorded to fairness in the language testing community, Xi makes a case for viewing fairness as an aspect…

In this article, the author begins by discussing four challenges on the concept of validity. These challenges are: (1) the appeal to logic and syllogistic reasoning; (2) the claim of reliability; (3) the local and the universal; and (4) the unitary and the divisible. In language testing validity cannot be achieved directly but only through a…

The paper by Wilson and Moore (this volume), based on the Messick Lecture delivered in 2006 at the annual Language Testing Research Colloquium in Melbourne, may present a familiar challenge to some language testers: of reading outside one's comfort zone. The distinctive character of language testing lies in its combination of two primary fields of…

This paper presents the author's critique on Xiaoming Xi's article, "How do we go about investigating test fairness?," which lays out a broad framework for studying fairness as comparable validity across groups within the population of interest. Xi proposes to develop a fairness argument that would identify and evaluate potential fairness-based…

Just like buildings, tests are designed and built for specific purposes, people, and uses. However, both buildings and tests grow and change over time as the needs of their users change. Sometimes, they are also both used for purposes other than those intended in the original designs. This paper explores architecture as a metaphor for language…

In this speech, the author covers a lot of ground. In the first half of his speech, the author gives a brief summary of the last 40 years of the history of language testing, from his perspective. The author reviews these years more or less by decade. Additionally, he discusses the evolution of the profession of language testing during this period,…

Discusses two studies that explore the possibilities of adopting the C-Test (which involves the deletion of the second half of every other word in the text, leaving the first and last sentence intact) for testing Hebrew. Suggests the test be used with the cloze test for assessing similar things. (SED)

Presents a framework that takes as its starting point an analysis of test purpose, and then shows how purpose can be systematically related to test design. Argues that the way forward for vocabulary assessment is to take account of test purposes in the design and validation of tests, as well as considering an interactionalist approach to construct…

Discusses the elusiveness of precision in language testing in relation to three major issues of linguistic analysis: 1) universality; 2) combining power; and 3) incorporation of extra language data. The results of a recent English Language Testing Service (ELTS) Test support this relationship. Language testing should accept the centrality of…

Looks at recent approaches to communicative language testing and to the testing of English for specific purposes (ESP). Contrasts two approaches to language testing research and discusses Oller's unitary competence hypothesis. Examines problems deriving from scoring procedures associated with ESP tests. (SED)

Discusses authenticity in language testing in relation to the language proficiency movement. Looks at both sociolinguistic and psychometric principles as they are concerned with authenticity and validity as well as the inferential distance that separates face validity from techical validities. Criticizes the belief that some test type possess…

An English-as-a-second-language reading comprehension test is analyzed, first using classical measurement procedures and then using the Rasch Model latent trait procedures. Results indicate that the Rasch Model analysis procedure produced numerous advantages for the test developer. Summarizes and describes 13 of these advantages. (SED)

Surveys the development of language tests toward authenticity and discusses the advantages and disadvantages of indirect and direct (authentic) language tests. Discusses the difficulty of applying appropriate psychometric measures to tests using real-life language, and the large number of tests variables which interfere with the authenticity of…