In this article, the author begins by discussing four challenges on the concept of validity. These challenges are: (1) the appeal to logic and syllogistic reasoning; (2) the claim of reliability; (3) the local and the universal; and (4) the unitary and the divisible. In language testing validity cannot be achieved directly but only through a…

The paper by Wilson and Moore (this volume), based on the Messick Lecture delivered in 2006 at the annual Language Testing Research Colloquium in Melbourne, may present a familiar challenge to some language testers: of reading outside one's comfort zone. The distinctive character of language testing lies in its combination of two primary fields of…

This article presents the author's response to Xiaoming Xi's paper titled "How do we go about investigating test fairness?" In the paper, Xi offers "a means to fully integrate fairness investigations and practice". Given the current importance accorded to fairness in the language testing community, Xi makes a case for viewing fairness as an aspect…

This paper presents the author's critique on Xiaoming Xi's article, "How do we go about investigating test fairness?," which lays out a broad framework for studying fairness as comparable validity across groups within the population of interest. Xi proposes to develop a fairness argument that would identify and evaluate potential fairness-based…

In this speech, the author covers a lot of ground. In the first half of his speech, the author gives a brief summary of the last 40 years of the history of language testing, from his perspective. The author reviews these years more or less by decade. Additionally, he discusses the evolution of the profession of language testing during this period,…

Describes a three-phase process model for interface design, drawing on practices developed in the software industry and adapting them for computer-based languages tests. Describes good practice in initial design, emphasizes the importance of usability testing, and argues that only through following a principled approach to interface design can the…

Examines linguistic, psychometric, and clinical aspects of the Test for Sentence Development, a subtest of a new Dutch language production battery, the Schlichting Test voor Taalproductie. The advantage of the new test is that very young children can be assessed systematically, which was not possible previously. (Author/VWL)

Presents a framework that takes as its starting point an analysis of test purpose, and then shows how purpose can be systematically related to test design. Argues that the way forward for vocabulary assessment is to take account of test purposes in the design and validation of tests, as well as considering an interactionalist approach to construct…

Considers how far a code of ethics makes language testing an open profession and notes the dangers of face validity and of hypocrisy. Discusses the need for a code of practice to provide detailed guidance to language testers with regard to their professional responsibilities. (Author/VWL)

Looks at recent approaches to communicative language testing and to the testing of English for specific purposes (ESP). Contrasts two approaches to language testing research and discusses Oller's unitary competence hypothesis. Examines problems deriving from scoring procedures associated with ESP tests. (SED)

Reviews assumptions underlying approaches to research into speaking task difficulty and questions the view that test scores always vary with task conditions or discourse variation. Offers a new approach to defining task difficulty in terms of the interaction between pragmatic task features and first language cultural background. Results of a study…

Discusses problems in task-based language assessment, including the definition and sampling of tasks, generalizations across tasks, interpretations about broad ability and language use domains, and the notion of task difficulty. (Author/VWL)

Discusses the purpose of a French-as-a-Second-Language (FSL) placement test designed for students enrolling in FSL at the postsecondary level. The test measures proficiency level in French and consists of three parts: comprehension of a short paragraph, selection of the appropriate statement in a situation, and a fill-in-the-gap part. (JL)

Questions the English for specific purposes enterprise on both practical and theoretical grounds. Rejects the idea of considering specific purposes (SPs) as registers alone, agreeing with suggestions that SPs are characterized by their communicative natures. Questions the influence SP factors have in test-taker performances relative to other…

Presents simplified methods for deriving estimates of the consistency of criterion-referenced, English-as-a-Second-Language tests, including (1) the threshold loss agreement approach using agreement or kappa coefficients, (2) the squared-error loss agreement approach using the phi(lambda) dependability approach, and (3) the domain score…