When the COVID-19 pandemic made it impossible to do in-person, on campus testing, we were forced to create a new system to screen International Teaching Assistants (ITA) for Temple university. We used this opportunity to address many of the concerns and problems that we had identified with the previous test, and created a new test that could be…

In this interview, JD Brown reflects on language testing/assessment. He suggests that language testing can be seen as a continuum with hard core positivist approaches at one end and post modernist interpretive perspectives at the other, and also argues that norm referencing (be it proficiency, placement, or aptitude testing) and criterion…

Those who work in second- and foreign-language testing often find Koretz's concern for validity inferences under high-stakes (VIHS) conditions both welcome and familiar. While the focus of the article is more narrowly on the potential for two instructional responses to test-based accountability, "reallocation" and "coaching,"…

In this article, the author begins by discussing four challenges on the concept of validity. These challenges are: (1) the appeal to logic and syllogistic reasoning; (2) the claim of reliability; (3) the local and the universal; and (4) the unitary and the divisible. In language testing validity cannot be achieved directly but only through a…

This paper presents the author's critique on Xiaoming Xi's article, "How do we go about investigating test fairness?," which lays out a broad framework for studying fairness as comparable validity across groups within the population of interest. Xi proposes to develop a fairness argument that would identify and evaluate potential fairness-based…

Just like buildings, tests are designed and built for specific purposes, people, and uses. However, both buildings and tests grow and change over time as the needs of their users change. Sometimes, they are also both used for purposes other than those intended in the original designs. This paper explores architecture as a metaphor for language…

In this speech, the author covers a lot of ground. In the first half of his speech, the author gives a brief summary of the last 40 years of the history of language testing, from his perspective. The author reviews these years more or less by decade. Additionally, he discusses the evolution of the profession of language testing during this period,…

Discusses the advantages and disadvantages of oral examinations of advanced degree candidates. Looks at examiners' attitudes and the kinds of questions which should be asked. Suggests that a fair oral examination ought to include factual as well as nonfactual questions and argues that many factual questions can be justified. (SED)

Looks at recent approaches to communicative language testing and to the testing of English for specific purposes (ESP). Contrasts two approaches to language testing research and discusses Oller's unitary competence hypothesis. Examines problems deriving from scoring procedures associated with ESP tests. (SED)

The use by interviewers of a deliberate, prearranged, and consistent overall structure, comprising warm-up, level check, probes, and wind-up, can strengthen the content validity of interview tests. Moreover, the flexibility necessary for elicitation is increased if an established battery of well-structured tasks exists for candidates to perform.…

Responds to criticism against the use of the oral proficiency interview for foreign language testing through examination of the concept of logic and language testing, components of speaking ability, and the limits of linguistic theory. (20 references) (CB)

Addresses the effectiveness of the oral proficiency interview in assessing foreign language skills, responding to arguments regarding the logic of the interview method, the American Council on the Teaching of Foreign Languages (ACTFL) guidelines and levels of proficiency, and the relationship between linguistic knowledge and the bases of…

Discusses authenticity in language testing in relation to the language proficiency movement. Looks at both sociolinguistic and psychometric principles as they are concerned with authenticity and validity as well as the inferential distance that separates face validity from techical validities. Criticizes the belief that some test type possess…

Supports use of multiple paradigms for the measurement of individual differences in the search for explanations of natural language. Rather than a single paradigm discipline, they offer a wider scope of inquiry--phenomena of interest, types of questions, and forms of explanations, as well as opening the discipline to inspiration and analogy from…

An English-as-a-second-language reading comprehension test is analyzed, first using classical measurement procedures and then using the Rasch Model latent trait procedures. Results indicate that the Rasch Model analysis procedure produced numerous advantages for the test developer. Summarizes and describes 13 of these advantages. (SED)