The redesigned "TOEIC Bridge"® tests were designed to evaluate test takers' English listening, reading, speaking, and writing skills in the context of everyday adult life. In this paper, we summarize the initial validity argument that supports the use of test scores for the purpose of selection, placement, and evaluation of a test…

We describe the summative assessment component within a K-12 assessment program and our development of a validity argument to support its claims with respect to intended uses and interpretations. First, we describe the "Winsight"® assessment program theory of action, a logic model elucidating mechanisms for how use of the assessment…

As the number of candidates who repeat English language proficiency tests more than once to meet a certain cutscore (e.g., for university admission) or to demonstrate progress (e.g., after instruction) continues to increase dramatically, there is a need for more research on the attributes and test performance of test repeaters. This article…

According to Kane (2006), the argument-based framework is quite simple and involves two steps. First, specify the proposed interpretations and uses of the scores in some detail. Second, evaluate the overall plausibility of the proposed interpretations and uses. Based on experience gained in developing that validity argument, Chapelle, Enright, and…

Washback and fairness are interrelated in validity research, and thus an investigation into washback inevitably involves fairness. This article reports Phase One of a washback study of "Test for English Majors for Grade Eight" (TEM8). Phase One was a questionnaire survey administered to university program administrators. Two research…

The fuzziness of assessing second language speaking performance raises two difficulties in scoring speaking performance: "indistinction between adjacent levels" and "overlap between scales". To address these two problems, this article proposes a new approach, "confidence scoring", to deal with such fuzziness, leading to "confidence" scores between…

This study examined initial evidence of changes in fit to a unidimensional model for some language tests at multiple ability levels. Seven data sets were analyzed using the first phase of exploratory factor analysis: principal component eigenvalue extraction. Each data set is analyzed at varying n-sizes: whole group; random subsample; and five…

If sociolinguistics involves the specification and analysis of sociological, interpersonal, and pragmatic variables at issue in given language-use situations, and discourse anaysis is the observation and analysis of both linguistic and paralinguistic features of speech events within these situations, there are at least three areas in these…

The concept of "washback," especially prominent in the field of applied linguistics, refers to the extent to which a test influences teachers and learners to do things they would not otherwise necessarily do. Some writers invoke the notion of washback validity, holding that a test's validity should be gauged by the degree to which it has…

Commercially available tests and measurement instruments for use with English-speaking subjects are described and reviewed. Only tests that are new, have been revised since last reviewed in the Mental Measurements Yearbook series, or are considered established and highly used are included. The contents are as follows: (1) a bibliography of…

A standardized language arts achievement test can be used by language arts teachers as they plan the language arts curriculum, group pupils, individualize instruction, and identify pupils needing special help. Two interventions, training and process consultation, were used to identify the most effective method of training preservice elementary…

The International English Language Testing System is described, including the test's underlying principles, design, administration, scoring, reliability, and interpretation. Some criticisms of the program are briefly discussed. (MSE)

A study investigated the effectiveness of the Rasch procedure in measuring response appropriateness, especially for the detection of cheating on multiple-choice language tests. The report gives background information on appropriateness measurement and its potential uses, reviews recent research on cheating and its detection, and describes three…

The thought of Samuel Messick has influenced language testing in 2 main ways: in proposing a new understanding of how inferences made based on tests must be challenged, and in drawing attention to the consequences of test use. The former has had a powerful impact on language-testing research, most notably in Bachman's work on validity and the…

The development of the Polish Proficiency Test, a standardized, nationally-normed test of listening and reading comprehension for English-speaking learners of Polish, is reported. An introductory chapter provides background information about the test's development, including discussion of the relationship between the test and Polish language…