This study investigated the effect of targeted test preparation, or coaching, on oral English as a second language test scores. The tests in question were the Basic English Skills Test Plus (BEST Plus), a scripted oral interview published by the Center for Applied Linguistics, and the Versant English Test (VET), a computer-administered and…

Raters are central to writing performance assessment, and rater development--training, experience, and expertise--involves a temporal dimension. However, few studies have examined new and experienced raters' rating performance longitudinally over multiple time points. This study uses operational data from the writing section of the MELAB (n =…

Information provided by examination of the skills that underlie holistic scores can be used not only as supporting evidence for the validity of inferences associated with performance tests but also as a way to improve the scoring rubrics, descriptors, and benchmarks associated with scoring scales. As fluency is considered a critical, perhaps…

The study reported here examined the evaluation criteria used to assess the proficiency and effectiveness of the language produced in an oral performance test of English conducted in an American university context. Empirical methods were used to analyze qualitatively and quantitatively transcriptions of the Oral English Tests (OET) of 44…

Second language (L2) oral performance assessment always involves raters' subjective judgments and is thus subject to rater variability. The variability due to rater characteristics has important consequential impacts on decision-making processes, particularly in high-stakes testing situations (Bachman, Lynch, & Mason, 1995; A. Brown, 1995;…

Language performance assessments typically require human raters, introducing possible error. In international examinations of English proficiency, rater language background is an especially salient factor that needs to be considered. The existence of rater language background-related bias in writing performance assessment is the object of this…

Performance assessments have become the norm for evaluating language learners' writing abilities in international examinations of English proficiency. Two aspects of these assessments are usually systematically varied: test takers respond to different prompts, and their responses are read by different raters. This raises the possibility of undue…

This paper argues that it is necessary for researchers and test developers in the area of language performance testing to have a clear understanding of the role of underlying performance capacities in second language performance. It critically evaluates the models proposed by Hymes, Canale and Swain, and Bachman. (71 references) (MDM)

The Language Facility Test was administered to 48 preschool children in Head Start classes in Ft. Worth, Texas, to determine (1) if the spontaneous production of English speech would be better after the bilingual children were first allowed to perform in Spanish, and (2) if the English language performance of the Mexican-American bilingual…

Suggests that language testing should be more performance-based and realigned with a current and richer understanding of the language teaching and learning processes. This kind of testing has questionable validity until a wide range of variables are successfully defined and delimited. (CB)

Presents a re-evaluation of the data given by Oller in the June 1971 issue of ELT. (RM)

An investigation of: (1) the relationship between the American College Test (ACT) English Usage Test scores and demonstrated writing proficiency, and (2) the relationships between and among other objective tests and writing proficiency was undertaken, using three samples of college freshmen. Although results indicated a moderately high…

Some validity criteria were applied to the language proficiency measures used by the British Council, particularly the "Davies Test." Five types of test validity are identified: construct validity; content validity; concurrent validity compared with another test; prediction validity; and face, or apparent, validity. Foreign students…

Examined the validity of aural and oral self-report scales for determining the Fiji Hindi proficiency of new adolescent immigrants in New Zealand. Participants completed self-reports and performance tests (oral interviews, listening-comprehension tests, and vocabulary tests). Performance tests correlated strongly with self-reports. Respondents…

The problem of determining relative weights for quantity and quality in scoring foreign language speaking and writing fluency tests is studied. French speaking and writing fluency tests were administered to students of French in several schools in England. Data from these tests was analyzed to support the suggestion that scoring formulas should…