Discusses how to tackle the problem of determining a meaningful score for yes-no tests used to measure the size of receptive vocabulary. Signal Detection Theory is applied, and a new more accurate index is suggested. (Author/VWL)

Student assessment plays a central and important role in teaching and learning. Teachers devote a large part of their preparation time to creating instruments and observation procedures, marking, recording, and synthesizing results in informal and formal reports in their daily teaching. A number of studies of the assessment practices used by…

Links the theory of washback with the broader concept of impact in educational measurement and to the recent debate on construct validity associated with Messick. Notes that for many years it was asserted that language tests negatively impacted teaching and learning, an impact known as washback. (25 references) (Author/CK)

Examines the concept of washback as an instance of the consequential aspect of construct validity, linking positive washback to direct assessments and the need to minimize construct underrepresentation and construct-irrelevant difficulty in the test. The article explains washback as referring to the extent to which test use influences language…

Attempts to identify latent variables affecting the item responses of the diverse language groups taking the Test of English As a Foreign Language indicated that latent group effects were small. Results support equating with item response theory and suggest the use of a restrictive assumption of proportionality of item response curves. (Author/CB)

Describes the use of the partial credit form of the Rasch model in the analysis and calibration of a set of writing tasks in which assessment scales and criteria were adapted to suit each task's specific demands. Potential applications of the partial credit model in language testing are discussed. (Author/CB)

This article examines the effects of test format and task type on candidate output in direct and semidirect versions of the oral interaction subtest of the Australian Assessment of Communicative English Skills. Results are discussed in relation to the degree of interactiveness and other factors that appear to influence lexical density and to the…

Discusses issues identified by Douglas (2000) as problematic for language for specific purposes testing, making reference to a number of performance-based instruments designed to assess the language proficiency of teachers or intending teachers. Addresses the problems of specificity and authenticity. (Author)

Discusses criteria used in assessing language for specific purposes tests. Examines the issue of separability of language and content and reinforces points made by Jacoby and McNamara (1999) that second language assessments based entirely on linguistic criteria may fail to satisfy the purpose of the test user, whereas the use of indigenous…

Investigates the process by which raters of texts written by English-as-a-Second-Language learners make their scoring decisions using an analytic rating scale designed for multiple test forms. Demonstrates that the task raters face is to reconcile their impression of the text, the specific features of the text, and the wordings of the rating…

Investigates agreement among teacher-, self-, and peer-assessments of students in the presence of peer feedback. This is done in the context of oral presentation skills of first year undergraduate students of ethnic Chinese background. Findings how that when assessment criteria are firmly set, peer feedback enables students to judge the…

A nested cross-over design was used to examine the effects of visual condition, type of stimuli, and language proficiency on listening comprehension items of the Test of English as a Foreign Language. Three two-way interactions were significant: proficiency by type of stimuli, type of stimuli by visual condition, and type of stimuli by time.…

Research on two approaches to assessment of second-language performance--second-language acquisition and language testing--is examined and compared with regard to systematic effects on language tests. Findings incidental to a test development project are then presented. It is concluded that a full account of performance testing requires a paradigm…

In a study of teenage learners of French, the aspect of teachers' language that was found to be most responsive to the ability of their students was lexical diversity. Focuses on this finding using a new measure. (Author/VWL)

Illustrates some of the issues that have arisen in the implementation of outcomes-based systems of assessment and reporting. Two examples from school and adult immigrant education in Australia are provided that demonstrate some of the political and technical problems involved in implementation in both high- and low-stakes contexts. Outlines ways…