In this research, we investigated the suitability of implementing "e-rater"® automated essay scoring in a high-stakes large-scale English language testing program. We examined the effectiveness of generic scoring and 2 variants of prompt-based scoring approaches. Effectiveness was evaluated on a number of dimensions, including agreement…

This study was designed to address two frequent criticisms of the SAT essay--that essay length is the best predictor of scores, and that there is an advantage in using more "sophisticated" examples as opposed to personal experience. The study was based on 2,820 essays from the first three administrations of the new SAT. Each essay was…

This article examines data from nine statewide administrations of the Idaho Comprehensive Literacy Assessment (ICLA) over three-years. The ICLA measures pre-service teachers' knowledge of research-based content and pedagogy related to reading instruction and assessment. The purpose of this article was first to examine pre-service candidates'…

This handbook is intended to help high school and college counselors effectively use and interpret ACT results. It contains four main sections: Section 1, "Components of the ACT," which contains general information about the ACT tests, probably will be of interest both to high school counselors and to college advisors and other staff. …

The primary purpose of this study was to investigate the efficacy of formulaic writing such as the five-paragraph theme (FPT) or essay for the purpose of earning high scores on high-stakes writing assessments. This qualitative descriptive study analyzed more than 1000 essays from Delaware Grade 8 and 10 writers, written for a statewide…

Details some of the advantages provided by a testing service that evaluates student writing. (NKA)

National Assessment of Educational Progress writing sample essays from 1988 and 1990 (495 and 599 essays) were subjected to computerized grading and human ratings. Cross-validation suggests that computer scoring is superior to a two-judge panel, a finding encouraging for large programs of essay evaluation. (SLD)

A representative group of 4,000 California high school seniors was randomly assigned one of five essay topics. Each essay was given two independent ratings based on criteria specified for each topic by an advisory group of English teachers. On the basis of the scores, a representative subset of 750 essays was randomly selected from the top…

A college faculty member who has graded Advanced Placement exam essays on U.S. government and politics, taken mostly by high school juniors and seniors, suggests that high school teachers and college faculty who assess the essays are not the best qualified persons to do so and that despite efforts to ensure consistency, the resulting scores are…

A faculty consultant to the Educational Testing Service for advanced placement (AP) test reading in U.S. government and politics responds to an article criticizing essay evaluation methods and criteria, finding in it a fundamental misunderstanding of the AP reading process and explaining why the essays are subject to less scrutiny for style,…

In a series of essays, the author analyzes and comments on the perceived weaknesses of the National Assessment of Educational Progress (NAEP) testing program. The basis of his criticism is that the NAEP has attempted to establish national norms, thereby disregarding the pluralistic nature of American society and the historical basis for community…

Papers from the conference on language testing include: "Foundations and Directions for a New Decade of Language Testing" (Carol Chapelle, Dan Douglas); "A Comparison of the Abilities Measured by the Cambridge and Educational Testing Service EFL Test Batteries" (Lyle F. Bachman, Fred Davidson, John Foulkes); "Judgments in…