In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

This article chronicles the evolution of a large research extensive institution's General Education writing assessment efforts from an initial summative focus to a formative, improvement focus. The methods of assessment, which changed as the assessment purpose evolved, are described. As more data were collected, the measurement tool was…

This report documents the Hawaii Writing Assessment, which was undertaken to identify the writing strengths and weaknesses of Hawaii's public school children in kindergarten through grade twelve and to provide a basis for improvement in curriculum and instruction. The two sections of the report contain an overview of the assessment effort and…

The information contained in this report describes the 1982 Manitoba (Canada) Writing Assessment Program and the results of student performance on the grades 3, 6, 9, and 12 writing tests. Various sections of the report provide the following information: (1) steps in the assessment program and procedures for comparison with the 1979 assessment;…

The Highland (Indiana) public schools developed a writing program for elementary school students based on the premise that children learn to use language by actively generating language. The program features language production as the principal student activity in the English class and uses the students' own written work and oral expression as the…

Latent semantic analysis (LSA) is an automated, statistical technique for comparing the semantic similarity of words or documents. In this article, I examine the application of LSA to automated essay scoring. I compare LSA methods to earlier statistical methods for assessing essay quality, and critically review contemporary essay-scoring systems…

An Oregon school implemented a program of journal writing in grades 5 to 8 and evaluated its effects upon the language arts curriculum and students' writing ability. Each of the 11 teachers in the project decided the amount of time to allocate to journal writing and the routines to establish, although all followed certain guidelines on…

Noting that few curriculum projects designed to teach effective writing skills have been evaluated through carefully planned, longitudinal research studies representing cooperative efforts between university and public school personnel, this report describes such a project. The report outlines (1) the purpose of the program, which was based on the…

It is argued that assessment of student writing can be enhanced by adoption of a functional approach to linguistic analysis; through their research, functional grammarians have provided language teachers with criteria for evaluating the extent to which learners have gained control of the grammatical and discourse features of a variety of…

A study examined the effectiveness of a staff development program in the Yale (Michigan) public schools, intended to provide professional development to all elementary and secondary language arts teachers about the instruction of writing process and the evaluation of student work. Evaluation of the professional development model included teacher…