In this paper, we provide an overview of psychometric procedures and guidelines Educational Testing Service (ETS) uses to evaluate automated essay scoring for operational use. We briefly describe the e-rater system, the procedures and criteria used to evaluate e-rater, implications for a range of potential uses of e-rater, and directions for…

Purpose: The purpose of this paper is to describe how and why Texas A&M University at Qatar (TAMUQ) has developed a system aiming to effectively place students in freshman and developmental English programs. The placement system includes: triangulating data from external test scores, with scores from a panel-marked hand-written essay (HWE),…

Language arts teachers participated in an inservice program, The Writer's Clinic, and evaluated their students' improvement in writing ability using holistic essay scoring techniques. Seventh and eighth grade students were administered an essay composition pretest in December; the same essay topic was given as the post test in May. Students were…

The authors provide an account of their experiences with the Study Essay Award of the Canadian Evaluation Society from the perspective of a former winner and the professor of program evaluation who mentored her evaluation of a substance abuse program for federal offenders on release in the community. (SLD)

Compares the efficacy of objective and holistic writing evaluation, in the context of the freshman writing program evaluation procedure at a west coast university. Indicates that holistic evaluation of writing samples is a far more accurate measure of writing quality and potential. (HTH)

Describes the process the teaching staff of one college went through in developing an exit examination and standards for their English 101 course, and states that students are writing better and that the instructors are better teachers of writing because of it. (CRH)

This evaluation of writing in the West Hartford CT Public Schools was part of a large evaluation of English/Language Arts. To provide information for program improvement and growth, the evaluation focused on six issues: (1) the extent of implementation of West Hartford's Composition Program; (2) how teachers use the Composition Program in their…

This handbook has been prepared to address one specific problem: How can the techniques of program evaluation be effectively applied to produce useful information about the operations and impact of moral education programs in secondary schools? The handbook is divided into five chapters. The introductory chapter describes the background and…

The Florida Writing Enhancement Program, for all tenth through twelfth grade students, as implemented in the Hillsborough County Public Schools, was evaluated. The program was designed to improve students' writing in the areas of composition, sentence formation, usage, and mechanics. This evaluation was conducted to determine whether the program…

This paper presents and evaluates different types of student assessment measures--including discussion-generating questions, multiple choice questions, essay questions, and authentic projects--for on-line courses. The paper asserts that assessment should mimic how students will be evaluated on the job site in the real world, meaning that they…