Examines reasons for using essay tests in the direct assessment of writing ability. Reviews the steps in developing a large-scale testing program; e.g., creating a pool of topics or prompts; developing scoring procedures; training raters; field-testing the system; scoring writing samples; assessing reliability; and assessing validity. (DMM)

Outlines research necessary for determining the validity and reliability of Test of Written English, an essay test that directly measures writing ability and complements Test of English-as-a-Foreign-Language's (TOEFL) indirect assessment of writing skills. Research should cover such aspects as construct, criterion-related, concurrent, content, and…

The Registered Holistic Scoring Method, which has been used for one year to score the ninth grade writing test of the New Jersey High School Proficiency Test, is described. Registered Holistic Scoring was developed from the previous holistic approach in order to provide more reliable scoring guidelines year after year. Two trained evaluators…

Every year approximately 1,300 first-year students at the Rochester Institute of Technology complete a 50-minute placement essay during summer and fall orientations. The essays are scored holistically, and the students are placed into one of three levels of an English composition course. At the end of the 10-week quarter of instruction, students…

Specialists in the field of large-scale, high-stakes writing assessment have, over the last forty years alternately discussed the issue of maximizing either reliability or validity in test design. Factors complicating the debate--such as Messick's (1989) expanded definition of validity, and the ethical implications of testing--are explored. An…

The Computerized Inventory of Developmental Writing Traits (CIDWT) is meant to provide a valid reliable measure of program improvement, particularly for teachers implementing a process writing approach in their classrooms. While standardized tests, portfolio, and holistic scoring all have something to offer, the CIDWT is an inexpensive direct…

Writing teachers and educators can add to information from large-scale testing and teachers can strengthen classroom assessment by creating a tight fit between large-scale testing and classroom assessment. Across the years, large-scale testing programs have struggled with a difficult problem: how to evaluate student writing reliably and…

The third administration of the California State University and Colleges Freshman English Equivalency Examination, a test consisting of an objective examination graded by the Educational Testing Service and an essay examination scored by California State University and College faculty, is analyzed in this report. After a short preface, the first…

The fourth administration of the California State University and Colleges Freshman English Equivalency Examination, a test consisting of an objective examination graded by the Educational Testing Service and an essay examination scored by California State University and College faculty, is analyzed in this report. After a short index of previous…

The fifth administration of the California State University and Colleges Freshman English Equivalency Examination, a test consisting of an objective examination graded by the Educational Testing Service and an essay examination scored by California State University and College faculty, is analyzed in this report. After a short index of previous…

The sixth administration of the California State University and Colleges Freshman English Equivalency Examination, a test consisting of an objective examination scored by California State University and College faculty, is analyzed in this report. After a preface and short index of previous volumes, the first section of the report contains a…

The seventh administration of the California State University and Colleges Freshman English Equivalency Examination, a test consisting of an objective examination graded by the Educational Testing Service and an essay examination scored by California State University and College faculty, is analyzed in this report. After a preface and short index…

The eighth and ninth administrations of the California State University and Colleges Freshman English Equivalency Examination, a test consisting of an objective examination graded by the Educational Testing Service and an essay examination scored by California State University and College faculty, are analyzed in this report. After a preface and…

From 1970 to 1985, the Scholastic Aptitude Test (SAT) underwent major modifications caused by: (1) the addition of the Test of Standard Written English (TSWE) to the College Board's Admissions Testing Program (ATP); (2) the passage of test disclosure legislation; (3) the institution of test sensitivity reviews; and (4) the use of item response…

The results of an evaluation of Vermont's statewide assessment initiative are presented, with information about the implementation of the program, its effects on educational practice, the analytic challenge presented by the portfolio scoring process, the reliability and validity of portfolio scores, and the tensions between assessment and…