This handbook describes the responsibilities of district and school assessment coordinators in the administration of the Pennsylvania System of School Assessment (PSSA). This updated guidebook contains the following sections: (1) General Assessment Guidelines for All Assessments; (2) Writing Specific Guidelines; (3) Reading and Mathematics…

This paper reports on an analysis of large-scale assessments of Grades 5-8 students' writing across 10 provinces and 2 territories in Canada. Theory, classroom practice, and the contributions and constraints of large-scale writing assessment are brought together with a focus on Grades 5-8 writing in order to provide both a broad view of…

National Assessment of Educational Progress writing sample essays from 1988 and 1990 (495 and 599 essays) were subjected to computerized grading and human ratings. Cross-validation suggests that computer scoring is superior to a two-judge panel, a finding encouraging for large programs of essay evaluation. (SLD)

A pilot study was undertaken to develop appropriate writing samples for assessment of composing tasks, to examine the utility and time requirements of scoring keys, particularly regarding their consistency and objectivity, and to study the efficacy of scoring guides. Five classes from second to sixth grade in a school in the Los Angeles Unified…

Examines reasons for using essay tests in the direct assessment of writing ability. Reviews the steps in developing a large-scale testing program; e.g., creating a pool of topics or prompts; developing scoring procedures; training raters; field-testing the system; scoring writing samples; assessing reliability; and assessing validity. (DMM)

This study was designed to address two frequent criticisms of the SAT essay--that essay length is the best predictor of scores, and that there is an advantage in using more "sophisticated" examples as opposed to personal experience. The study was based on 2,820 essays from the first three administrations of the new SAT. Each essay was…

The Registered Holistic Scoring Method, which has been used for one year to score the ninth grade writing test of the New Jersey High School Proficiency Test, is described. Registered Holistic Scoring was developed from the previous holistic approach in order to provide more reliable scoring guidelines year after year. Two trained evaluators…

This report describes the procedures followed in scoring the October 1978 Florida Minimal Writing Production Skills Assessment and reports the results of that assessment. The assessment was conducted on a sample of Florida public school students in grades 3, 5, 8, and 11. Sections include descriptions of the rating scale and scorer's guide as well…

A major issue facing the National Assessment of Educational Progress (NAEP) Writing Assessment is its relationship with the most frequently encountered measurement practices among State Education Agencies (SEAs) and Local Education Agencies (LEAs). Should NAEP conduct its assessments in a fashion that represents how things should be, or reflect…

The necessity of controlling the order in which trained essay raters for a statewide writing assessment program receive student essays was studied. The underlying theoretical question concerns possible rater bias caused by raters reading long strings of essays of homogeneous quality; this problem is usually referred to as context effect or…

The Connecticut Mastery Test was designed to assess specific skill levels of students by measuring performance on various learning objectives that students can be expected to master. The grade 4 Connecticut Mastery Test, given for the first time in the fall of 1985, provides information which can be used to improve instruction and the basic skills…

These comments provide further details which expand upon the recommendations of the subcommittee on National Assessment of Educational Progress (NAEP) Writing. Three issues are discussed. The first concerns how objectives of assessment in writing ought to be stated. The 1984 objectives are stated in general terms without reference to what might…

This document presents information to trainers already trained in the Registered Holistic scoring method. It has been developed to assist these trainers in training others in the procedures and the criteria of the new scoring method. The Registered Holistic scoring method was designed and field tested for the ninth grade writing sample component…

The methods used by the General Educational Development Testing Service (GEDTS) to establish and maintain score stability and reading reliability on its direct assessment of writing are described. Using the 1988 site certification and monitoring results of several scoring sites, the focus is on describing how the score scale was established and…

Statistical equating of scores from direct writing assessments is performed in Maryland to hold the difficulty of passing the Maryland Writing Test (MWT) equivalent from year to year and to allow a demonstration of growth in student writing achievement over the years. Passage of the test is a high school graduation requirement. Prior to…