In this research, we investigated the suitability of implementing "e-rater"® automated essay scoring in a high-stakes large-scale English language testing program. We examined the effectiveness of generic scoring and 2 variants of prompt-based scoring approaches. Effectiveness was evaluated on a number of dimensions, including agreement…

This handbook describes the responsibilities of district and school assessment coordinators in the administration of the Pennsylvania System of School Assessment (PSSA). This updated guidebook contains the following sections: (1) General Assessment Guidelines for All Assessments; (2) Writing Specific Guidelines; (3) Reading and Mathematics…

This paper reports on an analysis of large-scale assessments of Grades 5-8 students' writing across 10 provinces and 2 territories in Canada. Theory, classroom practice, and the contributions and constraints of large-scale writing assessment are brought together with a focus on Grades 5-8 writing in order to provide both a broad view of…

Examined a scoring anomaly that became apparent in a state-mandated writing assessment. Results for 3,660 essays by sixth graders show that using a spiral model for training raters and scoring papers results in higher mean ratings than does using a sequential model for training and scoring. Findings demonstrate the importance of making decisions…

To help teachers, administrators, and parents understand student performance in writing, a state-level report is prepared each year to analyze students writing scores and provide guidelines for the interpretation of the results. This report compares students scores on the 2001 Delaware Student Testing Program (DSTP) with scores on the 2000 DSTP…

The purpose of this study was to examine rater, domain, and gender influences on the assessed quality of student writing using weighted and unweighted scores. Twenty rates were randomly selected from a group of 87 operational raters contracted to rate essays as part of the 1993 field test of the Georgia High School Writing Test. All of the raters…

The North Carolina Writing Assessment, which is part of the state's End-of-Grade testing program, requires students in grades 4 and 7 to write essays in response to a standardized prompt. This report contains results for the Wake County Public School System (WCPSS). Fourth grade writing assessment scores across North Carolina rose in 1999, and in…

This study was designed to address two frequent criticisms of the SAT essay--that essay length is the best predictor of scores, and that there is an advantage in using more "sophisticated" examples as opposed to personal experience. The study was based on 2,820 essays from the first three administrations of the new SAT. Each essay was…

The effect of rapid feedback for a state writing assessment on subsequent writing performance was investigated. In addition, the agreement between teachers' scores for the state writing assessment and state department scores was analyzed. Eighth grade English teachers (n=8) were trained in analytic trait scoring of writing assessments. They then…

This study invesitigated possible reasons for the low performance on the text-based writing assessment of the Delaware Student Testing Program (DSTP) in 2000, especially for grades 3 and 5, and considered ways to improve classroom instruction. In the first part of the study, a panel of teachers reviewed the anchor papers from the assessment and…

Beginning in 1999, all of the Pennsylvania System of School Assessment (PSSA) had to be aligned with the Pennsylvania Academic Standards. This handbook describes the PSSA writing assessment, which was designed to measure individual student performance and to influence instruction. The guide contains a chart of the Pennsylvania Academic Standards…

Writing assessment began in Alaska in the 1970s, and the Alaska Writing Assessment (AWA) that was piloted in 1997 built on previous efforts. The 1997 AWA involved more than 20,000 students in grades 5, 7, and 10 from 43 school districts, and the mandatory assessment planned for 1998 will include approximately 28,000 students. This review of the…

This manual contains information regarding the administration of the Oregon Statewide Assessment Program's tests in writing and mathematics problem-solving. Parts of the manual address (1) background and preparation for testing; (2) administering the writing assessment; (3) administering the mathematics problem-solving assessment; (4) local rater…

This study examines the impact of the Pennsylvania writing assessment policy on writing instruction and teaching methodology. Drawing on self-reported teacher perceptions and classroom practices, the study also attempts to identify the factors that influence teacher beliefs and their use of materials and processes related to the state writing…

The Florida Writing Assessment was implemented in grades 4, 8, and 10 in 1998 as required by the Florida legislature. The assessment is designed to measure students' proficiency in writing responses to assigned topics within a designated testing period. This report contains writing assessment results for the whole state, school districts, and…