The purpose of this study was to examine rater, domain, and gender influences on the assessed quality of student writing using weighted and unweighted scores. Twenty rates were randomly selected from a group of 87 operational raters contracted to rate essays as part of the 1993 field test of the Georgia High School Writing Test. All of the raters…

The purpose of this study was to describe the Rasch model for measurement and apply the model to examine the relationship between raters, domains of written compositions, and student writing ability. Twenty raters were randomly selected from a group of 87 operational raters contracted to rate essays as part of the 1993 field test of the Georgia…

The effects of presenting a choice of writing tasks on the quality of essays produced by eleventh graders were studied with 34,200 students in Georgia. The choice condition had no substantive effect on the quality of essays, but race, gender, and the writing task variable did. (SLD)

In 1972, the Board of Regents of the University System of Georgia instituted the Regents' Testing Program (RTP) to provide systemwide information on the status of student competence in reading and writing and to provide a uniform means of identifying those students who fail to attain minimum levels of competence in these areas. Since 1972, some…

The necessity of controlling the order in which trained essay raters for a statewide writing assessment program receive student essays was studied. The underlying theoretical question concerns possible rater bias caused by raters reading long strings of essays of homogeneous quality; this problem is usually referred to as context effect or…

This study compared the different modes of evaluation at work in Greece's secondary school graduation and university admission process. The goals of the study were (1) to provide background information regarding the contribution of in-school assessment scores and external examination scores to higher education admissions decisions, and (2) to…

The methods used by the General Educational Development Testing Service (GEDTS) to establish and maintain score stability and reading reliability on its direct assessment of writing are described. Using the 1988 site certification and monitoring results of several scoring sites, the focus is on describing how the score scale was established and…

The viability of the Partial Credit Model (PCM) of G. N. Masters (1982) for scaling and banking individual essay prompts from a statewide writing assessment program was investigated. Preliminary analyses indicated the feasibility of using the PCM, the general polychotomous form of the Rasch model, with essay data from the Maryland Writing Test…

Statistical equating of scores from direct writing assessments is performed in Maryland to hold the difficulty of passing the Maryland Writing Test (MWT) equivalent from year to year and to allow a demonstration of growth in student writing achievement over the years. Passage of the test is a high school graduation requirement. Prior to…

The language arts assessment developed for use in grade 8 of the Cherry Creek Schools in Englewood (Colorado) is described. In 1988-89, the assessment in use was modified substantially to reflect a holistic approach through an assessment based entirely on a written product. Students are provided with multiple sessions in which to draft,…

This research examined the results from direct and indirect writing assessments to determine the most effective method of discrimination. The New Jersey State Department of Education developed a test for ninth-grade students which was designed to measure the ability to apply writing mechanics to written text and to communicate effectively in…

The reliability, content validity, and construct validity were compared for two test formats in a public examination used to assess a secondary school geography course. The 11-item geography portion of the Intermediate Certificate Examination (essay examination) was administered in June 1987 to 400 secondary school students in Ireland who also…

In 1991 Pennsylvania began implementation of a direct writing assessment at the sixth-grade and ninth-grade levels. A total of 18,758 sixth graders and 16,575 ninth graders wrote a response to 1 of 9 prompts reflecting 3 modes of writing. A six-point holistic scale was used to score the papers, with two readers scoring each paper. A third reader,…