The effect of different types of rating task instructions on rater behavior was examined using experts, as opposed to novices, as raters. The experts were instructed to (1) form a global categorical judgment (early hypothesis generation); (2) assess 19 detailed elements; or (3) both. Subjects were 8 dental faculty members who ranged in age from 28…

In response to growing concern about the lack of basic writing skills, this paper presents an overview of the issues involved in selecting a method for the assessment of students' writing skills. After general criteria for determining the appropriateness of a writing evaluation procedure are outlined, the merits and limitations of objective tests…

Intended for administrators and policymakers as well as teachers, this digest explores approaches to, problems with, and trends in large scale writing assessment. The digest first compares direct and indirect assessment approaches, then examines three approaches to scoring: holistic, primary trait, and analytic. It then discusses issues and…

A comparison of the holistic, error-count, and categorical methods of assessing written work presents disadvantages and advantages in terms of validity, reliability, and efficiency. The results of a pilot study indicate that the error-count method may provide the most benefits. (CB)

The reliability of the Writing Skills Assessment Test (WSAT) given to all entering freshmen at the City University of New York (CUNY) is the subject of this monograph. The monograph states that although the WSAT is scored according to validated and widely-used holistic procedures, some CUNY faculty had expressed concern about aspects of the WSAT's…

Examined the reliability and validity of the Work Sampling System (WSS) for evaluating the schoolwork of 100 kindergarten children. Results indicated that the WSS checklist and summary report had very high internal and moderately high interrater reliability. The WSS accurately predicted the performance of the children on a norm-referenced…

Twenty-four high schools in 18 Georgia school systems were selected to participate in a project to check the potential validity, reliability, usefulness, and costs of several direct and indirect measures of writing: holistic, analytic, primary trait, writing mechanics (error counts), and indirect measures (objective multiple choice items). Another…

The effectiveness of the "read-comp" technique in assessing writing ability and the usefulness of a rubric and procedure devised for scoring read-comp samples and essays were evaluated. Subjects were 100 freshman students enrolled in general and remedial English classes in a 6-week summer session at Indiana University of Pennsylvania.…

Four systems for scoring student essays were used to classify eleventh grade and undergraduate students according to writing ability. The reliabilities of the raters and the validities of the systems in classifying students were emphasized. Two analytic scoring systems--which assume that quality writing is characterized by the inclusion of certain…

A study examined how pragmatic form influences evaluation of student essays in university placement testing. Specifically, the study documented how patterns in students' use of information (assumed to be either old, inferable, or new for readers) affected the holistic scores for quality given to the essays. Subjects, 99 randomly selected entering…

A case study examined the effects of primary trait scoring on evaluating seventh grade students' compositions. Primary trait scoring as used in the Metropolitan School District of Washington Township in Indianapolis is innovative in that (1) the scoring guide is assignment specific, written after adult raters read and discussed many papers; (2)…

Four writing samples were obtained from 638 foreign college applicants who represented three major foreign language groups (Arabic, Chinese, and Spanish), and from 60 native English speakers. All four were scored holistically, two were also scored for sentence-level and discourse-level skills, and some were scored by the Writer's Workbench…

Language arts teachers participated in an inservice program, The Writer's Clinic, and evaluated their students' improvement in writing ability using holistic essay scoring techniques. Seventh and eighth grade students were administered an essay composition pretest in December; the same essay topic was given as the post test in May. Students were…