The effect of different types of rating task instructions on rater behavior was examined using experts, as opposed to novices, as raters. The experts were instructed to (1) form a global categorical judgment (early hypothesis generation); (2) assess 19 detailed elements; or (3) both. Subjects were 8 dental faculty members who ranged in age from 28…

A phenomenological approach was used in a study of three assessment strategies for the evaluation of journals written by speech communication students: (1) analytic assessment strategy; (2) primary trait assessment strategy; and (3) holistic assessment strategy. Completed question-and-answer packets, consisting of 8 to 12 diaries each, written by…

In response to growing concern about the lack of basic writing skills, this paper presents an overview of the issues involved in selecting a method for the assessment of students' writing skills. After general criteria for determining the appropriateness of a writing evaluation procedure are outlined, the merits and limitations of objective tests…

Holistic evaluation is a reliable, valid, and cost-effective alternative to the usual mechanical assessment of writing. Writing samples are scored on a five-point scale against an overall impression of development, organization, and coherentness. The method was applied to the Communication Activities Skills Project (CASP) for grades 3-12. Writing…

Noting that improvement in rater reliability means eliminating differences among raters, this paper discusses ways to assess writing evaluator reliability and methods for achieving higher levels of interrater reliability. After showing that reliability can be improved two ways--by increasing the number of raters or measurements made, and by…

Two methods of evaluating student writing were compared. Holistic evaluation attempts to assess the overall quality of a composition. It is a guided procedure for sorting or ranking written composition. A rater scores the composition by placing it within the range of papers produced in response to a given assignment. Scoring may also be done using…

The Primary Trait System (PTS) of scoring was devised by the National Assessment of Educational Progress to score large numbers of natural writing samples. Essentially, PTS permits evaluation of writing in an objective way, but one that does not rely on scoring surface features such as mechanics, grammar, or spelling. While the assessment value of…

To compare the different images of writing that different assessment methods produce, a study examined two formal writing assessments--holistic and the specially developed intra-subject paired comparison method (IPC)--of pre/post university freshman composition-course writing. The samples of writing were unrehearsed, 50 minute, in-class essays.…

An ethnographic study investigated conversations during planning meetings and placement rating sessions for selecting and rating freshman composition placement exams. Planning meetings involved the administrative coordinator and two assistants selecting model essays, discussing the rubric, and confirming the final plans for the rating session.…

A study was conducted by the Student Development Center of the University of Hawaii at Hilo to develop a writing placement procedure in a community college setting which would be practical, reliable, and valid. The key to this procedure was an English composition placement device that could help readers rate, holistically, writing samples written…

Describes efforts in the Canadian provinces of Manitoba, British Columbia, New Brunswick, and Ontario to require actual samples of student writing on English performance tests. Includes a bibliography, a holistic marking scale, and an outline of criteria typical in analytic scoring. (EL)

Writing samples as diagnostic measurement tools have many variables that the instructor must control--time is a factor, and often the instructor needs more than one sample to fairly evaluate student writing ability. One method for better predicting the exact nature of students' writing problems is sentence combining. For sentence combining to be…

This paper focuses on the need for increased sensitivity and responsiveness in international education and training project evaluations, particularly those in Third World countries. A conceptual-theoretical framework for designing and developing models appropriate for evaluating education and training projects in non-Western cultures is presented.…

In addition to determining students' writing proficiency, holistic writing scores obtained through a standardized evaluation provide useful data in making value judgments concerning various aspects of high school writing programs. In a cross-sectional study using holistic scoring, average scores of groups of students can be compared, and the…

Facing the problem of a wide discrepancy in grading standards for student essays, the English department at a Texas community college developed a standardized method of grading students' expository and persuasive essays. The department established a committee of 10 full-time instructors whose objective was to standardize grading for all required…