Journalism's societal role hinges on effective communication, demanding proficient language skills. This study assesses a South African University of Technology's Department of Journalism, probing existing selection methods' efficacy in predicting success in two English modules. Concerns persist about these methods accurately identifying students…

The effect of different types of rating task instructions on rater behavior was examined using experts, as opposed to novices, as raters. The experts were instructed to (1) form a global categorical judgment (early hypothesis generation); (2) assess 19 detailed elements; or (3) both. Subjects were 8 dental faculty members who ranged in age from 28…

In response to growing concern about the lack of basic writing skills, this paper presents an overview of the issues involved in selecting a method for the assessment of students' writing skills. After general criteria for determining the appropriateness of a writing evaluation procedure are outlined, the merits and limitations of objective tests…

This study examined the reliability of holistic scoring for a sample of essays written during the Spring 1985 MCAT administration. Analysis of variance techniques was used to estimate the reliability of scoring and to partition score variance into that due to level differences between papers and to context-specific factors. (Author/LMO)

Discusses the relationship between subjective evaluation and objective measures of ESL writing proficiency. Objective measures used in this study accounted for 84 percent of the variance of subjective grades assigned to a sample of compositions. Author suggests that training readers can be important to the reliability and the validity of the…

Makes certain observations relating to the use of general-impression marking as a partial determinant of admission to tertiary educational institutions in Western Australia. (HOD)

To help school districts comply with basic skills legislation, the California State Department of Education developed sample writing exercises and scoring guides. The exercises were modeled after Kinneavy's three categories of discourse: expressive--writer oriented; explanatory--subject oriented; and persuasive--audience oriented. The minimum…

Ratings of student performance for two essay questions rendered by professors of English and by professors in other disciplines were compared for reliability and concurrent validity. It was concluded that the reliability and validity of the ratings of the two groups were nearly comparable. (Author/BW)

Intended for administrators and policymakers as well as teachers, this digest explores approaches to, problems with, and trends in large scale writing assessment. The digest first compares direct and indirect assessment approaches, then examines three approaches to scoring: holistic, primary trait, and analytic. It then discusses issues and…

A study was conducted to determine whether counting correct word sequences is a valid measure of written expression for use in a formative evaluation system for elementary students. A correct word sequence was defined as two adjacent, correctly spelled words that were acceptable within the context of the phrase to a native speaker of the English…

Holistic evaluation, defined as the grading of an entire piece of writing without tallying or correcting specific errors, is discussed as preferable to discrete point testing or objective measures in assessing writing proficiency of English as a second language (ESL) students. The assessment process, in which the papers are evaluated as excellent,…

To compare the relative reliable uses and cost effectiveness of the analytic, the holistic, and the primary trait scoring methods, an inquiry was conducted in which a group of raters scored a large number of secondary school students' essays according to each of the scoring methods. Raters were nine graduate students in English who were trained in…

Reports on a study that compared the potential validity, reliability, and costs of several direct and indirect measures of writing. (HOD)

This paper addresses the evaluation of the testing of writing of foreign languages and compares two evaluation methods: the analytical method and the holistic method. The analytical method focuses on the mechanics of writing where the writer is measured against a set of empirical standards and a composition is dissected for the critical points.…

Two factors which may affect the ratings assigned to an essay test are investigated: (1) context effects; and (2) score level effects. Context effects exist in essay scoring if an essay is rated higher when preceded by poor quality essays than when preceded by high quality essays. A score level effect is defined as a change in the score (value)…