Automated essay scoring (AES) generally computes essay scores as a function of macrofeatures derived from a set of microfeatures extracted from the text using natural language processing (NLP). In the "e-rater"® automated scoring engine, developed at "Educational Testing Service" (ETS) for the automated scoring of essays, each…

The current paper on writing assessment surveys the literature on the reliability and validity of essay tests. The paper aims to examine the two concepts in relationship with essay testing as well as to provide a snapshot of the current understandings of the reliability and validity of essay tests as drawn in recent research studies. Bearing in…

Testing the hypotheses that reflective timed-essay prompts should elicit memories of meaningful experiences in students' undergraduate education, and that computer-mediated classroom experiences should be salient among those memories, a combination of quantitative and qualitative research methods paints a richer, more complex picture than either…

Reports on a study in the development of content-fair essay topics that provide the majority of examinees with the chance to write on a subject about which they know a great deal, and that reduce opportunities for linguistic misinterpretation. (HTH)

Concludes that the rhetorical specification approach to developing essay examination topics (giving writers information about the purpose of a composition, its audience, speaker, and subject) may not be the best way to elicit good writing. (JL)

A summary of the writing assessment programs reviewed in this journal is presented. The problems inherent in the programs are outlined. A coordinated research program on major problems in writing assessment is proposed as being beneficial and cost-effective. (DWH)

In the area of large scale assessment, there is increasing interest in the measurement of students' written performance. At issue is whether the task demands in writing assessment can be simplified to involve the production of paragraph-length writing samples and/or multiple choice testing, rather than full-length essays. This study considers data…

Examines the CUNY-WAT program and questions many aspects of it, especially the choice and phrasing of topics. (FL)

In preparation for adding an essay test to the General Educational Development (GED) test, the GED Testing Service undertook a series of studies to establish (1) whether acceptable reading reliabilities were attainable in decentralized holistic scoring sessions often involving no more than a dozen papers; (2) whether essay readers in a variety of…

Examines reasons for using essay tests in the direct assessment of writing ability. Reviews the steps in developing a large-scale testing program; e.g., creating a pool of topics or prompts; developing scoring procedures; training raters; field-testing the system; scoring writing samples; assessing reliability; and assessing validity. (DMM)

After an extensive review of the available research on large-scale writing assessment, certain issues in writing assessment seem to be unresolved, and still other issues are not supported by adequate research. This paper reviews the basic issues in writing assessment, points out which topics are supported by strong research, and which topics are…

The primary purpose of this study was to examine the relationship between scores on the multiple-choice General Educational Development (GED) Writing Skills test and scores on holistically graded essays. Secondary purposes included the following: (1) examining the relationship of essay scores to scores on the multiple-choice GED Reading Skills…

Outlines research necessary for determining the validity and reliability of Test of Written English, an essay test that directly measures writing ability and complements Test of English-as-a-Foreign-Language's (TOEFL) indirect assessment of writing skills. Research should cover such aspects as construct, criterion-related, concurrent, content, and…

To assess the written and verbal communication skills of the approximately 100 deaf and hard-of-hearing students attending the College of Business at the Rochester Institute of Technology (RIT) is a real challenge. The only way for most of these students to satisfy the College of Business' general writing competency requirement was to take the…

The test scores of college freshmen given both a multiple choice test and an essay test of writing skills were compared to assess the validity of a multiple choice test compared with an essay test. (HOD)