Despite the increasing interest in using AI tools as assistant agents in instructional settings, the effectiveness of ChatGPT, the generative pretrained AI, for evaluating the accuracy of second language (L2) writing has been largely unexplored in formative assessment. Therefore, the current study aims to examine how ChatGPT, as an evaluator,…

A generic approach in automated essay scoring produces scores that have the same meaning across all prompts, existing or new, of a writing assessment. This is accomplished by using a single set of linguistic indicators (or features), a consistent way of combining and weighting these features into essay scores, and a focus on features that are not…

Students in grades 5 and 8 completed a state writing assessment, and their first and final drafts on the extended writing portion of the test were copied and scored using the state writing rubric. The rubric consisted of three primary traits: Content and Organization, Style and Fluency, and Language Use. Scorers were blind to the study purpose and…

This article examines the influence of keyboarding versus handwriting in a high-stakes writing assessment. Conclusions are based on data collected from a pilot project to move Old Dominion University's Exit Exam of Writing Proficiency from a handwritten format into a dual-option format (i.e., the students may choose to handwrite or keyboard the…

The current research was conducted to investigate the validity of automated essay scoring (AES) by comparing group mean scores assigned by an AES tool, IntelliMetric [TM] and human raters. Data collection included administering the Texas version of the WriterPlacer "Plus" test and obtaining scores assigned by IntelliMetric [TM] and by…

This literature review summarizes what is currently known about the agreement among six measures of writing skills. Three of these methods involve the application of human judgment in scoring or rating a piece of writing: holistic, analytical, and primary trait scoring. Two methods involve anatomical or taxonomic analysis of a piece of writing:…

Six university English departments collaborated in this examination of the differences between multiple-choice and essay tests in evaluating writing skills. The study also investigated ways the two tools can complement one another, ways to improve cost effectiveness of essay testing, and ways to integrate assessment and the educational process.…

A follow-up study of two instruments for evaluating college writing was conducted. The experimental scale (E Scale) was developed in 1976 and revised for this study. The control scale (C Scale) was described in the literature in 1977. Ten English majors graded ten essays from diagnostic entrance exams. Both the E Scale and the C Scale were used,…

Over 2,000 writing samples were collected from four undergraduate institutions and compared, where possible, with scores on a multiple-choice test. High correlations between ratings of the writing samples and multiple-choice test scores were obtained. Samples contributed substantially to the prediction of both college grades and writing…

The purpose of this booklet is to provide social studies teachers with student writing samples that exemplify the criteria used to score students' responses on the June 1987 Alberta (Canada) Social Studies 30 Diploma Examination. Students choose one of two possible essay questions that required writing a defense of individual initiative in…

The differential performance of black and white college freshmen on a direct measure of writing skills, the essay portion of the American College Testing Program's Collegiate Assessment of Academic Proficiency (CAAP), was studied. The data consisted of responses of a sample of 998 black and 3,727 white examinees to two individual prompts for…

A writing assessment study was conducted in the Fort Worth Independent School District (Texas) in the spring of 1986 as part of a larger program evaluation study of the Writing to Read (WTR) Program. WTR is a computer-based instructional system designed to develop the writing and reading skills of kindergarten and first-grade students. Two types…

This report summarizes results of student achievement in the Austin (Texas) Independent School District (AISD) on the Texas Educational Assessment of Minimum Skills (TEAMS) tests in 1986-87. Major findings indicate the following: (1) 99.4% of AISD seniors to graduate in May 1987 passed the Exit-Level TEAMS tests, with only 17 denied diplomas in…

This study investigated the comparability of scores for paper and computer versions of a writing test administered to eighth grade students. Two essay prompts were given on paper to a nationally representative sample as part of the 2002 main NAEP writing assessment. The same two essay prompts were subsequently administered on computer to a second…