This study employed a mixed-methods approach to examine how rater performance develops during a semester-long rater certification program for an English as a Second Language (ESL) writing placement test at a large US university. From 2016 to 2018, we tracked three groups of novice raters (n = 30) across four rounds in the certification program.…

Background: Experiential educators face difficulties assessing participants and programs because there are so many measurement tools to choose from, many measures have validity issues such as those based on self-reported data, objective tests may not adequately measure social or psychological outcomes, and tests in content disciplines often assess…

The purpose of the current study is to explore the potential impact of a goal-based writing program on EFL students' writing competence and their attitudes toward goal-setting activities. The goal-based writing program was developed within goal-setting theory and launched in a writing class of 39 EFL Vietnamese university students over ten weeks.…

Large-scale writing programs can add value to the traditional timed writing assessment by using aspects of the essays to assess the effectiveness of institutional goals, programs, and curriculums. The "six learning goals" prompt in this study represents an attempt to provide an accurate writing assessment that moves beyond scores. This…

The current study examines data from students in grades 4-8 who participated in a statewide computer-based benchmark writing assessment that featured automated essay scoring and automated feedback. We examined whether the use of automated feedback was associated with gains in writing quality across revisions to an essay, and with transfer effects…

This study examined the influence of rater training and scoring context on training time, scoring time, qualifying rate, quality of ratings, and rater perceptions. One hundred twenty raters participated in the study and experienced one of three training contexts: (a) online training in a distributed scoring context, (b) online training in a…

Despite recent policy initiatives to ensure high school accountability through state-mandated testing, New Jersey high school graduates may not be prepared for the challenges of college-level writing because the state's high school assessment is not aligned with college-level expectations (Brown & Conley, 2007; Conley, 2003). An ever-growing…

This study details the development and results of a campus-based writing assessment plan that was mandated by a state-wide university system in order to explore the ''value-added'' from a writing program curriculum to undergraduate students' competence with written expression. Four writing samples (two timed essays and two conventional essays)…

"Voice" is widely considered to be a feature of effective writing. It's no surprise, then, that voice criteria frequently appear on rubrics used to score student essays in large-scale writing assessments. However, composition theorists hold vastly different views regarding voice and how it should be applied in the evaluation of student writing, if…

The present study employed multi-faceted Rasch measurement (MFRM) to explore the rater bias patterns of native English-speaker (NES) raters when they rate EFL essays. Forty NES raters rated 40 essays written by female Japanese university students on a single topic adapted from the TOEFL Test of Written English (TWE). The essays were assessed using…

Historically, the Composition Program at Eastern Washington University (EWU), a comprehensive university in Cheney, WA, required a single essay sample from each composition student as the final exit exam; in practice, a student passed or failed the course based on an in-class argumentative essay, written in three consecutive class periods. Such a…

This study examines a process-oriented ESL writing assessment called the Computerized Enhanced ESL Placement Test (CEEPT). The CEEPT at the University of Illinois at Urbana-Champaign or its non-computerized alternative (EEPT) have since 2000 offered a daylong process-oriented writing assessment in which test takers are given extended time to plan,…

The Florida Writing Enhancement Program, for all tenth through twelfth grade students, as implemented in the Hillsborough County Public Schools, was evaluated. The program was designed to improve students' writing in the areas of composition, sentence formation, usage, and mechanics. This evaluation was conducted to determine whether the program…

In 1989, a study was conducted within the Minnesota Community College System to determine the effects of a 3-year Writing Across the Curriculum (WAC) staff development program on the quality of student writing and on student mastery of course objectives. The study methods included faculty interviews, student and faculty surveys, holistic ratings…

A report on implementation of the Multicultural Reading and Thinking (McRAT) Program in Arkansas from 1989-92 chronicles the program's development, operation, and results. McRAT is a staff development program designed to help teachers infuse higher order thinking processes and multicultural concepts into regular classroom curricula (grades 3 to…