E-rater[R] is an automated essay scoring system that uses natural language processing techniques to extract features from essays and to model statistically human holistic ratings. Educational Testing Service has investigated the use of e-rater, in conjunction with human ratings, to score one of the two writing tasks on the TOEFL-iBT[R] writing…

Various factors contribute to variability in English as a second language (ESL) essay scores and rating processes. Most previous research, however, has focused on score variability in relation to task, rater, and essay characteristics. A few studies have examined variability in essay rating processes. The current study used think-aloud protocols…

This study analyzes the methods that teachers employ in written feedback to student writing and how the policies of the program and the teachers' embodied histories influence the strategies used. Data were gathered from 2 novice teachers as they taught their first graduate-level ESL writing course and consist of the teachers' feedback in addition…

In this article I present some findings of an action research study intended to find out to what extent a teacher-student partnership in writing assessment could promote high school students' autonomy. The study was conducted in a U.S. school. Two main action strategies in the assessment process were the use of symbols as the form of feedback…

Heritage speakers (HSs) of Russian in the United States form a very complex and diverse group of learners. Research in heritage linguistics has examined key parameters of the HSs' oral production. Important work has been done in heritage language (HL) pragmatics, morphology, and lexicon. However, very few studies have been conducted to…

In this study, 72 secondary English teachers from the Santa Ana Unified School District were randomly assigned to participate in the Pathway Project, a cognitive strategies approach to teaching interpretive reading and analytical writing, or to a control condition involving typical district training focusing on teaching content from the textbook.…

This study investigated the effectiveness of portfolio-based writing assessment in EFL situations. Participants were 40 pre-intermediate young Iranian English learners. They were randomly divided into experimental and control groups of 20 each. The experimental group wrote on five pre-established topics from their coursebook. Their writings were…

Whereas grading systems based on tacit knowledge may be the norm in practice, the recent trend toward educational accountability--from granting organizations, accreditation boards, journals on the teaching of psychology, and even tenure/promotion committees--suggests a real need for reliable, validated assessment measures that can be used to…

Academic writing and education in foreign and second languages both have lengthy histories. Their histories have diverged but also intersected. Matsuda (2005), for example, described the convergence in policies that led to a distinctive discipline of "L2 writing" in higher education in the U.S.A. during the latter part of the 20th century.…

In this study, we examine a large set of student responses to a constructed-response geometry item on the National Assessment of Educational Progress (NAEP) administered in 1992 and 1996. The item asks students to name the similarities and differences between a parallelogram and a rectangle of equal area presented side by side on a grid. Through…

Despite the growing body of research on writing assessment, little attention has been devoted to developing and validating measures for beginning writers. This study examined the technical adequacy of a Sentence Writing measure with 233 students in kindergarten and first grade. The reliability, validity, and sensitivity to growth were investigated…

This study examined the influence of rater training and scoring context on training time, scoring time, qualifying rate, quality of ratings, and rater perceptions. One hundred twenty raters participated in the study and experienced one of three training contexts: (a) online training in a distributed scoring context, (b) online training in a…

This study adopted a mixed-methods cross-sectional approach to identify similarities and differences in the English as a second language (ESL) essay holistic scores and evaluation criteria of raters with different levels of experience. Each of 31 experienced and 29 novice raters rated a sample of ESL essays holistically and analytically and…

Although effective writing skills are vital to the success of university-level students, second language (L2) writers face unique challenges in developing these skills. This is particularly relevant to their ability to produce writing that is linguistically accurate. While many writing teachers feel a great commitment to these students, much of…

Despite the increasing interest in and need for test information for use in instructional practice and student learning, there have been few attempts to systematically link a diagnostic approach to English for academic purposes (EAP) writing instruction and assessment. In response to this need for research, this study examined the extent to which…