Evaluating written texts is believed to be a time-consuming process that can lack consistency and objectivity. Automated essay scoring (AES) can provide solutions to some of the limitations of human scoring. This research aimed to evaluate the performance of one AES system, Grammarly, in comparison to human raters. Both approaches' performances…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

Despite the increased use of integrated tasks in high-stakes academic writing assessment, research on rating criteria which reflect the unique construct of integrated summary writing skills is comparatively rare. Using a mixed-method approach of expert judgement, text analysis, and statistical analysis, this study examines writing features that…

The difference in how humans read and how Automated Essay Scoring (AES) systems process written language leads to a situation where a portion of student responses will be comprehensible to human markers, but unable to be parsed by AES systems. This paper examines a number of pieces of student writing that were marked by trained human markers, but…

Limited access to spoken and signed language is a worldwide phenomenon affecting deaf children. Language delay caused by impeded language acquisition has negative cascading effects on deaf children's learning and development. In the event of stymied language development, deaf students exhibit highly errored writing and commit errors unseen in the…

Automatic essay scoring (AES) refers to the process of scoring free text responses to given prompts, considering human grader scores as the gold standard. Writing such essays is an essential component of many language and aptitude exams. Hence, AES became an active and established area of research, and there are many proprietary systems used in…

Previous studies with English-speaking children showed that handwriting and spelling abilities played a critical role in the development of writing fluency and quality, particularly during the transition from the kindergarten to primary school; in contrast, studies dealing with orthographically transparent languages found small or no relations…

This study explored the extent to which the ethnic identity of a writer and the background (gender and area of teaching) of a rater can influence mainstream teacher candidates' evaluation of English as a second language (ESL) writing, using a matched-guise method. A one-page essay was elicited from an ESL learner enrolled in an intensive English…

This study was an expanded replication of an earlier endeavor (Shermis, Burstein, & Bliss, 2004) to document the writing outcomes associated with automated essay scoring. The focus of the current study was on determining whether exposure to multiple writing prompts facilitated writing production variables (Essay Score, Essay Length, and Number…

A study investigated the problem of systematic oversights by students taking language passage correction (PC) tests. In these tests, students are asked to correct errors inserted in written prose passages. When errors are not overtly marked, students often overlook them. This study examined patterns of oversight in two PC tests used to evaluate…

The articles contained in this volume on second language writing evaluation focus on the evaluation of academic English learned as a second language (ESL). Essays include: "Assessment by Misconception: Cultural Influences and Intellectual Traditions" (Brigid Ballard, John Clanchy); "Reading the World Differently: A Cross-Cultural Approach to…