This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

In this article, we explore the concept of a "hidden curriculum" within generative AI, specifically Large Language Models (LLMs), and its intersection with the hidden curriculum in education. We highlight how AI, trained on biased human data, can perpetuate societal inequities and discriminatory practices despite appearing objective. We…

Writing is a necessary skill in our technological world. Many people have a mobile device that they use for e-mailing, social media, as an alarm clock to start the day, reading the news, searching for information, ordering food, managing transportation (e.g., monitoring traffic, accessing public transit), or for relaxing pursuits, such as watching…

This article considers the claim that machine scoring of writing test responses agrees with human readers as much as humans agree with other humans. These claims about the reliability of machine scoring of writing are usually based on specific and constrained writing tasks, and there is reason for asking whether machine scoring of writing requires…

The hurried pace of the modern classroom does not permit formative feedback on writing assignments at the frequency or quality recommended by the research literature. One solution for increasing individual feedback to students is to incorporate some form of computer-generated assessment. This study explores the use of automated assessment of…

Purpose: The primary goal of this study was to document the progression of the microstructural elements of written language in children at 4 grade levels. The secondary purpose was to ascertain whether the variables selected for examination could be classified into valid categories that reflect the multidimensional nature of writing. Method:…

Advances in assessment technologies are affording teachers and students new ways to efficiently assess and track achievement while also better promoting learning. WriteToLearn is one such technology, a Web-based tool that integrates practice and assessment in reading comprehension with writing about what is learned. Based on the principle of…

Within large scale educational assessment agencies in the UK, there has been a shift towards assessors marking digitally scanned copies rather than the original paper scripts that were traditionally used. This project uses extended essay examination scripts to consider whether the mode in which an essay is read potentially influences the…

Automated Essay Scoring (AES) is defined as the computer technology that evaluates and scores the written prose (Shermis & Barrera, 2002; Shermis & Burstein, 2003; Shermis, Raymat, & Barrera, 2003). AES systems are mainly used to overcome time, cost, reliability, and generalizability issues in writing assessment (Bereiter, 2003; Burstein,…

This article presents findings from research in a school district using handhelds to support writing across the curriculum. The authors report that handheld devices can be useful to foster classroom note-taking activities, assist students who have handwriting difficulties, and provide inspiration to teachers who want to create collaborative and…

Innovations, ETS's corporate magazine, provides information on educational assessment for educators, school leaders, researchers and policymakers around the world. Each issue of Innovations focuses on a particular theme in assessment. This issue reports on how new technologies in classrooms around the world are enhancing teaching, learning and…