This study examined a naturalistic, districtwide implementation of an automated writing evaluation (AWE) software program called "MI Write" in elementary schools. We specifically examined the degree to which aspects of MI Write were implemented, teacher and student attitudes towards MI Write, and whether MI Write usage along with other…

This study examined a naturalistic, districtwide implementation of an automated writing evaluation (AWE) software program called "MI Write" in elementary schools. We specifically examined the degree to which aspects of MI Write were implemented, teacher and student attitudes towards MI Write, and whether MI Write usage along with other…

In a randomized trial that collects text as an outcome, traditional approaches for assessing treatment impact require that each document first be manually coded for constructs of interest by human raters. An impact analysis can then be conducted to compare treatment and control groups, using the hand-coded scores as a measured outcome. This…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

We investigated spelling errors in English and Spanish essays by Spanish-English dual language learners in Grades 1, 2, and 3 (N = 278; 51% female) enrolled in either English immersion or English-Spanish dual immersion programs. We examined what types of spelling errors students made, whether they made spelling errors that could be due to…

Automated Essay Scoring (AES) can reliably grade essays at scale and reduce human effort in both classroom and commercial settings. There are currently three dominant supervised learning paradigms for building AES models: feature-based, neural, and hybrid. While feature-based models are more explainable, neural network models often outperform…

This report sets out the findings of the technical development work completed as part of the Use Cases for Generative AI in Education project, commissioned by the Department for Education (DfE) in September 2023. It has been published alongside the User Research Report, which sets out the findings from the ongoing user engagement activity…

We investigated spelling errors in English and Spanish essays by Spanish-English dual language learners in Grades 1, 2, and 3 (N = 278; 51% female) enrolled in either English immersion or English-Spanish dual immersion programs. We examined what types of spelling errors students made, whether they made spelling errors that could be due to…

This study reports the integrated findings of a mixed-methods sequential explanatory study that investigated the feasibility and effectiveness of mobile-based writing tools (MBWTs) as well as gender differences that emerged from these learning effects in the narrative writing skills of a group of sixth to seventh grade Latinx English Learners…

We investigate students' implementation of the feedback messages they received in an automated writing evaluation system ("eRevise") that aims to improve students' use of text evidence in their writing. Seven 5th and 6th-grade teachers implemented "eRevise" (n = 143 students). Qualitative analysis of students' essays across…

Writing a good essay typically involves students revising an initial paper draft after receiving feedback. We present eRevise, a web-based writing and revising environment that uses natural language processing features generated for rubric-based essay scoring to trigger formative feedback messages regarding students' use of evidence in…

In an age when students are increasingly expected to demonstrate technology-based writing proficiency, fluency challenges with word processing programs can pose a barrier to successful writing when students are asked to compose using these tools. The current study was designed to determine whether differences existed in typing fluency and digital…

Lucy Moonen set out to explore whether collaborative writing in small groups, facilitated by the use of Google Docs, would help to sustain students' focus on essay writing as the development of an historical argument. She explains how she set up an essay on the League of Nationals as a collaborative task and demonstrates how the technology enabled…

Classroom teachers sometimes struggle trying to find time during the typical school day to provide the writing instruction students need to be successful. This study examined 29 fifth through twelfth grade classroom teachers' survey responses about their perception of the effectiveness of using an online blogging tool, Kidblog, to plan and provide…

The study explored whether aspects of elementary students' writing about their personal values could predict if students were considered more at risk or more resilient. Essays from 176 fifth-grade students (79.54% African American, 20.46% Hispanic) from a low-income, urban district in New Jersey were analyzed using the Linguistic Inquiry and Word…