Evaluating written texts is believed to be a time-consuming process that can lack consistency and objectivity. Automated essay scoring (AES) can provide solutions to some of the limitations of human scoring. This research aimed to evaluate the performance of one AES system, Grammarly, in comparison to human raters. Both approaches' performances…

This mixed-methods study aims to investigate the bias in peer feedback. Thirty-two English as an additional language learners gave each other anonymous feedback on their texts. Half of the participants received feedback from their teacher disguised as peer feedback, while the other half received actual peer feedback. Data were collected through…

This study explored a way to help Japanese university students write longer essays while maintaining grammatical accuracy. Participants were three groups of students enrolled in a one-year EFL course in different academic years (N = 111), and the number of words they wrote in 30 minutes and the number of errors made per 100 words were compared. To…

This study investigates how aspects of collocational proficiency affect the ratings that expert examiners give to second language (L2) English learner essays. Lexical proficiency is a multi-faceted phenomenon and certain aspects of it are particularly impactful on human judgements, including lexical sophistication and accuracy. However, the…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

This corpus-based study investigates lexical richness in English writing by Chinese senior high school students. Lexical uses in 303 compositions were compared across three grades in terms of lexical sophistication, variation, density and errors. Timed compositions were sampled from Writing Corpus of English Learners, and the sample sizes of three…

This study seeks to clarify whether teachers are able to distinguish between essays written by English L2 students or generated by ChatGPT. 47 instructors who hold experience teaching English to native speakers of Japanese in universities or other higher education institutions were tested on whether they could identify between human written essays…

The study examined the types of language errors made by learners in the English narrative essays. It also assessed the feedback techniques employed by teachers of English in the handling of language errors in the English narrative essays. A descriptive research design was employed to examine errors of English narrative essays of 181 form two…

Students' writing proficiency is measured through holistic and analytical ratings in writing assessment; however, recent studies suggest that measurement of syntactic complexity in second language writing research has become an effective measure of writing proficiency. Within this paradigm, we investigated how automated measurement of syntactic…

We investigated spelling errors in English and Spanish essays by Spanish-English dual language learners in Grades 1, 2, and 3 (N = 278; 51% female) enrolled in either English immersion or English-Spanish dual immersion programs. We examined what types of spelling errors students made, whether they made spelling errors that could be due to…

The difference in how humans read and how Automated Essay Scoring (AES) systems process written language leads to a situation where a portion of student responses will be comprehensible to human markers, but unable to be parsed by AES systems. This paper examines a number of pieces of student writing that were marked by trained human markers, but…

Studies on the role of input in L2 acquisition often estimate L2 input properties through L1 corpora and focus on L2-English. This study probes the initial stage of L2-Korean learning for adult English-speaking beginners of Korean to investigate input-output relations in the acquisition of L2 that is typologically different from English in a more…

This report sets out the findings of the technical development work completed as part of the Use Cases for Generative AI in Education project, commissioned by the Department for Education (DfE) in September 2023. It has been published alongside the User Research Report, which sets out the findings from the ongoing user engagement activity…

We investigated spelling errors in English and Spanish essays by Spanish-English dual language learners in Grades 1, 2, and 3 (N = 278; 51% female) enrolled in either English immersion or English-Spanish dual immersion programs. We examined what types of spelling errors students made, whether they made spelling errors that could be due to…

The current study explores error fossilization in the academic writing of Saudi English as a Foreign Language (EFL) undergraduate learners. A manual textual analysis approach, employing corpus content analysis on writing across diverse genres including argumentative, expository, narrative, and descriptive essays was conducted to discover the…