This longitudinal study (2002-2014) investigates the stability of rating characteristics of a large group of raters over time in the context of the writing paper of a national high-stakes examination. The study uses one measure of rater severity and two measures of rater consistency. The results suggest that the rating characteristics of…

This paper reports on a three-year action research project action investigating the relationship between assessment as a social structure and the agency of students within a preparatory course for postgraduate international students at a UK Russell Group University. Action research into academic writing assessment within this highly constrained…

With a considerable emphasis on the role of feedback in L2 writing, the effectiveness of written corrective feedback (WCF) has been investigated extensively over the past 25 years. Conflicting findings have been reported regarding the efficacy of WCF in developing learners' written accuracy. This paper provides an in-depth analysis of research on…

Automated Writing Evaluation (AWE) provides automatic writing feedback and scoring to support student writing and revising. The purpose of the present study was to analyze a statewide implementation of an AWE software (n = 114,582) in grades 4-11. The goals of the study were to evaluate: (1) to what extent AWE features were used; (2) if equity and…

Automated Essay Scoring (AES) can reliably grade essays at scale and reduce human effort in both classroom and commercial settings. There are currently three dominant supervised learning paradigms for building AES models: feature-based, neural, and hybrid. While feature-based models are more explainable, neural network models often outperform…

Synthesis writing is widely taught across domains and serves as an important means of assessing writing ability, text comprehension, and content learning. Synthesis writing differs from other types of writing in terms of both cognitive and task demands because it requires writers to integrate information across source materials. However, little is…

In writing studies research, automated writing evaluation technology is typically examined for a specific, often narrow purpose: to evaluate a particular writing improvement measure, to mine data for changes in writing performance, or to demonstrate the effectiveness of a single technology and accompanying validity arguments. This article adopts a…

The researcher in this study applied the notions of quantitative method, theoretical linguistics and applied linguistics to examine the correlation between the linguistic theory of end-weight principle and English adjective clauses in Q1-SCOPUS applied linguistics articles and Thai EFL learners' descriptive essays. The significance of this study…

Research has suggested that the type of feedback learners receive can impact on whether learners understand the feedback, the extent to which they engage with it, and whether they incorporate it in their revised drafts. However, to date, only a small number of studies have investigated learner engagement with corrective feedback provided by…

This report sets out the findings of the technical development work completed as part of the Use Cases for Generative AI in Education project, commissioned by the Department for Education (DfE) in September 2023. It has been published alongside the User Research Report, which sets out the findings from the ongoing user engagement activity…

Children's writing development is a matter of concern for Australian and other education systems. Factors related to the nature of writing as a literate skill, school writing pedagogy, and diminishing role of writing in a screen-dominant environment may account for this educational concern. What happens in a child's writing when immigrant parents…

This article presents findings from an empirical study in which we investigated Content and Language Integrated Learning (CLIL) students' linguistic resources in the L2 (English) to convey different Cognitive Discourse Functions (Dalton-Puffer 2013; 2016)--"Describe, Compare (Categorize), Report, Evaluate" and "Explore"--in two…

With the recent rapid technological advance, second language (L2) educators have increasingly incorporated technologies into writing pedagogy. Two of the major technologies to promote L2 writing are e-portfolios and automated written corrective feedback (AWCF). Notably, feedback-rich portfolios facilitate L2 learners' self-regulation and writing…

Power distance (PD), a cultural value denoting acceptance of asymmetrical power relationships, influences the force of rhetoric used by a writer to address their reader. However, AI technologies such as ChatGPT lack an explicit awareness of PD, which could affect the quality of AI-generated persuasive texts used for language learning. To…

This paper analyzes writing tasks in academic writing textbooks for Japanese university students, focusing on the organization and difficulty of these tasks based on the Common European Framework of Reference for Languages (CEFR). A total of 411 writing tasks from 30 textbooks were coded by two experienced Japanese English teachers. The author…