Identifying high-quality educators at the point of hire can reduce future recruitment costs and minimize the impact of attrition on school organizations and student learning. One low-cost way to screen applicants and learn about their beliefs, values, and pedagogy is through their short-essay writing samples. However, there is limited research…

The new era of generative artificial intelligence has sparked the blossoming academic fireworks in the realm of education and information technologies. Driven by natural language processing (NLP), automated writing evaluation (AWE) tools become a ubiquitous practice in intelligent computer-assisted language learning (CALL) environments. Based on…

The evaluation of student essay corrections has become a focal point in understanding the evolving role of Artificial Intelligence (AI) in education. This study aims to assess the accuracy, efficiency, and cost-effectiveness of ChatGPT's essay correction compared to human correction, with a primary focus on identifying and rectifying grammatical…

Evaluating the quality of university exam papers is crucial for universities seeking institutional and program accreditation. Currently, exam papers are assessed manually, a process that can be tedious, lengthy, and in some cases, inconsistent. This is often due to the focus on assessing only the formal specifications of exam papers. This study…

The use of automated writing evaluation (AWE) in second language (L2) writing contexts has increased dramatically, as evidenced by the large body of research published on the topic over the past decade. Considering this, several systematic reviews on AWE have been published. Nevertheless, none of these review studies has exclusively focused on the…

The present study performs a three-level meta-analysis to investigate the overall effectiveness of automated writing evaluation (AWE) on EFL/ESL student writing performance. 24 primary studies representing 85 between-group effect sizes and 34 studies representing 178 within-group effect sizes found from 1993 to 2021 were separately meta-analyzed.…

This bibliometric analysis attempts to map out the scientific literature on automated writing evaluation (AWE) systems for teaching, learning, and assessment. A total of 170 documents published between 2002 and 2021 in Social Sciences Citation Index journals were reviewed from four dimensions, namely size (productivity and citations), time…

With the rapid advancement of information technologies, automated writing evaluation technologies have developed so fast that they can be applied to writing assessments. However, scanty studies have pooled the effects of automated writing evaluation on writing performance. Through a PRISMA protocol-based meta-analysis, this study concludes that…

Reflective practice holds critical importance, for example, in higher education and teacher education, yet promoting students' reflective skills has been a persistent challenge. The emergence of revolutionary artificial intelligence technologies, notably in machine learning and large language models, heralds potential breakthroughs in this domain.…

Despite the plethora of studies on the role of noticing in second language learning, little is known about the role of AI-operated feedback in noticing errors and uptake "during" and "after" writing. To address this gap, this study primarily aimed to investigate the impact of feedback modes and timing on L2 students' noticing…

Automated writing evaluation (AWE) plays an important role in writing pedagogy and has received considerable research attention recently; however, few reviews have been conducted to systematically analyze the recent publications arising from the many studies in this area. The present review aims to provide a comprehensive analysis of the…

Much research has applied automated writing evaluation (AWE) systems to English writing instruction; however, understanding how students internalize and apply this feedback to reduce writing errors is difficult, largely due to the personal and private nature of this process. Therefore, this research utilized eye-tracking technology to explore the…

Within the context of Chinese university education, effective communication in the field of second language writing heavily relies on lexical complexity, yet the role of writing feedback perception in relation to lexical complexity remains elusive. This study introduces a comprehensive writing feedback perception model encompassing perceptions of…

In recent years, various strategies have been employed to integrate ChatGPT into the field of second language (L2) teaching and learning. In line with such efforts, this study investigates the potential of ChatGPT as an automated writing evaluation (AWE) tool for L2 assessment, given the lack of systematic and quantitative investigation into human…

This paper presents a multidimensional model of variation in writing quality, register, and genre in student essays, trained and tested via confirmatory factor analysis of 1.37 million essay submissions to ETS' digital writing service, Criterion®. The model was also validated with several other corpora, which indicated that it provides a…