The present study performs a three-level meta-analysis to investigate the overall effectiveness of automated writing evaluation (AWE) on EFL/ESL student writing performance. 24 primary studies representing 85 between-group effect sizes and 34 studies representing 178 within-group effect sizes found from 1993 to 2021 were separately meta-analyzed.…

In recent years, various strategies have been employed to integrate ChatGPT into the field of second language (L2) teaching and learning. In line with such efforts, this study investigates the potential of ChatGPT as an automated writing evaluation (AWE) tool for L2 assessment, given the lack of systematic and quantitative investigation into human…

Although it has been suggested that automated writing evaluation (AWE) can liberate teachers' time to focus more on higher-order concerns as it can take care of lower-order concerns, AWE's impact on teachers' feedback practice is underexplored. Additionally, scant literature exists on teachers' perception of AWE when they use it to complement…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

The release of ChatGPT marked the beginning of a new era of AI-assisted plagiarism that disrupts traditional assessment practices in ESL composition. In the face of this challenge, educators are left with little guidance in controlling AI-assisted plagiarism, especially when conventional methods fail to detect AI-generated texts. One approach to…

Research on the use of ChatGPT in education has proliferated in the past years. However, there is limited understanding of how English as a Foreign Language (EFL) learners engage emotionally with and utilize ChatGPT during the pre-writing stage. Furthermore, how learners' affective engagement (emotional responses) with this tool in the planning…

With the burgeoning popularity and swift advancements of automated writing evaluation (AWE) systems in language classrooms, scholarly and practical interest in this area has noticeably increased. This systematic review aims to comprehensively investigate current research on three prominent AWE systems: Grammarly, Pigai, and Criterion. Objectives…

While the use of collaborative peer editing is widespread in some online learning contexts, little is known about how constituent editing behaviours impact student writing quality when using shared online documents as the mediating tool. Therefore, the present study (n = 176) examines the effects of English language learners' peer editing…

With the rapid development of generative artificial intelligence (AI) frameworks (e.g., the generative pre-trained transformer [GPT]), a growing number of researchers have started to explore its potential as an automated essay scoring (AES) system. While previous studies have investigated the alignment between human ratings and GPT ratings, few…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

English writing and critical thinking are not only fundamental to academic success but also play a crucial role for the holistic development of primary students. This study investigated the effects of a cloud-based gamified instruction integrating peer assessment on primary student English writing and critical thinking. A pre- and post-test with a…

There is a rich body of literature that details the effects of automated writing evaluation (AWE) on second language (L2) students. However, these studies mostly focus on the impact that automated feedback has on writing performance, i.e. that is, there is a dearth of research on its influence on affective factors. Hence, this study was conducted…

This study examines the use of ChatGPT, in conjunction with other applications, Grammarly and Quillbot, as an automated writing evaluation (AWE) tool in a Recount and Narrative essay course for 18 English as a Foreign Language (EFL) students in Indonesia. The primary objective was to investigate the impact of these tools on the development of…

Online grammar checkers have increasingly been used in writing instruction to detect and remove English as a foreign language (EFL) learners' grammatical errors. This study investigated the effects of the automated writing evaluation software "Grammarly" on Iranian EFL learners' article errors which are common in EFL writing. Ninety…

This study investigated the effectiveness of applying pedagogical translanguaging by utilizing Google Translate to facilitate college juniors in writing presentation scripts. Participants included 109 non-English major juniors divided into high- and low-proficiency groups, with 56 and 53 students, respectively. Each participant first drafted their…