The present study performs a three-level meta-analysis to investigate the overall effectiveness of automated writing evaluation (AWE) on EFL/ESL student writing performance. 24 primary studies representing 85 between-group effect sizes and 34 studies representing 178 within-group effect sizes found from 1993 to 2021 were separately meta-analyzed.…

Lexical diversity (LD) is an important indicator of second language lexical development. Much research has investigated LD indices, with a focus on learners of English. However, further research is needed in languages that are typologically distinct from English, such as Korean. In this study, we evaluated the reliability and validity of LD…

Attaining Advanced proficiency and beyond has been a principal goal for second language learners, practitioners, and researchers. Achieving this level in writing requires producing connected discourse of paragraph-level length and nurturing the ability to arrange various linguistic units to form a unified and cohesive whole. This ability, known as…

This research uses Bloom's taxonomy in English-language writing and speaking skills assessment rubrics. A descriptive qualitative research method was adopted, and data were collected through observations, interviews, and English major students' course grades. Five lecturers and 25 students participated in the research, and the findings revealed…

Measuring lexical diversity in texts that have different lengths is problematic because length has a significant effect on the number of types a text contains, thus hampering any comparison. Treffers-Daller et al. (2018) recommended a simple solution, namely counting the number of types in a section of a given length that was extracted from the…

Corrective feedback (CF) has long been a hot topic in language education circles and has received extensive research attention. However, there is still controversy over the effectiveness of CF use and error correction in language classes. To address this discrepancy, the current study probed the effectiveness of different CF types in improving…

This study aims to analyse how Japanese first-year university students' writing anxiety in academic writing classes changed over nine months. A total of 102 Japanese first-year university students participated in an academic writing class. Two assessors evaluated the students' compositions, using the same writing assessment rubric. The students…

Syntactic complexity has long been used to gauge language learners' performance, proficiency, and development, offering language teachers valid recommendations for syllabus design and materials development. Progress in syntactic complexity research foreshadows the imperative of measuring syntactic features at a high level of granularity, which…

Language immersion programs seek to develop multilingual, multiliterate individuals able to engage with academic content. Studies of immersion students' language development provide details regarding language proficiency and accuracy, yet they generally do not address how features of written, academic language, for example, syntactic and lexical…

In the past two decades, syntactic complexity measures (e.g. the length or number of words per clause/t-unit/sentences and number of clauses per t-unit/sentence, and types of clauses used) have been widely used to determine and benchmark language proficiency development in speaking and writing. (Norris and Ortega 2009; Lu 2011). However, the…

It is widely believed that raters' cognition is an important aspect of writing assessment, as it has both logical and temporal priority over scores. Based on a critical review of previous research in this area, it is found that raters' cognition can be boiled to two fundamental issues: building text images and strategies for articulating scores.…

This study investigated the efficacy of varying degrees of written corrective feedback (WCF) explicitness on the accuracy of revised drafts and new pieces of writing among learners of different proficiency levels. A total of 130 learners of English were divided into three proficiency groups (basic, independent, and proficient users), with learners…

This study investigates how aspects of collocational proficiency affect the ratings that expert examiners give to second language (L2) English learner essays. Lexical proficiency is a multi-faceted phenomenon and certain aspects of it are particularly impactful on human judgements, including lexical sophistication and accuracy. However, the…

With the rapid development of generative artificial intelligence (AI) frameworks (e.g., the generative pre-trained transformer [GPT]), a growing number of researchers have started to explore its potential as an automated essay scoring (AES) system. While previous studies have investigated the alignment between human ratings and GPT ratings, few…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…