Syntactic complexity has long been used to gauge language learners' performance, proficiency, and development, offering language teachers valid recommendations for syllabus design and materials development. Progress in syntactic complexity research foreshadows the imperative of measuring syntactic features at a high level of granularity, which…

As an important practice for researchers, citing sources is a challenging task for undergraduate students as they deal with the types of citation forms, the variety of reporting verbs and their tenses, and the writer stances through reporting verbs. Therefore, the current research is aimed at investigating the surface forms, reporting verb tenses,…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

The release of ChatGPT marked the beginning of a new era of AI-assisted plagiarism that disrupts traditional assessment practices in ESL composition. In the face of this challenge, educators are left with little guidance in controlling AI-assisted plagiarism, especially when conventional methods fail to detect AI-generated texts. One approach to…

With the rapid development of generative artificial intelligence (AI) frameworks (e.g., the generative pre-trained transformer [GPT]), a growing number of researchers have started to explore its potential as an automated essay scoring (AES) system. While previous studies have investigated the alignment between human ratings and GPT ratings, few…

Studies on automatic scoring systems in writing assessments have also evaluated the relationship between human and machine scores for the reliability of automated essay scoring systems. This study investigated the magnitudes of indices for inter-rater agreement and discrepancy, especially regarding human and machine scoring, in writing assessment.…

There is a rich body of literature that details the effects of automated writing evaluation (AWE) on second language (L2) students. However, these studies mostly focus on the impact that automated feedback has on writing performance, i.e. that is, there is a dearth of research on its influence on affective factors. Hence, this study was conducted…

This study aims to examine the relationship between the productive knowledge of some lexical and phraseological indices and the quality of English as a Foreign Language (EFL) learners' writing. A sample of 120 expository essays, written by semesters 1 and 5 university students in a less proficient EFL context, are rated by human evaluators and…

Corpus-based studies of lexical bundles have opened new avenues for language teaching research. The fact that naturally occurring language consists of patterns of lexical repetition and multi-word units has given rise to the question of chunkiness in learner language. This study was designed to examine lexical bundles and their functions in a…

This study investigated the effectiveness of applying pedagogical translanguaging by utilizing Google Translate to facilitate college juniors in writing presentation scripts. Participants included 109 non-English major juniors divided into high- and low-proficiency groups, with 56 and 53 students, respectively. Each participant first drafted their…

The conventional scoring rubric has been used as a tool to assess students' writing for years and recently there is growing attention on the use of automated assessment tools. While studies highlighting the use of the tools per se are numerous, not much is available on the use of the combined tools. This study addresses the gap by examining 20…

In recent years, there has been a growing trend of using informal styles in academic writing, including research articles. To examine the degree of formality in students' writing, this corpus-based study aimed to analyze the formal linguistic features in the academic writing assignments of English-major students at a Thai university. The learner…

This corpus-based study investigates lexical richness in English writing by Chinese senior high school students. Lexical uses in 303 compositions were compared across three grades in terms of lexical sophistication, variation, density and errors. Timed compositions were sampled from Writing Corpus of English Learners, and the sample sizes of three…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…

This study seeks to clarify whether teachers are able to distinguish between essays written by English L2 students or generated by ChatGPT. 47 instructors who hold experience teaching English to native speakers of Japanese in universities or other higher education institutions were tested on whether they could identify between human written essays…