One of the challenges of discussing validity arguments for machine scoring of essays centers on the absence of a commonly held definition and theory of good writing. At best, the algorithms attempt to measure select attributes of writing and calibrate them against human ratings with the goal of accurate prediction of scores for new essays.…

Background: Writing is integral to educational success at all levels and to success in the workplace. However, low literacy is a global challenge, and many students lack sufficient skills to be good writers. With the rapid advance of technology, computer-based tools that provide automated feedback are being increasingly developed. However, mixed…

Synthesis writing is widely taught across domains and serves as an important means of assessing writing ability, text comprehension, and content learning. Synthesis writing differs from other types of writing in terms of both cognitive and task demands because it requires writers to integrate information across source materials. However, little is…

English writing and critical thinking are not only fundamental to academic success but also play a crucial role for the holistic development of primary students. This study investigated the effects of a cloud-based gamified instruction integrating peer assessment on primary student English writing and critical thinking. A pre- and post-test with a…

Automated Writing Evaluation (AWE) software has been viewed as a promising tool for assisting writing. This study integrated AWE and its combination with peer review discussion into writing practice in a large college writing class in the Asian context. Adopting a mixed-method approach, this study employed a quantitative questionnaire to…

The purpose of this review is to examine the effects of automated writing evaluation (AWE) feedback on students' English writing performance. We systematically reviewed studies that have empirically focused on this purpose. This review uses several combinations of key words to search in the databases of JSTOR, SSCI, and ERIC for peer-reviewed…

Students' writing proficiency is measured through holistic and analytical ratings in writing assessment; however, recent studies suggest that measurement of syntactic complexity in second language writing research has become an effective measure of writing proficiency. Within this paradigm, we investigated how automated measurement of syntactic…

One of the important components in second language (L2) development is to produce clause-level units of form-meaning pairings or argument structure constructions. Based on the usage-based constructionist approach that language development entails an ability to use more diverse, more complex, and less frequent constructions, this study tested…

To determine the impacts of using ChatGPT to assist English as a foreign language (EFL) English college majors in revising essays and the possibility of leading to higher scores and potentially causing unfairness. A prospective, double-blinded, paired-comparison study was conducted in Feb. 2023. A total of 44 students provided 44 original essays…

This study investigates the effectiveness of ChatGPT feedback in enhancing the writing skills of Gen Z students, who constitute a significant portion of today's global population. Utilizing a mixed-methods approach, the research explores both quantitative and qualitative aspects of students' interactions with ChatGPT in the context of foreign…

A perfect writing skill has been deemed instrumental to achieving competence in EFL, yet it is considered one of the most impressive learning domains. This study investigates the impact of human-AI collaborative feedback on the writing proficiency of EFL students. It examines key teaching domains, including the teaching environment, teacher…

Synthesis writing is widely taught across domains and serves as an important means of assessing writing ability, text comprehension, and content learning. Synthesis writing differs from other types of writing in terms of both cognitive and task demands because it requires writers to integrate information across source materials. However, little is…

While over the last couple of years, there has been a growing investigation into the use of Artificial Intelligence (AI) within language learning, very little has been written regarding how such AI feedback influences the complex experiences of EFL learners in terms of motivation, foreign language peace of mind (FLPoM), trait emotional…

This research paper employs an exploratory framework to evaluate the potential of ChatGPT as an Automated Writing Evaluation (AWE) tool in teaching English as a Foreign Language (EFL) in Thailand. The main objective is to investigate how well ChatGPT can assess students' writing using prompts and pre-defined rubrics compared to human raters.…

Background: With the growing trend of integrating technology into teaching environments, using Automated Writing Evaluation (AWE) in writing instruction has been extensively studied over the last two decades. The studies on AWE mostly investigated its impact on students' writing proficiencies and revealed conflicting results. However, very few…