One of the challenges of discussing validity arguments for machine scoring of essays centers on the absence of a commonly held definition and theory of good writing. At best, the algorithms attempt to measure select attributes of writing and calibrate them against human ratings with the goal of accurate prediction of scores for new essays.…

Synthesis writing is widely taught across domains and serves as an important means of assessing writing ability, text comprehension, and content learning. Synthesis writing differs from other types of writing in terms of both cognitive and task demands because it requires writers to integrate information across source materials. However, little is…

Academic writing is a key determinant to be successful in higher education institutions, and graduation requirements often involve students producing theses and dissertations using academic writing skills after conducting research. The COVID-19 pandemic has greatly affected pre-service teachers' learning in higher education institutions, and with…

Students' writing proficiency is measured through holistic and analytical ratings in writing assessment; however, recent studies suggest that measurement of syntactic complexity in second language writing research has become an effective measure of writing proficiency. Within this paradigm, we investigated how automated measurement of syntactic…

One of the important components in second language (L2) development is to produce clause-level units of form-meaning pairings or argument structure constructions. Based on the usage-based constructionist approach that language development entails an ability to use more diverse, more complex, and less frequent constructions, this study tested…

To determine the impacts of using ChatGPT to assist English as a foreign language (EFL) English college majors in revising essays and the possibility of leading to higher scores and potentially causing unfairness. A prospective, double-blinded, paired-comparison study was conducted in Feb. 2023. A total of 44 students provided 44 original essays…

Synthesis writing is widely taught across domains and serves as an important means of assessing writing ability, text comprehension, and content learning. Synthesis writing differs from other types of writing in terms of both cognitive and task demands because it requires writers to integrate information across source materials. However, little is…

This research paper employs an exploratory framework to evaluate the potential of ChatGPT as an Automated Writing Evaluation (AWE) tool in teaching English as a Foreign Language (EFL) in Thailand. The main objective is to investigate how well ChatGPT can assess students' writing using prompts and pre-defined rubrics compared to human raters.…

Purpose: This study presents results from a pilot intervention that integrated self-regulation through reflection and goal setting with automated writing evaluation (AWE) technology to improve students' writing outcomes. Methods: We employed a single-group pretest-posttest design. All students in Grades 5-8 (N = 56) from one urban, all female,…

This study reports the integrated findings of a mixed-methods sequential explanatory study that investigated the feasibility and effectiveness of mobile-based writing tools (MBWTs) as well as gender differences that emerged from these learning effects in the narrative writing skills of a group of sixth to seventh grade Latinx English Learners…

During the pandemic of Coronavirus disease 2019 (COVID-19), English as a foreign language (EFL) students have to study and submit their assignments and quizzes through online systems using electronic files instead of hardcopies. This has created an opportunity for teachers to use computer tools to conduct preliminary assessment of the students'…

This study investigates the effectiveness of using Google Translate as a translingual CALL tool in English as a Foreign Language (EFL) writing, keyed to the perceptions of both more highly proficient Chinese English major university students and less-proficient non-English majors. After watching a 5-minute passage from a movie, each cohort of…

Second language writing researchers have examined the affordances of Automated Writing Evaluation programs in providing immediate feedback that helps improve students' writing outputs. However, a little is known about tracking learners' process during writing essays and whether much/less pauses made by learners could predict good/poor quality of…

First year undergraduate design students have found difficulties in realising the standards expected for academic writing at university level. An assessment initiative was used to engage students with criteria and standards for a core interdisciplinary design subject notable for its demanding assessment of academic writing. The same graduate…

This article discusses and challenges the increasing use of plagiarism detection services such as Turnitin and Grammarly by students, arguing that the increasingly online nature of composition is having a profound effect on student composition processes. This dependence on the Internet is leading to a strategy I term 'de-plagiarism', in which…