Automated writing evaluation (AWE) software is an increasingly popular tool for English second language learners. However, research on the accuracy of such software has been both scarce and largely limited in its scope. As such, this article broadens the field of research on AWE accuracy by using a mixed design to holistically evaluate the…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

In recent years, language practitioners have paid increasing attention to artificial intelligence (AI)'s role in language programs. This study investigated the impact of AI-assisted language assessment on L2 learners' foreign language anxiety (FLA), attitudes, motivation, and writing skills. The study adopted a sequential exploratory mixed-methods…

The study aimed at examining the effect of Paragraph Punch on developing EFL students' writing paragraphs. The participants were eighty English language students of the English Department, Al-Balqa Applied University, who had enrolled in the Writing paragraph course. They were distributed into two assigned sections: the experimental group of (40)…

As a result of the Japanese Ministry of Education's recent edict that students' written and spoken English should be assessed in university entrance exams, there is an urgent need for tools to help teachers and students prepare for these exams. Although some commercial tools already exist, they are generally expensive and inflexible. To address…

In many high-stakes testing situations, test-takers are not allowed to draw on external writing resources while writing, a practice observed more frequently in classroom settings. This may pose problems with the representativeness of test tasks and score interpretations. This study investigates the domain definition of one particular test known as…

Comparative Judgement (CJ) has emerged as a technique that typically makes use of holistic judgement to assess difficult-to-specify constructs such as production (speaking and writing) in Modern Foreign Languages (MFL). In traditional approaches, markers assess candidates' work one-by-one in an absolute manner, assigning scores to different…

The current study focused mainly on the role of the linguistic complexity of IELTS writing Task 2. In other words, it investigated the differential effects of two interrelated linguistic complexities of writing Task 2 on the three levels of discourse representation and what IELTS candidates perceived through analyzing IELTS writing topics both at…

Cohesion features were calculated for a corpus of 960 essays by 480 test-takers from the Test of English as a Foreign Language (TOEFL) in order to examine differences in the use of cohesion devices between integrated (source-based) writing and independent writing samples. Cohesion indices were measured using an automated textual analysis tool, the…

Learners need diligence when going solo in technology-enhanced learning environments. Nevertheless, self-regulation and scaffolding are two under-researched concepts when it comes to mobile learning. To tackle this knowledge gap, this study focuses on self-regulation and scaffolding for mobile assisted language learning (MALL). Fifty-two students…

Digital storytelling (DST) is one of the areas which has entered the field of foreign language education and has proved to be beneficial in learning different language skills. However, it remains underexplored whether and how DST can affect learners' writing skill and motivation to write. The present study sought to investigate the impact of DST…

Writing in English with confidence is a matter of great concern for nonnative speakers. Since writing fluently requires a multi-dimensional mastery of language skills, students always regard it as an open question. This paper investigates writing skills which seem to be the least favored and most problematic skills to acquire in foreign language…

This mixed-methods study investigates writers' task representation and the factors affecting it in test-like and non-test-like conditions. Five advanced-level L2 writers wrote two argumentative essays each, one in test-like conditions and the other in non-test-like conditions where the participants were allowed to use all the time and online…

Drawing on Vygotskian sociocultural theory of mind and social constructivism, and adopting a sequential exploratory mixed-methods approach, this study explored the impact of online dynamic assessment (DA) on EFL learners' academic writing skills through one-on-one individual and online synchronous DA sessions over Google Docs. It also investigated…

This paper reports a series of research studies on the use of automated writing evaluation (awe) in secondary and university settings in China. The secondary school study featured the use of awe in six intact classes of 268 senior high school students for one academic year. The university study group comprised 460 students from five universities…