This study aims to examine whether differences exist in the factors influencing the difficulty of scoring English summaries and determining scores based on the raters' attributes, and to collect candid opinions, considerations, and tentative suggestions for future improvements to the analytic rubric of summary writing for English learners. In this…

Some previous researchers attempted to bridge the gap between two bodies of research: the role of metacognitive knowledge in second language (L2) writing and L2 collaborative writing (CW). Although recent studies unveiled the positive impacts of learners' metacognitive knowledge on L2 collaborative writing, there is not yet consensus regarding the…

This research uses Bloom's taxonomy in English-language writing and speaking skills assessment rubrics. A descriptive qualitative research method was adopted, and data were collected through observations, interviews, and English major students' course grades. Five lecturers and 25 students participated in the research, and the findings revealed…

The upsurge of ICT media and hybrid modalities for learning that stemmed from the world health crisis seem to be destined to stay. In this new paradigm, self-assessment processes have acquired an even more relevant role in the teaching learning process than they already had. Due to the myriad of academic online resources and information at their…

Evaluating written texts is believed to be a time-consuming process that can lack consistency and objectivity. Automated essay scoring (AES) can provide solutions to some of the limitations of human scoring. This research aimed to evaluate the performance of one AES system, Grammarly, in comparison to human raters. Both approaches' performances…

The impact of self- and peer-assessment strategies (assessment as learning) on the development of writing skill of EFL learners is a research area requiring more research studies. The present study aimed to investigate the impact of language assessment literacy enhancement (LALE) on Iranian high school English as Foreign Language (EFL) students'…

Accompanying the recent rise in cautious popularity surrounding Generative Artificial Intelligence (Gen-AI), some language educators are exploring innovative linguistic interactions with Gen-AI. Seeking to add a literature approximation to such criticism, this article explores two activities that feature Gen-AI in undergraduate literature courses.…

Despite the increasing interest in using AI tools as assistant agents in instructional settings, the effectiveness of ChatGPT, the generative pretrained AI, for evaluating the accuracy of second language (L2) writing has been largely unexplored in formative assessment. Therefore, the current study aims to examine how ChatGPT, as an evaluator,…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

Comparative Judgement (CJ) is an evaluation method, typically conducted online, whereby a rank order is constructed, and scores calculated, from judges' pairwise comparisons of performances. CJ has been researched in various educational contexts, though only rarely in English as a Foreign Language (EFL) writing settings, and is generally agreed to…

In this Brief Report, we describe an evaluation of and revisions to a rubric adapted from the Jacobs et al.'s (1981) ESL COMPOSITION PROFILE, with four rubric categories and 20-point rating scales, in the context of an intensive English program writing placement test. Analysis of 4 years of rating data (2016-2021, including 434 essays) using…

Rubrics are often used as scoring tools in evaluating student writing performance. Although there is a considerable amount of research on the use of rubrics in ESL writing instruction, little attention has been paid to studies of engaging students in rubric co-construction in the ELT context. This study investigates the implementation of…

The role of internet technology in higher education and particularly in teaching English as a Foreign language is increasingly prominent because of the interest in the ways in which technology can be applied to support students. The automated evaluation scoring system is a typical demonstration of the application of network technology in the…

Given that interaction patterns are one of the most critical components of the collaborative writing (CW) strategy, especially regarding text quality, the present study investigates the interaction patterns of argumentative text quality in CW at advanced-level undergraduate L2 writing. Ninety-five undergraduate learners participated in the…

With the rapid development of generative artificial intelligence (AI) frameworks (e.g., the generative pre-trained transformer [GPT]), a growing number of researchers have started to explore its potential as an automated essay scoring (AES) system. While previous studies have investigated the alignment between human ratings and GPT ratings, few…