Lexical diversity (LD) is an important indicator of second language lexical development. Much research has investigated LD indices, with a focus on learners of English. However, further research is needed in languages that are typologically distinct from English, such as Korean. In this study, we evaluated the reliability and validity of LD…

Rater comments tend to be qualitatively analyzed to indicate raters' application of rating scales. This study applied natural language processing (NLP) techniques to quantify meaningful, behavioral information from a corpus of rater comments and triangulated that information with a many-facet Rasch measurement (MFRM) analysis of rater scores. The…

The present study explored the effects of interactionist Dynamic Assessment (DA) and age on the writing accuracy of IELTS candidates. This research investigated the existence of an interactional effect between the age of learners and the type of treatment they received. First, 140 IELTS candidates were split into two age groups, adult and young.…

Students with emotional and behavioral challenges often struggle with writing. Curriculum-based measurement (CBM) is an assessment used for a variety of purposes including screening, progress monitoring, and data-based individualization. However, little research has examined technical properties of writing CBM data and supported inferences. This…

Cognitive diagnostic assessment (CDA) intends to identify learners' strengths and weaknesses in latent cognitive attributes to provide personalized remedial instructions. Previous CDA studies on English as a Foreign Language (EFL)/English as a Second Language (ESL) writing have adopted dichotomous cognitive diagnostic models (CDMs) to analyze data…

Assessing the content of learners' compositions is a common practice in second language (L2) writing assessment. However, the construct definition of content in L2 writing assessment potentially underrepresents the target competence in content and language integrated learning (CLIL), which aims to foster not only L2 proficiency but also critical…

In this Brief Report, we describe an evaluation of and revisions to a rubric adapted from the Jacobs et al.'s (1981) ESL COMPOSITION PROFILE, with four rubric categories and 20-point rating scales, in the context of an intensive English program writing placement test. Analysis of 4 years of rating data (2016-2021, including 434 essays) using…

Task design has been viewed to be essential in the context of language assessment. This study investigated whether increasing task complexity affects learners' writing performance. It employs three writing tasks with different levels of complexity based on Robinson's Componential Framework. A cohort of 278 participants was selected using a simple…

Vocabulary knowledge plays an important role in writing. Previous research has examined the relationship between various aspects of vocabulary knowledge and independent writing performance and limited attention has been given to integrated writing such as summary writing. Our study investigated the contribution of two aspects of vocabulary…

This study offers a bibliometric overview of the English language assessment research from 1992 to 2024. It aims to uncover the current state, research trends, and future directions of the field. A total of 927 articles published in Web of Science (WoS) were analyzed using the VOSviewer bibliometric software tool. Based on the sample of 927…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…

This study investigated the impact of generative AI-assisted writing feedback, specifically using Grammarly, on English as a Foreign Language (EFL) learners' writing proficiency, revision practices, and writing quality. Sixty postgraduate EFL students were randomly assigned to either an experimental group using Grammarly as an AI-enhanced feedback…

This study examines how the genre of input text influences Chinese young EFL learners' performance on continuation tasks. Participants were 30 students in Grade 9 and repeated-measures design was adopted to compare their performance on narrative and argumentative continuation tasks, in terms of writing quality, CAF indicators as well as alignment.…

The purpose of this study is to analyze the grammatical complexity features of international teaching assistants' (ITAs) mock-teaching presentations and to compare the distributions of these features to those found in the Oral English Proficiency Test (a local ITA assessment), university classroom teaching, conversation, and academic writing. The…