This paper highlights as issues of concern the rapid changes in technology and the tendency to report on partial validation efforts where the work is not identified as forming part of a larger validation project. With close human supervision emerging technologies can have a significant and positive impact on language testing. While technology…

Background: This study examines the evolution of English speaking proficiency test methods, which have traditionally relied on face-to-face interactions to assess communicative language competence. Recently, computer-based language tests have also been used on a larger scale, albeit with concerns about their impact on measurement. Objectives: This…

While many studies have addressed the benefits of technology-assisted L2 writing, limited research has delved into how generative artificial intelligence (GAI) supports students in completing their writing tasks in Mandarin Chinese. In this study, 26 university-level Mandarin Chinese foreign language students completed two writing tasks on two…

Background: Language assessment plays a pivotal role in language education, serving as a bridge between students' understanding and educators' instructional approaches. Recently, advancements in Artificial Intelligence (AI) technologies have introduced transformative possibilities for automating and personalising language assessments. Objectives:…

This study investigates the impact of artificial intelligence (AI)-assisted assessment on young L2 learners' vocabulary knowledge, immunity, and resilience, considering parental and teacher support roles. Sixty junior high school students in Afghanistan, aged 13 to 14, participated in the study. They were divided into an experimental group…

Purpose: Oral language skills provide a critical foundation for formal education and especially for the development of children's literacy (reading and spelling) skills. It is therefore important for teachers to be able to assess children's language skills, especially if they are concerned about their learning. We report the development and…

This study aimed to compare item characteristics and response time between stimulus conditions in computer-delivered listening tests. Listening materials had three variants: regular videos, frame-by-frame videos, and only audios without visuals. Participants were 228 Japanese high school students who were requested to complete one of nine…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…

This study inspected how techno-competence in artificial intelligence (AI)-driven evaluations affected EFL learners' boredom, self-esteem, and writing skills. To do so, 66 Saudi Arabian male students from Saudi Arabia participated in the study. They were then split into the experimental group (EG) and the control group (CG). While the CG was…

Previous research on online features embedded in language assessments have been limited to the use of dictionary or spell/grammar check. Few have examined the role of accessibility features in the Kindergarten to Grade 12 (K-12) English learner (EL) context in the U.S. This study examined how K-12 EL educators perceive and instruct online…

Responding to the challenge of delivering valid assessments during the unprecedented times of the COVID-19 pandemic was certainly not easy. However, the efforts will undoubtedly lead to developments in the field of language assessment. This special issue closes with a brief summary of the commentaries it contains and raises some unanswered…

Over the past 40 years, second language educators and assessors have come to the realization that investigating the process of writing can shed light on language teaching, learning and assessment practices (Odendahl & Deane, 2018). What L2 writers do and think while writing can provide links between the task, the related construct and the…

VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first…

It has been argued that successful professional development efforts, especially in assessment-literacy, need to address emotional components and the existence of implicit conceptions in order to raise consciousness and ultimately transform practice (Xu and Brown, 2016: p. 156). Experiential approaches have been shown to be highly effective for…

Drawing on duoethnography, the teacher researchers in the present study interacted with the relevant literature, engaged in dialogs, and shared artifacts to examine their knowledge, beliefs, and practices regarding fairness and justice considerations in technology-enhanced language classroom assessment. Under the domain of knowledge, they…