University classrooms are increasingly populated by students with diverse nationalities and native languages (L1). The growing number of students in English-led classrooms who speak English as a second or lower language (L2) may face added difficulties in understanding the specific task objectives or directions, as explained by native-…

There has been much debate in assessment research about the inclusion of Global English accents in high-stakes listening tests. This study explored test-takers' attitudes toward the inclusion of different English accents in the Duolingo English Test (DET) 2021 test version and their associations with listening test scores. One hundred sixty…

Purpose: This study builds a new system for automatically assessing learners' speech elicited from an oral discourse completion task (DCT), and evaluates the prediction capability of the system with a view to better understanding factors deemed influential in predicting speaking proficiency scores and the pedagogical implications of the system.…

The study examined the use of the Oral Proficiency Interview (OPI) in assessing Chinese as a second language and the challenges faced by teachers in the Chinese Language Scholarship (CLS) program. The Concurrent Triangulation Mixed Method Research was used in the study in which qualitative and quantitative data are collected simultaneously,…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…

The present study investigates whether or not Thai students' English writing skills can be improved by using an online grammar checker. First, typical syntactic errors made by undergraduate students majoring in English and English for Careers were examined. Secondly, possible reasons for syntactic errors in English writing in the light of Lado's…

VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first…

This study tried to design a WhatsApp bot to be implemented in English language vocabulary learning context in Oman. 150 Omani English as a Foreign Language (EFL) students from three different proficiency levels were selected based on random sampling. To measure the effectiveness of the treatment, pretests, posttests, and delayed posttests were…

Language proficiency diagnosis is essential to extract fine-grained information about the linguistic knowledge states and skill mastery levels of test takers based on their performance on language tests. Different from comprehensive standardized tests, many language learning apps often revolve around word-level questions. Therefore, knowledge…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

Scalar implicatures involve inferring the use of a less informative term (e.g. some) to mean the negation of a more informative term (e.g. not all). A growing body of recent research on the derivation of scalar implicatures by adult second language (L2) learners shows that while they are successful in acquiring the knowledge of scalar…

Given the novelty of human--machine communication (HMC) in task-based language learning (TBLL), we conducted a multimethodological pilot study to explore the use of Alexa in out-of-class task-based learning to mediate texts in English as a foreign language. Fourteen Polish intermediate learners participated in the quasi-experiment and programme…

This study looked at how practically ASR-based interactive video assignments can be integrated into EFL classrooms for additional out-of-class speaking practice, and what effects it will have on students. We created an ASR-based interactive video assignment using Google Scripts and gave it to students as a homework assignment between lessons in…

Nonverbal behavior can impact language proficiency scores in speaking tests, but there is little empirical information of the size or consistency of its effects or whether language proficiency may be a moderating variable. In this study, 100 novice raters watched and scored 30 recordings of test takers taking an international, high stakes…

The digital transformation in educational assessment has led to the proliferation of large-scale data, offering unprecedented opportunities to enhance language learning, and testing through machine learning (ML) techniques. Drawing on the extensive data generated by online English language assessments, this dissertation investigates the efficacy…