This study explores the efficacy of ChatGPT-3.5, an AI chatbot, used as an Automatic Essay Scoring (AES) system and feedback provider for IELTS essay preparation. It investigates the alignment between scores given by ChatGPT-3.5 and those assigned by official IELTS examiners to establish its reliability as an AES. It also identifies the strategies…

The recent surge in the popularity of Large Language Models (LLM) for language assessment underscores the growing significance of cost-effective language evaluation in our increasingly digitalized society. This paper posits that the application of computational psychometrics can enable the incorporation of technology into language assessment,…

This study aims to investigate ChatGPT's ability to comprehend input from nonnative speakers, specifically those learning English as a second language, with Japanese speakers serving as the model population. The experiment examines how ChatGPT evaluates the difficulty levels of the Test of English for International Communication (TOEIC), which is…

This paper presents a new method for accurately measuring the vocabulary size of second language (L2) learners. Traditional vocabulary size tests (VSTs) are limited in capturing a tester's vocabulary and are often population-specific. To overcome these issues, we propose an intelligent vocabulary size measurement method that utilizes massive robot…

While many studies have addressed the benefits of technology-assisted L2 writing, limited research has delved into how generative artificial intelligence (GAI) supports students in completing their writing tasks in Mandarin Chinese. In this study, 26 university-level Mandarin Chinese foreign language students completed two writing tasks on two…

Automated essay scoring (AES) has become a valuable tool in educational settings, providing efficient and objective evaluations of student essays. However, the majority of AES systems have primarily focused on native English speakers, leaving a critical gap in the evaluation of non-native speakers' writing skills. This research addresses this gap…

Background: Language assessment plays a pivotal role in language education, serving as a bridge between students' understanding and educators' instructional approaches. Recently, advancements in Artificial Intelligence (AI) technologies have introduced transformative possibilities for automating and personalising language assessments. Objectives:…

This study investigates the impact of artificial intelligence (AI)-assisted assessment on young L2 learners' vocabulary knowledge, immunity, and resilience, considering parental and teacher support roles. Sixty junior high school students in Afghanistan, aged 13 to 14, participated in the study. They were divided into an experimental group…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

Language testing is witnessing increasing interest in the potential for AI to support test development and validation. To date, published research involving AI in language testing has typically been conducted in the context of high-stakes proficiency tests and the potential for this technology to support local language testing is under-researched.…

The National College English Test Band 4 (CET-4) is a key test to assess the English language ability of Chinese university students, and the success rate of the test is important to improve the quality of their English learning. Artificial intelligence technology can be used to predict and explore the factors influencing the success rate. This…

Acquiring technological literacy and acceptance has a significant influence on academic emotion regulation (AER), academic resilience (AR), willingness to communicate (WTC), and academic enjoyment (AE), which are crucial for the success of university students. However, this area has not been adequately explored in research, particularly in the…

One of the biggest challenges for EFL (English as Foreign Language) students to learn English is the lack of practicing environments. Although language researchers have attempted to conduct flipped classrooms to increase the practicing time in class, EFL students generally have difficulties interacting with peers and teachers in English in class.…

Mobile-assisted Language Learning (MALL) has been widely adopted in teaching and learning, yet there has been scant research concerning speaking test adaptation. An emerging type of mobile application is designed to facilitate test takers' performance in a high-stakes speaking test (e.g., the International English Language Testing System (IELTS)).…

In recent years, language practitioners have paid increasing attention to artificial intelligence (AI)'s role in language programs. This study investigated the impact of AI-assisted language assessment on L2 learners' foreign language anxiety (FLA), attitudes, motivation, and writing skills. The study adopted a sequential exploratory mixed-methods…