This study aims to investigate ChatGPT's ability to comprehend input from nonnative speakers, specifically those learning English as a second language, with Japanese speakers serving as the model population. The experiment examines how ChatGPT evaluates the difficulty levels of the Test of English for International Communication (TOEIC), which is…

University classrooms are increasingly populated by students with diverse nationalities and native languages (L1). The growing number of students in English-led classrooms who speak English as a second or lower language (L2) may face added difficulties in understanding the specific task objectives or directions, as explained by native-…

Despite the progress in information technology, artificial intelligence as well as all kinds of machine translation software, we found that to dynamically capture the essence and the spirit of the cultural item, one needs to resort to the human mind rather than to the machine that only decodes words away from their shades of meaning. The objective…

This study explores the efficacy of ChatGPT-3.5, an AI chatbot, used as an Automatic Essay Scoring (AES) system and feedback provider for IELTS essay preparation. It investigates the alignment between scores given by ChatGPT-3.5 and those assigned by official IELTS examiners to establish its reliability as an AES. It also identifies the strategies…

The study examined the use of the Oral Proficiency Interview (OPI) in assessing Chinese as a second language and the challenges faced by teachers in the Chinese Language Scholarship (CLS) program. The Concurrent Triangulation Mixed Method Research was used in the study in which qualitative and quantitative data are collected simultaneously,…

Although automated item generation has gained a considerable amount of attention in a variety of fields, it is still a relatively new technology in ELT contexts. Therefore, the present article aims to provide an accessible introduction to this powerful resource for language teachers based on a review of the available research. Particularly, it…

This study explores the effectiveness of using ChatGPT, an Artificial Intelligence (AI) language model, as an Automated Essay Scoring (AES) tool for grading English as a Foreign Language (EFL) learners' essays. The corpus consists of 50 essays representing various types including analysis, compare and contrast, descriptive, narrative, and opinion…

VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first…

This study tried to design a WhatsApp bot to be implemented in English language vocabulary learning context in Oman. 150 Omani English as a Foreign Language (EFL) students from three different proficiency levels were selected based on random sampling. To measure the effectiveness of the treatment, pretests, posttests, and delayed posttests were…

The recent surge in the popularity of Large Language Models (LLM) for language assessment underscores the growing significance of cost-effective language evaluation in our increasingly digitalized society. This paper posits that the application of computational psychometrics can enable the incorporation of technology into language assessment,…

This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…

Questions exist as to whether AI tools, such as ChatGPT, can aid learning. This study examined whether in-class exercises involving error detection in text generated by ChatGPT can aid students' foreign language writing. Participants were Arabic-English speakers who were classified as ranging from modest to competent English users according to…

Given the novelty of human--machine communication (HMC) in task-based language learning (TBLL), we conducted a multimethodological pilot study to explore the use of Alexa in out-of-class task-based learning to mediate texts in English as a foreign language. Fourteen Polish intermediate learners participated in the quasi-experiment and programme…

Objectives: The study aims to investigate the efficacy of the Poe ChatGPT-based TPACK model on EFL teachers' performance and their students' vocabulary learning. Methods: I designed four instruments to gather the research data: a survey of EFL teaching skills, a teaching knowledge test, an observation checklist for assessing teacher performance,…

The National College English Test Band 4 (CET-4) is a key test to assess the English language ability of Chinese university students, and the success rate of the test is important to improve the quality of their English learning. Artificial intelligence technology can be used to predict and explore the factors influencing the success rate. This…