Publication Date
| In 2025 | 3 |
| Since 2024 | 7 |
Descriptor
Source
| Language Testing | 2 |
| International Journal of… | 1 |
| Language Learning & Technology | 1 |
| Language Teaching Research… | 1 |
| Language Testing in Asia | 1 |
| Vocabulary Learning and… | 1 |
Author
| Ahmad Alkhayyat | 1 |
| Alexander F. Tang | 1 |
| Ayaka Sugawara | 1 |
| Biju Theruvil Sayed | 1 |
| Dan Song | 1 |
| Habesha Teferi | 1 |
| Haerim Hwang | 1 |
| Huiying Cai | 1 |
| Hyunwoo Kim | 1 |
| Iroda Adhamova | 1 |
| Malila Prado | 1 |
| More ▼ | |
Publication Type
| Journal Articles | 7 |
| Reports - Research | 7 |
| Tests/Questionnaires | 1 |
Education Level
| Higher Education | 4 |
| Postsecondary Education | 4 |
Audience
Laws, Policies, & Programs
Assessments and Surveys
| International English… | 2 |
| Michigan Test of English… | 1 |
| Test of English as a Foreign… | 1 |
What Works Clearinghouse Rating
Peer reviewed
Direct linkHuiying Cai; Xun Yan – Language Testing, 2024
Rater comments tend to be qualitatively analyzed to indicate raters' application of rating scales. This study applied natural language processing (NLP) techniques to quantify meaningful, behavioral information from a corpus of rater comments and triangulated that information with a many-facet Rasch measurement (MFRM) analysis of rater scores. The…
Descriptors: Natural Language Processing, Item Response Theory, Rating Scales, Writing Evaluation
Download full textXinming Chen; Ziqian Zhou; Malila Prado – International Journal of Assessment Tools in Education, 2025
This study explores the efficacy of ChatGPT-3.5, an AI chatbot, used as an Automatic Essay Scoring (AES) system and feedback provider for IELTS essay preparation. It investigates the alignment between scores given by ChatGPT-3.5 and those assigned by official IELTS examiners to establish its reliability as an AES. It also identifies the strategies…
Descriptors: Artificial Intelligence, Natural Language Processing, Technology Uses in Education, Automation
Dan Song; Alexander F. Tang – Language Learning & Technology, 2025
While many studies have addressed the benefits of technology-assisted L2 writing, limited research has delved into how generative artificial intelligence (GAI) supports students in completing their writing tasks in Mandarin Chinese. In this study, 26 university-level Mandarin Chinese foreign language students completed two writing tasks on two…
Descriptors: Artificial Intelligence, Second Language Learning, Standardized Tests, Writing Tests
Haerim Hwang; Hyunwoo Kim – Language Testing, 2024
Given the lack of computational tools available for assessing second language (L2) production in Korean, this study introduces a novel automated tool called the Korean Syntactic Complexity Analyzer (KOSCA) for measuring syntactic complexity in L2 Korean production. As an open-source graphic user interface (GUI) developed in Python, KOSCA provides…
Descriptors: Korean, Natural Language Processing, Syntax, Computer Graphics
Osama Koraishi – Language Teaching Research Quarterly, 2024
This study conducts a comprehensive quantitative evaluation of OpenAI's language model, ChatGPT 4, for grading Task 2 writing of the IELTS exam. The objective is to assess the alignment between ChatGPT's grading and that of official human raters. The analysis encompassed a multifaceted approach, including a comparison of means and reliability…
Descriptors: Second Language Learning, English (Second Language), Language Tests, Artificial Intelligence
Biju Theruvil Sayed; Zein Bassam Bani Younes; Ahmad Alkhayyat; Iroda Adhamova; Habesha Teferi – Language Testing in Asia, 2024
There has been a surge in employing artificial intelligence (AI) in all areas of language pedagogy, not the least among them language testing and assessment. This study investigated the effects of AI-powered tools on English as a Foreign Language (EFL) learners' speaking skills, psychological well-being, autonomy, and academic buoyancy. Using a…
Descriptors: Artificial Intelligence, Language Tests, Success, Speech Skills
Qiao Wang; Ralph L. Rose; Ayaka Sugawara; Naho Orita – Vocabulary Learning and Instruction, 2025
VocQGen is an automated tool designed to generate multiple-choice cloze (MCC) questions for vocabulary assessment in second language learning contexts. It leverages several natural language processing (NLP) tools and OpenAI's GPT-4 model to produce MCC items quickly from user-specified word lists. To evaluate its effectiveness, we used the first…
Descriptors: Vocabulary Skills, Artificial Intelligence, Computer Software, Multiple Choice Tests
