Launched in late November 2022, ChatGPT, a large language model chatbot, has garnered considerable attention. However, ongoing questions remain regarding its capabilities. In this study, ChatGPT was used to complete national high school exams in the Netherlands on the topic of English reading comprehension. In late December 2022, we submitted the…

This study applied the Mixed Rasch Model (MRM) to the listening comprehension section of the International English Language Testing System (IELTS) to detect latent class differential item functioning (DIF) by exploring multiple profiles of second/foreign language listeners. Item responses of 462 examinees to an IELTS listening test were subjected…

This study examines the impact of teacher metapathy, or teachers' capacity to comprehend and sympathize with students' emotional and cognitive requirements, on the academic outcomes of IELTS applicants, such as total band scores, motivation, and language learning orientation. Ten IELTS teachers from five language training centers and 100 IELTS…

This study investigated phonological whole-word measures in bilingual Arabic-English speakers to explore how the target approximations influence children's phonological development. To this end, fifteen bilingual Arabic-English speakers and nine monolingual Arabic-speaking children aged 36-48 months (mean = 42) participated in a parent-child…

A frequently encountered security issue in writing tests is nonauthentic text submission: Test takers submit texts that are not their own but rather are copies of texts prepared by someone else. In this report, we propose AutoESD, a human-in-the-loop and automated system to detect nonauthentic texts for a large-scale writing tests, and report its…

It is important for college students and future TESOL teachers to see someone like them among their instructors and mentors. Diverse future teachers who are trained in TESOL might be attracted to the profession based on who their teacher educators are in terms of gender, multilingualism, international studies, and/or work experience. The question…

Despite the vast research on test anxiety and test performance since the 1950s, studies on how students' English test anxiety affects their English proficiency test performance in the context of second- and foreign language learning remain few. Therefore, using a quantitative research design, this study explored students' English test anxiety and…

This study presents a comparative analysis of classical reliability measures, including Cronbach's alpha, test-retest, and parallel forms reliability, alongside modern psychometric methods such as the Rasch model and Mokken scaling, to evaluate the reliability of C-tests in language proficiency assessment. Utilizing data from 150 participants…

Several high-stakes English proficiency tests including but not limited to IELTS, PTE Academic, and TOEFL iBT recommend a 2-year time limit on validity for score usage. Although this timeframe provides a useful rule-of-thumb for the recency of testing, it can have far-reaching consequences. In response to stakeholder queries around IELTS validity…

This study delves into writing scores in both tests, aiming to uncover the reasons behind score differences. Through comprehensive comparative analysis, this research explores scoring patterns, criteria, and score distributions in IELTS and PTE writing sections. It investigates sources of score variation, including task design, rating criteria,…

This study explores the relationship between English Learners (ELs) in the Texas school system and their outcomes on the State of Texas Assessments of Academic Readiness (STAAR) tests and the Texas English Language Proficiency Assessment System (TELPAS). Schumann's Acculturation Model and Krashen's Input Hypothesis were used as theoretical…

Stakeholders in exam-driven countries are responsible for developing test-related tasks to assess the quality of English as a Foreign Language (EFL) teaching and learning. Hence, the language assessment literacy (LAL) of different stakeholders has to be investigated. This mixed-methods study explored the required LAL competencies among two groups…

The TOEFL Junior® tests are designed to evaluate young language students' English reading, listening, speaking, and writing skills in an English-medium secondary instructional context. This paper articulates a validity argument constructed to support the use and interpretation of the TOEFL Junior test scores for the purpose of placement, progress…

Aural lexical knowledge (ALK) is crucial for second language (L2) listening. Despite its importance, there is scant research that has validly explored the relationship between ALK and L2 listening across different English as a Foreign Language (EFL) contexts. In an effort to broaden this research base, the current study closely replicates a…

Reading comprehension constitutes an important part of the Chinese National Matriculation English Test (NMET) which influences English teaching practice greatly. Despite the focus of many studies on NMET reforms, content validity, and washback effects, there remains a notable gap in research regarding the genre of reading texts in NMET. Drawing on…