This study applied the Mixed Rasch Model (MRM) to the listening comprehension section of the International English Language Testing System (IELTS) to detect latent class differential item functioning (DIF) by exploring multiple profiles of second/foreign language listeners. Item responses of 462 examinees to an IELTS listening test were subjected…

There has been much debate in assessment research about the inclusion of Global English accents in high-stakes listening tests. This study explored test-takers' attitudes toward the inclusion of different English accents in the Duolingo English Test (DET) 2021 test version and their associations with listening test scores. One hundred sixty…

Based on 312 samples, this study investigated the relationship between two dimensions of L2 vocabulary knowledge (VK) and listening comprehension (LC) by comparing written and oral vocabulary measurements and further examined the mediating effect of L2 vocabulary fluency (VF) by using Bootstrapping and Monte Carlo Method. Results show that: (1)…

The article offers an in-depth lexical analysis of the listening sub-test of the famous International English Language Testing System (IELTS). The vocabulary profile of 239 listening transcripts from 60 IELTS official practice tests were analyzed. The results showed that, 3,000 most frequent word families in the British National Corpus/Corpus of…

I analyzed a corpus of the international English language testing system (IELTS) comprising 256 listening sections (1996-2021). The primary objective of the study was to gain insights into the assumptions made by test designers regarding the real-life contexts that test-takers will encounter. Overall, 15 superordinate topic areas and 300 subtopics…

Scholars have argued for the inclusion of different spoken varieties of English in high-stakes listening tests to better represent the global use of English. However, doing so may introduce additional construct-irrelevant variance due to accent familiarity and the shared first language (L1) advantage, which could threaten test fairness. However,…

Corpus-based studies have offered the domain definition inference for test developers. Yet, corpus-based studies on temporal fluency measures (e.g., speech rate) have been limited, especially in the context of academic lecture settings. This made it difficult for test developers to sample representative fluency features to create authentic…

A critical component of cognitive diagnostic models (CDMs) is a Q-matrix that stipulates associations between items of a test and their required attributes. The present study aims to develop and empirically validate a Q-matrix for the listening comprehension section of the International English Language Testing System (IELTS). To this end, a…

This study examines four learner engagement dimensions (behavioural, cognitive, emotional and social) in pedagogical task performance and provides insights into the effects of two task types (information-seeking and direction-giving) and topic familiarity on learner engagement in a semester-long English course. A total of 28 foreign language…

Language assessment is increasingly computermediated. This development presents opportunities with new task formats and equally a need for renewed scrutiny of established conventions. Recent recommendations to increase integrated skills assessment in lecture comprehension tests is premised on empirical research that demonstrates enhanced construct…

Students of social and natural sciences are expected to achieve different learning outcomes because they employ different language learning strategies and are exposed to different vocabulary. This research was aimed at finding evidence from empirical data to determine whether the differences in learning outcomes are statistically significant. The…

The current study investigates how second language (L2) listening comprehension is associated with three dimensions of L2 vocabulary knowledge: size, depth, and fluency. Vocabulary knowledge tests administered to 290 participants measured L2 auditory vocabulary size, depth, and fluency. Afterward, participants took an International English…

This article investigates the effect of different accents on high- and low-proficiency second language (L2) learners. It begins with testing the English listening proficiency of Chinese students and then compares the influence of three accented English (a British accent, an Australian accent and an Indian accent) on their listening scores.…

The purpose of the present study was twofold: (a) to compare the performance of six cognitive diagnostic models, including a general model (GDINA), two non-compensatory models (DINA and NC-RUM), and three compensatory models (ACDM, DINO, and CRUM), at test level to find the best model for describing the underlying interaction among the listening…

The aim of the present study was to evaluate the effectiveness of listening strategy instruction on second language (L2) listening comprehension ability, listening anxiety, and listening self-efficacy of Iranian English as a foreign language (EFL) learners. To this end, a sample of 52 English major learners of two intact classes from a university…