This study applied the Mixed Rasch Model (MRM) to the listening comprehension section of the International English Language Testing System (IELTS) to detect latent class differential item functioning (DIF) by exploring multiple profiles of second/foreign language listeners. Item responses of 462 examinees to an IELTS listening test were subjected…

There has been much debate in assessment research about the inclusion of Global English accents in high-stakes listening tests. This study explored test-takers' attitudes toward the inclusion of different English accents in the Duolingo English Test (DET) 2021 test version and their associations with listening test scores. One hundred sixty…

Based on 312 samples, this study investigated the relationship between two dimensions of L2 vocabulary knowledge (VK) and listening comprehension (LC) by comparing written and oral vocabulary measurements and further examined the mediating effect of L2 vocabulary fluency (VF) by using Bootstrapping and Monte Carlo Method. Results show that: (1)…

The article offers an in-depth lexical analysis of the listening sub-test of the famous International English Language Testing System (IELTS). The vocabulary profile of 239 listening transcripts from 60 IELTS official practice tests were analyzed. The results showed that, 3,000 most frequent word families in the British National Corpus/Corpus of…

This mixed-methods study examined the effectiveness of Rosetta Stone, a mobile-based language learning application, on Chinese EFL students' listening, speaking, foreign language enjoyment (FLE), and foreign language anxiety (FLA). Two groups of intermediate Chinese EFL students from a language institute, with 33 students in the control group and…

The aim of the present study was to evaluate the effectiveness of listening strategy instruction on second language (L2) listening comprehension ability, listening anxiety, and listening self-efficacy of Iranian English as a foreign language (EFL) learners. To this end, a sample of 52 English major learners of two intact classes from a university…

High stakes testing, such as IELTS, is designed to select individuals for decision-making purposes (Fulcher, 2013b). Hence, there is a slow-growing stream of research investigating the subskills of IELTS listening and, in feedback terms, its effects on individuals and educational programs. Here, cognitive diagnostic assessment (CDA) performs it…

The aim of this study was to investigate how test methods affect listening test takers' performance and cognitive load. Test methods were defined and operationalized as while-listening performance (WLP) and post-listening performance (PLP) formats. To achieve the goal of the study, we examined test takers' (N = 80) brain activity patterns…

Background: In many universities, undergraduate engineering students are taught in English rather than their first language. This requires the crucial skill of academic listening, but many students have limited linguistic knowledge and skills, necessitating additional scaffolding by instructors. Purpose: The purpose of this study was thus…

I analyzed a corpus of the international English language testing system (IELTS) comprising 256 listening sections (1996-2021). The primary objective of the study was to gain insights into the assumptions made by test designers regarding the real-life contexts that test-takers will encounter. Overall, 15 superordinate topic areas and 300 subtopics…

Scholars have argued for the inclusion of different spoken varieties of English in high-stakes listening tests to better represent the global use of English. However, doing so may introduce additional construct-irrelevant variance due to accent familiarity and the shared first language (L1) advantage, which could threaten test fairness. However,…

This study investigated the effect of the Metacognitive Intervention (MI) on the listening performance and metacognitive awareness of upper-intermediate learners of English as a Foreign Language (EFL) with low Working Memory Capacity (WMC). 136 male learners aged between 15 and 25 years formed the original pool of this study, and 94 were…

Corpus-based studies have offered the domain definition inference for test developers. Yet, corpus-based studies on temporal fluency measures (e.g., speech rate) have been limited, especially in the context of academic lecture settings. This made it difficult for test developers to sample representative fluency features to create authentic…

A critical component of cognitive diagnostic models (CDMs) is a Q-matrix that stipulates associations between items of a test and their required attributes. The present study aims to develop and empirically validate a Q-matrix for the listening comprehension section of the International English Language Testing System (IELTS). To this end, a…

This study examines four learner engagement dimensions (behavioural, cognitive, emotional and social) in pedagogical task performance and provides insights into the effects of two task types (information-seeking and direction-giving) and topic familiarity on learner engagement in a semester-long English course. A total of 28 foreign language…