This study revisits the roles of different aspects of phonological vocabulary knowledge in second language (L2) listening. Japanese learners of English (n = 114) completed the TOEIC Listening test and three phonological vocabulary tests assessing (a) ability to recognize the meanings of aural forms (meaning recognition), (b) ability to recall the…

Second language (L2) listening comprehension is a function of many variables. We focused on metacognitive awareness, which we measured using the Metacognitive Awareness Listening Questionnaire (MALQ; Vandergrift et al., 2006), and meta-analyzed (a) the factor structure of the MALQ and (b) the relationship between metacognitive awareness and L2…

The present study examines the impact of implementing video captioning and subtitles on listening comprehension with special reference to the speaker's speed. A total of 64 undergraduate Saudi EFL learners were assigned into six groups: fast speaker with full captioning, fast speaker with subtitles, fast speaker with no captioning nor subtitles,…

The principle of fairness in testing traditionally involves an assertion about the absence of bias, or that measurement should be impartial (i.e., not provide an unfair advantage or disadvantage), across groups of test takers. In more general-purposes language testing, a test taker's background knowledge is not typically considered relevant to the…

In response to the calls for making key stakeholders' perspectives relevant in the test validation process, the study discussed in this report sought test-taker feedback as part of collecting validity evidence and supporting the ongoing field testing efforts of the new "TOEFL ITP"® Speaking section. Specifically, I aimed to investigate…

Using standardized tests such as paper-based TOEFL with three subtests for classroom assessment is restricted by the length of the test, which is usually longer than the class duration. Therefore, it is significant to be able to predict other subtests by conducting only one subtest. Therefore, the current study aimed to calculate prediction…

There has been much debate in assessment research about the inclusion of Global English accents in high-stakes listening tests. This study explored test-takers' attitudes toward the inclusion of different English accents in the Duolingo English Test (DET) 2021 test version and their associations with listening test scores. One hundred sixty…

The current study addressed the impact of computerized dynamic assessment (C-DA) on the TOEFL "i"BT listening comprehension test administered to Iranian EFL learners (n = 185) who took part in preparation courses on the TOEFL exam in some language centres in Iran. To mediate the test-takers with hints to process the listening questions,…

In this quasi-experimental study, the effects of lexical coverage through pseudo word manipulation in dialogue comprehension are investigated. Forty-four first-year students in a Japanese university listened to five dialogues at different lexical coverage levels: 98%, 95%, 90%, 85%, and 83%. The results of the comprehension tests confirm the…

The current study explores the impact of varying multiple-choice question preview and presentation formats in a test of second language listening proficiency targeting different levels of text comprehension. In a between-participant design, participants completed a 30-item test of listening comprehension featuring implicit and explicit information…

This study aims to investigate English as a foreign language (EFL) learners' use of context information under various noise conditions. The participants were seven Japanese undergraduate students. A noise test adopted from the Speech-Perception-in-Noise (SPIN) test (Kalikow et al., 1977) was used. Four signal-to-noise ratio (SNR) conditions (SNR =…

Distractors in tests are included to divert attention away from correct answers choices. Knowing what types of distractors commonly appear in tests will benefit test takers as they can prepare themselves beforehand. Therefore, this qualitative study was aimed at making assumptions on plausible lexical distractors which are expected to appear in…

This study aimed to answer an ongoing validity question related to the use of nonstandard English accents in international tests of English proficiency and associated issues of test fairness. More specifically, we examined (1) the extent to which different or shared English accents had an impact on listeners' performances on the Duolingo listening…

Many universities in Korea have implemented teaching TOEIC based courses in their core curriculums as a result of the increased popularity of the TOEIC test. With the assumption that reading and listening scores are inter-related with each other, a focus of this study is to find the distribution patterns of the reading comprehension (RC) and the…

Tests are often applied to evaluate students' academic performance in all educational contexts. In order to be successful in the tests, students are required not only to possess the knowledge of the subject, but also test-taking strategies which enable them to gain higher test score. The present study was aimed at investigating the relationship…