This controlled experimental study investigated the interaction of variables associated with rating the pronunciation component of high-stakes English-language-speaking tests such as IELTS and TOEFL iBT. One hundred experienced raters who were all either familiar or unfamiliar with Brazilian-accented English or Papua New Guinean Tok Pisin-accented…

Building up on Munro and Derwing, the current study set out to re-examine and generalize the Functional Load (FL) principle (Brown, 1988) as a tool to identify a set of relatively crucial segmental features for successful understanding in L2 communication. In Experiment 1, 40 Japanese learners of English in English-as-Foreign-Language settings…

Drawing on the framework of invariant measurement from Rasch measurement theory, the purpose of this study is to psychometrically evaluate the 20 language and teaching skill domains of the International Teaching Assistant (ITA) Test using the many-facet Rasch model and to empirically explore performance differences between females and males in…

There has been much debate in assessment research about the inclusion of Global English accents in high-stakes listening tests. This study explored test-takers' attitudes toward the inclusion of different English accents in the Duolingo English Test (DET) 2021 test version and their associations with listening test scores. One hundred sixty…

Nonverbal behavior can impact language proficiency scores in speaking tests, but there is little empirical information of the size or consistency of its effects or whether language proficiency may be a moderating variable. In this study, 100 novice raters watched and scored 30 recordings of test takers taking an international, high stakes…

The current paper examined the impact of Dynamic Assessment (DA) on the speaking skills of EFL learners applying socio-cultural theory, which was developed by Vygotsky (1934). The study also tried to compare the results from online synchronous DA sessions, which were done in the form of one-to-one online training over Google Meet, with the results…

This study critically examined the previously reported partial independence between second language (L2) accentedness (degree to which L2 speech differs from the target variety) and comprehensibility (ease of understanding). In prior work, comprehensibility was linked to multiple linguistic dimensions of L2 speech (phonology, fuency, lexis,…

Scholars have argued for the inclusion of different spoken varieties of English in high-stakes listening tests to better represent the global use of English. However, doing so may introduce additional construct-irrelevant variance due to accent familiarity and the shared first language (L1) advantage, which could threaten test fairness. However,…

Introduction: In recent years, the number of test-takers of international tests of English has grown at an exponential rate. Those whose first language is not English, i.e. non-native English speakers (NNES), constitute the predominant majority of these test-takers, largely based in non-Anglophone contexts. Thus, the state of whether the…

The current study investigated task effects on listener perception of second language (L2) comprehensibility (ease of understanding). Sixty university-level adult speakers of English from 4 first language (L1) backgrounds (Chinese, Romance, Hindi, Farsi), with 15 speakers per group, were recorded performing 2 tasks (IELTS long-turn speaking task…

The purpose of this mixed-methods study was to explore Iranian IELTS candidates' strengths and weaknesses in IELTS Speaking Test in terms of IELTS's four speaking assessment criteria, namely Fluency and Coherence (FlC), Lexical Resource (LR), Grammar Range and Accuracy (GRA), and Pronunciation (Pro). It also aimed to examine the discourse features…

Willingness to communicate (WTC) has recently been researched as a dynamic variable, with some investigations viewing it as a complex dynamic system (CDS). One important property associated with CDS is the notion of attractor states, which are characterized by stable patterns of behavior. The present study employed an idiodynamic method to monitor…

This article investigates the effect of different accents on high- and low-proficiency second language (L2) learners. It begins with testing the English listening proficiency of Chinese students and then compares the influence of three accented English (a British accent, an Australian accent and an Indian accent) on their listening scores.…

At the University of Illinois at Urbana-Champaign (UIUC), the English Placement Test (EPT) is the institutional placement test that is used to place students into appropriate English as a second language (ESL) writing and/or pronunciation service courses. The EPT is used to assess the English ability of newly admitted international undergraduate…

Research in second language speech has often focused on listeners' accent judgment and factors that affect their perception. However, the topic of listeners' application of specific sound categories in their own perceptual judgments has not been widely investigated. The current study explored how listeners from diverse language backgrounds weighed…