This controlled experimental study investigated the interaction of variables associated with rating the pronunciation component of high-stakes English-language-speaking tests such as IELTS and TOEFL iBT. One hundred experienced raters who were all either familiar or unfamiliar with Brazilian-accented English or Papua New Guinean Tok Pisin-accented…

I analyzed a corpus of the international English language testing system (IELTS) comprising 256 listening sections (1996-2021). The primary objective of the study was to gain insights into the assumptions made by test designers regarding the real-life contexts that test-takers will encounter. Overall, 15 superordinate topic areas and 300 subtopics…

Building up on Munro and Derwing, the current study set out to re-examine and generalize the Functional Load (FL) principle (Brown, 1988) as a tool to identify a set of relatively crucial segmental features for successful understanding in L2 communication. In Experiment 1, 40 Japanese learners of English in English-as-Foreign-Language settings…

Drawing on the framework of invariant measurement from Rasch measurement theory, the purpose of this study is to psychometrically evaluate the 20 language and teaching skill domains of the International Teaching Assistant (ITA) Test using the many-facet Rasch model and to empirically explore performance differences between females and males in…

There has been much debate in assessment research about the inclusion of Global English accents in high-stakes listening tests. This study explored test-takers' attitudes toward the inclusion of different English accents in the Duolingo English Test (DET) 2021 test version and their associations with listening test scores. One hundred sixty…

Nonverbal behavior can impact language proficiency scores in speaking tests, but there is little empirical information of the size or consistency of its effects or whether language proficiency may be a moderating variable. In this study, 100 novice raters watched and scored 30 recordings of test takers taking an international, high stakes…

The current paper examined the impact of Dynamic Assessment (DA) on the speaking skills of EFL learners applying socio-cultural theory, which was developed by Vygotsky (1934). The study also tried to compare the results from online synchronous DA sessions, which were done in the form of one-to-one online training over Google Meet, with the results…

Various examinations are administered at universities across the US as a means of assessing bilingual/multilingual international teaching assistants' (ITAs') proficiency in spoken English before they are permitted to teach. While such exams are taken by students in a range of academic disciplines, recent research suggests that communicative…

Scholars have argued for the inclusion of different spoken varieties of English in high-stakes listening tests to better represent the global use of English. However, doing so may introduce additional construct-irrelevant variance due to accent familiarity and the shared first language (L1) advantage, which could threaten test fairness. However,…

Willingness to communicate (WTC) has recently been researched as a dynamic variable, with some investigations viewing it as a complex dynamic system (CDS). One important property associated with CDS is the notion of attractor states, which are characterized by stable patterns of behavior. The present study employed an idiodynamic method to monitor…