This controlled experimental study investigated the interaction of variables associated with rating the pronunciation component of high-stakes English-language-speaking tests such as IELTS and TOEFL iBT. One hundred experienced raters who were all either familiar or unfamiliar with Brazilian-accented English or Papua New Guinean Tok Pisin-accented…

This study looked at how practically ASR-based interactive video assignments can be integrated into EFL classrooms for additional out-of-class speaking practice, and what effects it will have on students. We created an ASR-based interactive video assignment using Google Scripts and gave it to students as a homework assignment between lessons in…

Drawing on the framework of invariant measurement from Rasch measurement theory, the purpose of this study is to psychometrically evaluate the 20 language and teaching skill domains of the International Teaching Assistant (ITA) Test using the many-facet Rasch model and to empirically explore performance differences between females and males in…

The present study investigated the efficacy of segmental/suprasegmental vs. holistic pronunciation instruction in the development of listening comprehension skills by EFL learners, using a pre-test post-test design. Six groups of 20 intermediate EFL learners at a university in Iran took part in the study, all groups receiving the same amount of…

Educators of International Teaching Assistants (ITAs) have been overlooked, erroneously. As teacher educators, their work is exponentially important to North American universities. A multiple case study examined three ITA Educators' ideologies, involving data from two interviews -one being a stimulated recall using classroom observations…

There has been much debate in assessment research about the inclusion of Global English accents in high-stakes listening tests. This study explored test-takers' attitudes toward the inclusion of different English accents in the Duolingo English Test (DET) 2021 test version and their associations with listening test scores. One hundred sixty…

This study investigated U.S. undergraduates' perceptions of non-native speakers' (NNS) speech which had received 100% proficiency scores on the TOEFL iBT test. Fifty-five U.S. undergraduates rated 20 speech samples for comprehensibility, accentedness, and acceptability. The speech samples were also analyzed for acoustic fluency. Descriptively,…

The practice of second language (L2) speech perception has traditionally relied on equal-interval perceptual scales and novice listeners' (NLs) impressionistic judgments of constructs such as accentedness and comprehensibility (Munro & Derwing, 2011). However, issues have surfaced with respect to how well NLs can use these scales, whether they…

In the present study, three groups of interpreter trainees were formed, two experimental groups, i.e., blended prosody instruction (BPI) and computer-assisted prosody training (CAPT), and one control group (CON). In this experiment the participants took part in a four-week teaching program for 16 sessions (60 minutes per session), i.e., 16 hours…

This study examined the impact of the manipulated task complexity (Robinson 2001a, 2001b, 2007, 2011; Robinson & Gilabert, 2007) on second language (L2) speech comprehensibility. I examined whether manipulated task complexity (a) impacts L2 speech comprehensibility, (b) aligns with L2 speakers' perception of task difficulty (cognitive…

Various examinations are administered at universities across the US as a means of assessing bilingual/multilingual international teaching assistants' (ITAs') proficiency in spoken English before they are permitted to teach. While such exams are taken by students in a range of academic disciplines, recent research suggests that communicative…

This study critically examined the previously reported partial independence between second language (L2) accentedness (degree to which L2 speech differs from the target variety) and comprehensibility (ease of understanding). In prior work, comprehensibility was linked to multiple linguistic dimensions of L2 speech (phonology, fuency, lexis,…

This study examines the effect of incorporating a variety of international English accents into a simulated TOEFL listening comprehension test in growing recognition of internationalization of language teaching and learning in the field of TESOL. Although some high-stakes English proficiency exams have begun incorporating speech samples produced…

Scholars have argued for the inclusion of different spoken varieties of English in high-stakes listening tests to better represent the global use of English. However, doing so may introduce additional construct-irrelevant variance due to accent familiarity and the shared first language (L1) advantage, which could threaten test fairness. However,…

As a branch of artificial intelligence, automated speech recognition (ASR) technology is increasingly used to detect speech, process it to text, and derive the meaning of natural language for various learning and assessment purposes. ASR inaccuracy may pose serious threats to valid score interpretations and fair score use for all when it is…