There has been much debate in assessment research about the inclusion of Global English accents in high-stakes listening tests. This study explored test-takers' attitudes toward the inclusion of different English accents in the Duolingo English Test (DET) 2021 test version and their associations with listening test scores. One hundred sixty…

Best linear prediction (BLP) and penalized best linear prediction (PBLP) are techniques for combining sources of information to produce task scores, section scores, and composite test scores. The report examines issues to consider in operational implementation of BLP and PBLP in testing programs administered by ETS [Educational Testing Service].

This study examined the impact of the manipulated task complexity (Robinson 2001a, 2001b, 2007, 2011; Robinson & Gilabert, 2007) on second language (L2) speech comprehensibility. I examined whether manipulated task complexity (a) impacts L2 speech comprehensibility, (b) aligns with L2 speakers' perception of task difficulty (cognitive…

Recent technology advancements have increased the prospects for automated spoken language technology to provide feedback on speaking performance. In this study we examined user perceptions of using an automated feedback system for preparing for the TOEFL iBT® test. Test takers and language teachers evaluated three types of machine-generated…

As a branch of artificial intelligence, automated speech recognition (ASR) technology is increasingly used to detect speech, process it to text, and derive the meaning of natural language for various learning and assessment purposes. ASR inaccuracy may pose serious threats to valid score interpretations and fair score use for all when it is…

Purpose: This study examined bilinguals' performance on functional executive function map tasks such as the Zoo Map from the Behavioural Assessment of the Dysexecutive Syndrome and the extent to which working memory, set-shifting, and inhibition measures predicted bilinguals' performance on these tasks. Additionally, we explored the utility of…

Although several studies have explored the effects of task sequencing on second language (L2) production, there is no established set of criteria to sequence tasks for learners in L2 writing classrooms. This study examined the effect of simple ?complex task sequencing manipulated along both resource-directing (± number of elements) and…

The use of integrated tasks to test English-speaking skills raises questions about the impact of comprehension on test score outcomes, and the impact of stimulus materials on test-taker strategic behaviours. This study analysed speaking performances and verbal report data to examine the strategies used by test takers at different levels of…

Multiple test tasks are available for assessing L2 collocation knowledge. However, few studies have investigated the characteristics of a variety of recognition and recall tasks of collocation simultaneously, and most research on L2 collocations has focused on verb-noun and adjective-noun collocations. This study investigates (1) the relative…

Recently, the field of instructed pragmatics has seen a shift of paradigm from the prevailing cognitive approaches to socially-oriented ones, revolving around the notions like collaborative dialogue and sociocultural theory. Drawing on the notion of collaborative dialogue, this study investigates the extent to which teacher's scaffolding and…

In the present study, we take a longitudinal, corpus-based perspective to investigate short-term (over 9 months) linguistic change in the language produced for the spoken and written sections of the "TOEFL iBT"® test by a group of English-as-a-foreign-language (EFL) learners in China. The goal of the study is to identify patterns that…

Jumbled sentence items in language assessment have been criticized by some authors as inauthentic. However, unscrambling jumbled sentences is a common occurrence in real-world communication in English as a lingua franca. Naturalistic inquiry identified 54 instances of jumbled sentence use in daily life in Dubai/Sharjah, where English is widely…

Despite calls for engaging assessments targeting young language learners (YLLs) between 8 and 13 years old, what makes assessment tasks engaging and how such task characteristics affect measurement quality have not been well studied empirically. Furthermore, there has been a dearth of validity research about technology-enhanced speaking tests for…

Despite a growing amount of research on collaborative dialogue during task performance, little attention has been given to the occurrence of collaborative dialogue across task modality and its impact on language development. To expand our current understanding of task modality effects on learning opportunities, we examined the process of engaging…

One of the central considerations in the validity argument for the TOEFL iBT is the relationship between the language on the exam and the language required for university courses. Corpus linguistics has recently been shown to be an effective way to explore this relationship, which can also be considered as an aspect of authenticity. Applying…