This article provides a detailed review of the Computer-based English Listening Speaking Test (CELST) used in Guangdong, China, as part of the National Matriculation English Test (NMET) to assess students' English proficiency. The CELST measures listening and speaking skills as outlined in the "English Curriculum for Senior Middle…

The extrapolation of test scores to a target domain - that is, association between test performances and relevant real-world outcomes - is critical to valid score interpretation and use. This study examined the relationship between Duolingo English Test (DET) speaking scores and university stakeholders' evaluation of DET speaking performances. A…

As our understanding of the construct of oral communication (OC) has evolved, so have the possibilities of computer technology undertaking the delivery of tests that measure this ability. It is paramount to understand to what extent such developments lead to accurate, comprehensive, and useful assessment of OC. In this paper, we discuss five…

Purpose: The primary aim of this study was to compare decoding and literacyrelated skills of children with suspected childhood apraxia of speech (sCAS) to children with reading disorders (RD) and no history of speech sound disorder (RD-no SSD) to determine if the groups differ in decoding and the endophenotypes that contribute to RD. We also…

The computer-based College English Test-Spoken English Test (CET-SET) in China incorporates interactional competence in its construct by using a non-face-to-face paired discussion task. To build validity arguments for this unique computer-mediated interactive task, the present study investigated the impact of delivery mode on test performance in…

Fluency in terms of speed of speech and (lack of) hesitations such as silent and filled pauses ('uhm's) is part of oral proficiency. Language assessment rubrics therefore include aspects of fluency. Measuring fluency, however, is highly time-consuming because of the manual labour involved. The current paper aims to automatically measure aspects of…

Purpose: The aim of this study was to examine the concurrent validity of the Fluharty Preschool Speech and Language Screening Test--Second Edition (Fluharty-2; Fluharty, 2001) for mass screenings of language at age 3 years. Method: Participants were sixty-two 3-year-old children, 31 who had failed and 31 who had passed the Fluharty-2. Performance…

Human raters and machine scoring systems potentially have complementary strengths in evaluating language ability; specifically, it has been suggested that automated systems might be used to make consistent measurements of specific linguistic phenomena, whilst humans evaluate more global aspects of performance. We report on an empirical study that…

The extensive use of automated speech scoring in large-scale speaking assessment can be revolutionary not only to test design and rating, but also to the learning and instruction of speaking based on how students and teachers perceive and react to this technology. However, its washback remained underexplored. This mixed-method study aimed to…

As automated scoring systems for spoken responses are increasingly used in language assessments, testing organizations need to analyze their performance, as compared to human raters, across several dimensions, for example, on individual items or based on subgroups of test takers. In addition, there is a need in testing organizations to establish…

Internationally educated nurses' (IENs) English language proficiency is critical to professional licensure as communication is a key competency for safe practice. The Canadian English Language Benchmark Assessment for Nurses (CELBAN) is Canada's only Canadian Language Benchmarks (CLB) referenced examination used in the context of healthcare…

Purpose: We examined the effects of physiological arousal on speech motor control and speech motor practice effects in preschool-age children who do (CWS) and do not stutter (CWNS). Method: Participants included 18 CWS (M[subscript age] = 4 years 5 months) and 18 age- and gender-matched CWNS. The participants repeated a phrase "buy bobby a…

Severity and centrality are two main kinds of rater effects posing threats to the validity and fairness of performance assessments. Adopting Jin and Wang's (2018) extended facets modeling approach, we separately estimated the magnitude of rater severity and centrality effects in the web-based TestDaF (Test of German as a Foreign Language) writing…

Introduction: The current work presents a framework of motoric complexity where stimuli differ according to movement elements across a sound sequence (i.e., consonant transitions and vowel direction). This framework was then examined in children with childhood apraxia of speech (CAS), other speech sound disorders (SSDs), and typical development…

Purpose: This study aimed to identify predictors of response to treatment for residual speech sound disorder (RSSD) affecting English rhotics. Progress was tracked during an initial phase of traditional motor-based treatment and a longer phase of treatment incorporating ultrasound biofeedback. Based on previous literature, we focused on baseline…