Making inferences about a test taker's language ability has been a concern for language testers. Defining language ability in a speaking test is made difficult because the construct involves factors within and beyond the test taker. One underlying factor is the use of strategies. This study probes test takers' strategic processes and their use in…

Purpose: This study compared perception of consonants in medial position by preschoolers, with and without speech sound disorder (SSD), with similar vocabulary and language skills. In addition, we investigated the association between speech perception and production skills. Method: Participants were 36 monolingual English-speaking children with…

This report briefly reviews the design and scoring procedure for the "TOEIC"® Speaking test and summarizes existing evidence about the consistency of TOEIC Speaking test scores. It then describes several analyses conducted using generalizability theory to provide additional information about the consistency of scores across different…

Intensive English programs (IEPs) strive to make certain that international students have sufficient levels of speaking ability, which is typically assessed through a combination of different tasks. One drawback of including multiple tasks is that the development, administration, and scoring might not be practical. Therefore, it is important to…

Purpose: The purpose of this study was to evaluate, over 2 separate school years, the school-district-wide failure rate of kindergartners on a screener of grammatical tense marking--the Rice Wexler Test of Early Grammatical Impairment (TEGI) Screening Test (Rice & Wexler, 2001)--composed of past tense (PT) and third-person singular (3S)…

This paper reviews the International English Language Testing System's speaking sub-test in the East Asia region with reference to theoretical and practice-based perspectives and identifies future research opportunities to enhance the measures of test qualities found. The test's construct validity was seen to accurately measure the abilities…

Purpose: Children with developmental language disorder sometimes spontaneously repeat clinician models of morphemes targeted for treatment. We examine how spontaneous repeating of clinician models in the form of recasts associates with improved child production of those emerging morphemes. Method: Forty-seven preschool children with developmental…

The literature on task planning abounds with studies in laboratory or classroom contexts; however, the contribution of task planning to the testing context has remained a largely uncharted area of enquiry. The current study is primarily focused on exploring the impacts of pressured vs. unpressured on-line task planning conditions on EFL students'…

Purpose: Item response theory (IRT) is a psychometric approach to measurement that uses latent trait abilities (e.g., speech sound production skills) to model performance on individual items that vary by difficulty and discrimination. An IRT analysis was applied to preschoolers' productions of the words on the Goldman-Fristoe Test of…

A retrospective review of initial early intervention and early childhood special education (EI/ECSE) evaluation reports was completed to identify practices specific to the evaluation of Latinx children's communication development. A records abstraction approach employed entailed a random selection of 294 EI/ECSE evaluation reports completed in…

This article provides an overview and evaluation of the uses--actual and potential--of automatic speech recognition (ASR) and spoken dialogue systems (SDS), related technologies that can be applied to second language speaking assessment, given particular definitions of the construct. Both technologies have only gradually moved in the direction of…

Purpose: This review evaluated whether 9 single-word tests of phonological error patterns provide adequate content coverage to accurately identify error patterns that are active in a child's speech. Method: Tests in the current study were considered to display sufficient opportunities to assess common phonological error patterns if they…

For educational tests, it is critical to maintain consistency of score scales and to understand the sources of variation in score means over time. This practice helps to ensure that interpretations about test takers' abilities are comparable from one administration (or one form) to another. This study examines the consistency of reported scores…

This report presents an overview of the "SpeechRater"? automated scoring engine model building and evaluation process for several item types with a focus on a low-English-proficiency test-taker population. We discuss each stage of speech scoring, including automatic speech recognition, filtering models for nonscorable responses, and…

Integrated speaking test tasks (integrated tasks) provide reading and/or listening input to serve as the basis for test-takers to formulate their oral responses. This study examined the influence of topical knowledge on integrated speaking test performance and compared independent speaking test performance and integrated speaking test performance…