"A Practical Guide to Language Assessment" helps educators at every level redefine their approach to language assessment. Grounded in extensive research and aligned with the latest advances in language education, this comprehensive guide introduces foundational concepts and explores key principles in test development and item writing.…

An increasing number of language testing companies are developing and deploying deep learning-based automated essay scoring systems (AES) to replace traditional approaches that rely on handcrafted feature extraction. However, there is hesitation to accept neural network approaches to automated essay scoring because the features are automatically…

Purpose: The purpose of this study is to develop an accurate test scale for vocabulary comprehension ability applicable to Mandarin-speaking preschool children aged 3-5. Methods: First, an initial scale was developed and evaluated using the expert consultation method. Subsequently, 490 typically developing 3-5-year-old Mandarin-speaking children…

This study explores the potential of OpenAI's ChatGPT-4 (gpt-4-0613) as an automated essay scoring (AES) tool in a trial involving 300 essays from an American university's academic English program placement test. Three prompting strategies (minimal/detailed rubric, require/not require rationale, and with/without scoring examples) were tested for…

Purpose: Phonological awareness (PA) is a foundational skill for literacy development and may be impacted in children with cleft palate with or without cleft lip (CP ± L), as studies have reported associations between atypical speech sound production in this population and reduced PA skills. This study examined (a) the relationship between…

Launched in late November 2022, ChatGPT, a large language model chatbot, has garnered considerable attention. However, ongoing questions remain regarding its capabilities. In this study, ChatGPT was used to complete national high school exams in the Netherlands on the topic of English reading comprehension. In late December 2022, we submitted the…

This study examines the impact of teacher metapathy, or teachers' capacity to comprehend and sympathize with students' emotional and cognitive requirements, on the academic outcomes of IELTS applicants, such as total band scores, motivation, and language learning orientation. Ten IELTS teachers from five language training centers and 100 IELTS…

Background: The evidence on the effect of age on the receptive and expressive language skills of individuals with Down syndrome is inconclusive. Recent research highlights the relevance of having tools to detect age-related changes in language skills. Method: Data were collected on 45 adults with Down syndrome. All were assessed with the Peabody…

This study applied the Mixed Rasch Model (MRM) to the listening comprehension section of the International English Language Testing System (IELTS) to detect latent class differential item functioning (DIF) by exploring multiple profiles of second/foreign language listeners. Item responses of 462 examinees to an IELTS listening test were subjected…

It is common to find mixed-format data results from the use of both multiple-choice (MC) and constructed-response (CR) questions on assessments. Dealing with these mixed response types involves understanding what the assessment is measuring, and the use of suitable measurement models to estimate latent abilities. Past research in educational…

This article presents the process of constructing and validating a test of metalinguistic awareness (MLA) for young school children (age 8-10). The test was developed between 2021 and 2023 as part of the MetaLearn research project, financed by The Research Council of Norway. The research team defines MLA as using metalinguistic knowledge at a…

This paper discusses the challenges of defining coherence in the context of oral language assessment literacy and proposes that better understanding of the construct can be achieved through a systemic-functional linguistic lens. Coherence is taken to be a foundational quality of written and spoken discourse and is a standard feature in the…

Cumulative tests have been shown to enhance second language (L2) vocabulary learning by incrementally incorporating both new and previously learned materials in daily or weekly quizzes. In this study, we investigated the role of three factors that could impact the effectiveness of cumulative testing: (a) study time and (b) spaced practice (review…

This paper discusses Texas Examinations of Educator Standards Program Languages Other Than English -- Spanish exam (TExES LOTE - Spanish) and its potential bias, particularly against teacher candidates with Spanish as a heritage language (HL) background. In Texas, most teacher candidates, or college students of Spanish preparing for secondary…

Accurately identifying developmental language disorder (DLD) in students who speak a home language other than English has proven to be an enduring challenge. Consequently, students with DLD miss out on critical interventions, and those who are acquiring their two languages in a typical manner are placed in settings that do not meet their…