Concurrent classrooms, also called hybrid classrooms, have become a well-liked teaching strategy. Research suggests that face-to-face and online set-ups are best integrated, combining their strengths to create a unique learning experience consistent with the context and intended educational purposes. However, more extensive research still needs to…

Universal screening to predict students' risk for reading problems is a foundational component of the Multi-Tiered Systems of Support framework and is required by law in many US states. School or district administrators are tasked with selecting screening assessments that are both technically adequate and feasible given the resources of their…

A long-standing debate in the testing of listening concerns the authenticity of the listening input. On the one hand, listening texts produced by item writers often lack spoken language characteristics. On the other hand, real-life recordings are often too context-specific to stand alone, or not suitable for item generation. In this study, we…

Full-information item analysis provides item developers and reviewers comprehensive empirical evidence of item quality, including option response frequency, point-biserial index (PBI) for distractors, mean-scores of respondents selecting each option, and option trace lines. The multi-serial index (MSI) is introduced as a more informative…

Background: Diet quality assessment in community health settings is critical to reduce the incidence and improve management of diet-related chronic disease. Unfortunately, understandable and actionable brief dietary screening tools that empower individuals are nearly absent. Purpose: The purpose of this article is to describe two rigorous…

Despite the ease of accessing a wide range of measures, little attention is given to validity arguments when considering whether to use the measure for a new purpose or in a different context. Making a validity argument has historically focused on the intended interpretation and use. There has been a press to consider both the intended and actual…

The growth of computer-based testing over the last two decades has motivated the creation of innovative item formats. It is often argued that technology-enhanced items (TEIs) provide better measurement of test-takers' knowledge, skills, and abilities by increasing the authenticity of tasks presented to test-takers (Sireci & Zenisky, 2006).…

In recent years, language practitioners have paid increasing attention to artificial intelligence (AI)'s role in language programs. This study investigated the impact of AI-assisted language assessment on L2 learners' foreign language anxiety (FLA), attitudes, motivation, and writing skills. The study adopted a sequential exploratory mixed-methods…

The Vocabulary Size Test (VST) measures English learners' decontextualised receptive vocabulary knowledge of written English and has nine bilingual versions with multiple-choice options written in other languages. This study used the English-Japanese version of the VST to investigate the extent to which loanword items were answered correctly by…

Authentic listening increasingly involves being able to pause or replay recordings as needed. In this study, we investigated differences in the reported use of listening strategies and listening anxiety between single-play and self-paced test administration. We also analyzed the interrelationships among first language (L1) literacy skills, second…

This study sought to develop an Academic School Climate Scale measuring students' perceptions of the learning environments at their schools. With a pilot sample of 1,265 students and validation sample of 14,773 students in Grades 4-12 in schools across the U.S., results of EFA and CFA supported a bifactor model with a general factor and three…

To meet graduation requirements, public school students in Florida must participate in and pass any statewide, standardized assessments required for a standard diploma or earn identified concordant scores or comparative scores, as applicable, for the cohort year in which they entered in ninth grade (M-DCPS, 2024). One of the statewide assessments…

Analyzing heterogeneous treatment effects (HTE) plays a crucial role in understanding the impacts of educational interventions. A standard practice for HTE analysis is to examine interactions between treatment status and pre-intervention participant characteristics, such as pretest scores, to identify how different groups respond to treatment.…

Secondary school staff are often tasked with delivering mental health content to students, yet there has been little research on staff confidence to do so. Given the responsibility placed on staff to support student mental health, reliable and valid measures are needed to facilitate assessment of teacher confidence in the classroom and evaluation…

This paper explores what the measures of utterance fluency typically employed in Automatic Speech Evaluation (ASE), i.e. automated speaking assessments, tell us about oral proficiency. 60 Chinese learners of English completed the second part of the speaking section of IELTS and six tasks designed to measure the linguistic knowledge and processing…