The current study examined the criterion validity of a computer adaptive universal screener with an end-of-year state mathematics assessment using extant data provided by a local education agency. Participants included 1,195 third through eighth graders. Correlational analyses were used to report predictive and concurrent validity coefficients for…

The purpose of this National Assessment of Educational Progress (NAEP) Achievement Levels Validity Argument Report is to synthesize evidence currently available to address the validity of the interpretations and uses of the NAEP Achievement Levels. Validity is the extent to which theory and evidence supports or refutes proposed and enacted test…

Using data from students in Grades 3-8 in school years 2018-2019 (N = 1,871) and 2021-2022 (N = 1,740), we examined the strength of fall math screening using Measures of Academic Progress (MAP) for predicting end-of-year state math assessment performance levels and whether this prediction varied across English language proficiency (ELP). In…

Using expert reviews and item response theory (IRT), this study evaluated the language- and culture-related construct-irrelevant variance and reliability of the 2019 TIMSS sense of school belonging scale (SSBS) for grades 4 and 8. The five items of the SSBS, which were identical for both grades, were reviewed for the language- and culture-related…

This study evaluated the forecasting accuracy of trend estimation methods applied to time-series data from computer adaptive tests (CATs). Data were collected roughly once a month over the course of a school year. We evaluated the forecasting accuracy of two regression-based growth estimation methods (ordinary least squares and Theil-Sen). The…

Large scale international assessments depend on invariance of measurement across countries. An important consideration when observing cross-national differential item functioning (DIF) is whether the DIF actually reflects a source of bias, or might instead be a methodological artifact reflecting item response theory (IRT) model misspecification.…

This study sought to develop an Academic School Climate Scale measuring students' perceptions of the learning environments at their schools. With a pilot sample of 1,265 students and validation sample of 14,773 students in Grades 4-12 in schools across the U.S., results of EFA and CFA supported a bifactor model with a general factor and three…

We present two types of validity evidence to support inferences and decisions about use of easyCBMs in relation to state testing programs. The first type involves the use of Benchmarks in reading to use in making predictions of performance on the Smarter Balanced (SB) test. These predictions can be made both well in advance (several months) or…

This paper presents results of a score interpretation study for a computer adaptive mathematics assessment. The study purpose was to test the efficacy of item developers' alignment of items to Range Achievement-Level Descriptors (RALDs; Egan et al.) against the empirical achievement-level alignment of items to investigate the use of RALDs as the…

Linking score scales across different tests is considered speculative and fraught, even at the aggregate level. We introduce and illustrate validation methods for aggregate linkages, using the challenge of linking U.S. school district average test scores across states as a motivating example. We show that aggregate linkages can be validated both…

Surveying is a common methodology in science education research, including cross-national and cross-cultural comparisons. The literature surrounding students' attitudes toward science, in particular, illustrates the prevalence of efforts to translate instruments with the eventual goal of comparing groups. This paper utilizes survey data from a…

Previous research suggests that non-cognitive factors play an important role in promoting success at school and beyond, aligning with the multifaceted goals of education. Enhancing students' attitudes to learning in school is expected to have positive impacts on various schooling outcomes. To date, very few studies have focused on measuring and…

Abundant research has pointed to the importance of non-cognitive skills for success in life. This paper describes the development and validation of the "UiL", designed to measure 19 non-cognitive skills that have been identified as being important for school children in Denmark. First, we describe the development of the scales, and then…

This in-brief technical report documents the results from two different analytic approaches for examining the reliability of the slope for easyCBM® reading measures in Grades K-8. Results varied by grade, assessment measure, and the analytic approach. Results patterns are discussed.

Behavioral and emotional problems among children and adolescents can lead to numerous negative outcomes without intervention. From a prevention standpoint, screening for behavioral and emotional risk is an important step toward identifying such problems before the point of diagnosis or referral. The present study conducted a k-means cluster…