The National Assessment of Educational Progress (NAEP) has tested the civic, or citizenship knowledge of students across the nation at irregular intervals since its very inception. Despite advancements in reading and mathematics, evidenced by results from the National Assessment of Educational Progress (NAEP), civics proficiency has remained…

Scoring procedures for the constructed-response (CR) items in large-scale mixed-format educational assessments often involve checks for rater agreement or rater reliability. Although these analyses are important, researchers have documented rater effects that persist despite rater training and that are not always detected in rater agreement and…

Physical activity can meaningfully influence educational outcomes. However, physical activity among youth remains insufficient (World Health Organization, 2018).Youth who are not physically active are more likely to encounter chronic health issues including obesity, depression, and anxiety (Bartelink et al., 2019, Bélair et al., 2018, Krebs,…

Educators struggle to assess various aspects of reading in valid and reliable ways. Whether it is comprehension, phonological awareness, vocabulary, or phonics, determining appropriate assessments is challenging across grade levels and student abilities. Also challenging is measuring aspects of fluency: rate, accuracy, and prosody. This article…

Process Analysis is an emerging approach to discover meaningful knowledge from temporal educational data. The study presented in this paper shows how we used Process Analysis methods on the National Assessment of Educational Progress (NAEP) test data for modeling and predicting student test-taking behavior. Our process-oriented data exploration…

Linking score scales across different tests is considered speculative and fraught, even at the aggregate level (Feuer et al., 1999; Thissen, 2007). We introduce and illustrate validation methods for aggregate linkages, using the challenge of linking U.S. school district average test scores across states as a motivating example. We show that…

Comparability studies between CBT and PPT studied if there were score differences between these two versions. However, there were no consistent results across studies and time. The purpose of this study is to summarize the testing mode effects for K-12 mathematics tests by conducting a meta-analysis. 103 effect sizes of 32 studies were collected…

Trend estimation in international comparative large-scale assessments relies on measurement invariance between countries. However, cross-national differential item functioning (DIF) has been repeatedly documented. We ran a simulation study using national item parameters, which required trends to be computed separately for each country, to compare…

Video games have become a popular medium in our society, and recent scholarship suggests that games can support substantial learning. This study stems from a project in which we created a video game enabling students to use biotechnology to solve a societal problem. As students engaged in the game, they necessarily interacted with the underlying…

Some form of a short interrupted time series (ITS) is often used to evaluate state and national programs. An ITS design with a single treatment group assumes that the pretest functional form can be validly estimated and extrapolated into the postintervention period where it provides a valid counterfactual. This assumption is problematic. Ambiguous…

"Taking Stock and Pushing Forward" (2014) reports states' progress toward the Challenge to Lead 2020 Goals for Education. State-specific documents report on student achievement as well as essential state policies to improve it. Among the many metrics: how states are improving achievement on NAEP, high school graduation rates, and access…

"Taking Stock and Pushing Forward" (2014) reports states' progress toward the Challenge to Lead 2020 Goals for Education. State-specific documents report on student achievement as well as essential state policies to improve it. Among the many metrics: how states are improving achievement on NAEP, high school graduation rates, and access…

"Taking Stock and Pushing Forward" (2014) reports states' progress toward the Challenge to Lead 2020 Goals for Education. State-specific documents report on student achievement as well as essential state policies to improve it. Among the many metrics: how states are improving achievement on NAEP [National Assessment of Educational…

"Taking Stock and Pushing Forward" (2014) reports states' progress toward the Challenge to Lead 2020 Goals for Education. State-specific documents report on student achievement as well as essential state policies to improve it. Among the many metrics: how states are improving achievement on NAEP [National Assessment of Educational…

"Taking Stock and Pushing Forward" (2014) reports states' progress toward the Challenge to Lead 2020 Goals for Education. State-specific documents report on student achievement as well as essential state policies to improve it. Among the many metrics: how states are improving achievement on NAEP [National Assessment of Educational…