The purpose of this National Assessment of Educational Progress (NAEP) Achievement Levels Validity Argument Report is to synthesize evidence currently available to address the validity of the interpretations and uses of the NAEP Achievement Levels. Validity is the extent to which theory and evidence supports or refutes proposed and enacted test…

This paper introduces an approach that uses latent class analysis to identify cut scores (LCA-CS) and categorize respondents based on context scales derived from largescale assessments like PIRLS, TIMSS, and NAEP. Context scales use Likert scale items to measure latent constructs of interest and classify respondents into meaningful ordered…

Linking score scales across different tests is considered speculative and fraught, even at the aggregate level. We introduce and illustrate validation methods for aggregate linkages, using the challenge of linking U.S. school district average test scores across states as a motivating example. We show that aggregate linkages can be validated both…

Rising inequality in the United States has raised concerns about potentially widening gaps in educational achievement by socioeconomic status (SES). Using assessments from LTT-NAEP, Main-NAEP, TIMSS, and PISA that are psychometrically linked over time, we trace trends in SES gaps in achievement for U.S. student cohorts born between 1961 and 2001.…

The Trends in International Mathematics and Science Study (TIMSS) makes it possible to compare the performance of students in the US in Mathematics and Science to the performance of students in other countries. TIMSS uses four international benchmarks for describing student achievement: Low, Intermediate, High, and Advanced. In this study, we…

Rising inequality in the United States has raised concerns about potentially widening gaps in educational achievement by socio-economic status (SES). Using assessments from LTT-NAEP, Main-NAEP, TIMSS, and PISA that are psychometrically linked over time, we trace trends in achievement for U.S. student cohorts born between 1954 and 2001. Achievement…

In the absence of clear incentives, achievement tests may be subject to the effect of slipping where item response functions have upper asymptotes below one. Slipping reduces score precision for higher latent scores and distorts test developers' understandings of item and test information. A multidimensional four-parameter normal ogive model was…

Students' explanations of their mathematical thinking and conclusions have become a greater part of the assessment landscape in recent years. With a sample of 71 fourth-grade students at risk for mathematics learning disabilities, we investigated the relation between student accuracy in comparing the magnitude of fractions and the quality of…

This study finds that, breaking with decades of slow improvement, U.S. reading and math scores on the National Assessment of Educational Progress (NAEP) and other assessments have seen historic declines since most states implemented national Common Core English and math curriculum standards six years ago. This descriptive analysis is designed to…

International large-scale assessments of student achievement such as International Association for the Evaluation of Educational Achievement's Trends in International Mathematics and Science Study (TIMSS) and Progress in International Reading Literacy Study and Organization for Economic Cooperation and Development's Program for International…

This quantitative study examines the correlation between international student achievement test outcomes and national competitiveness rankings. Student achievement data are derived from a variation-adjusted, common-scale metric data set for 74 countries that have participated in any of the international mathematics and science achievement tests…

Concerns about the breadth of the U.S. income distribution and limited intergenerational mobility have led to a focus on educational achievement gaps by socio-economic status (SES). Using intertemporally linked assessments from NAEP, TIMSS, and PISA, we trace the achievement of U.S. student cohorts born between 1954 and 2001. Achievement gaps…

We estimate male-female test score gaps in math and English language arts (ELA) for nearly 10,000 U.S. school districts using state accountability data from third- through eighth-grade students in the 2008-2009 through 2015-2016 school years. We find that the average U.S. school district has no gender achievement gap in math, but there is a gap of…

Comparability studies between CBT and PPT studied if there were score differences between these two versions. However, there were no consistent results across studies and time. The purpose of this study is to summarize the testing mode effects for K-12 mathematics tests by conducting a meta-analysis. 103 effect sizes of 32 studies were collected…

Studies using tests scores as the dependent variable often report point estimates in student standard deviation units. We note that a standard deviation is not a standard unit of measurement since the distribution of test scores can vary across contexts. As such, researchers should be cautious when interpreting differences in the numerical size of…