Linking score scales across different tests is considered speculative and fraught, even at the aggregate level. We introduce and illustrate validation methods for aggregate linkages, using the challenge of linking U.S. school district average test scores across states as a motivating example. We show that aggregate linkages can be validated both…

Opponents of educational choice recycle the same false prophesies of doom without regard to the evidence or the size and scope of the proposals. Part I of this report assesses the validity of choice opponents' predictions that choice policies will lead to significant losses of district school funding and declining academic performance. Part II of…

Ensuring that students are ready for college when they graduate from high school has important implications for students, educators, education policymakers, and other stakeholders. This study focuses on an examination of the relationship between the National Assessment of Educational Progress (NAEP) grade 12 mathematics assessment and college…

This article explores the associations between the achievement of economically disadvantaged students and the presence of state policies that include student achievement in teacher evaluations. We looked at student achievement across all 50 states from 2007 through 2013. A simple comparison of states with and without the policy suggested that…

Educational quality is a way to influence the future of the American economy (Hanushek, 1986). Large-scale assessments are designed to determine quality in education by measuring student achievement. A connection exists between the standards, teachers, and assessments that form a system of accountability within education. State and national…

This study uses high school transcript data from the National Assessment of Educational Progress (NAEP) High School Transcript Study (HSTS) to determine the validity of student-reported high school courses on the NAEP twelfth-grade student questionnaire. Given that the HSTS is not administered as part of every NAEP twelfth-grade assessment,…

As researchers at a testing organization concerned with the appropriate uses and validity evidence for our assessments, we provide an applied perspective related to the issues raised in the focus article. Newton's proposal for elaborating the consensus definition of validity is offered with the intention to reduce the risks of inadequate…

Cognitive validity examines the relationship between what an assessment aims to measure and what it actually elicits from test takers. The present study examined whether multiple-choice items from the National Assessment of Educational Progress (NAEP) grade 12 U.S. history exam elicited the historical thinking processes they were designed to…

Though measures of long-term academic performance trends are valuable to education policy analysts and policymakers, they have been hard to come by at the state level, where most education policy is made. Such data are either nonexistent prior to 1990 or are unrepresentative of statewide student populations. A continuous series of state mean SAT…

Learning standards across the United States have increasingly called for history students to engage in aspects of "historical thinking," a term used to describe the complex disciplinary processes that historians use to make sense of the past. Although students are expected to learn these complex processes, little is known about how to…

In 2011, Indiana lawmakers established a system to evaluate teachers using existing standardized assessments as an indicator of student learning. In this study we examined one component of Indiana's evaluation system to determine whether student knowledge of the test's consequences is predictive of test performance. Using an experimental design,…

Background: Large-scale survey assessments have been used for decades to monitor what students know and can do. Such assessments aim at providing group-level scores for various populations, with little or no consequence to individual students for their test performance. Students' test-taking behaviors in survey assessments, particularly the level…

The judgmental approaches used by the Governing Board to set National Assessment of Educational Progress achievement levels have been the subject of a great deal of controversy and have sometimes led to results that were considered "unreasonable." The NCES requirement that the achievement levels be used on a trial basis and be…

After passage of the Every Student Succeeds Act (ESSA) in 2015, states assumed greater responsibility for designing their own accountability and assessment systems. ESSA requires states to measure "higher order thinking skills and understanding" and encourages the use of open-ended performance assessments, which are essential for…

The article argues that science assessment should change from an item-driven to a construct-driven practice and pay more attention to disciplinary scientific reasoning. It investigates assessment scales developed from a novel theoretical rationale, describing scientific reasoning as three fundamental practices (hypothesizing, experimenting, and…