In this paper we describe content focused, practical procedures to establish benchmarked performance standards for educational and other tests. To implement our procedures, we identify one or more external benchmark (e.g., NAEP or PISA performance levels, college and career readiness benchmarks); link to the external benchmarks to locate those…

The American media has historically favored conservative critiques when reporting about national history exam results. Utilizing the frameworks of critical media studies and collective memory, this mixed methods study analyzes the media responses to the 2014 National Assessment of Educational Progress (NAEP) United States history exam. Findings…

Would-be citizens must complete a multistep process that includes answering--in person and orally--10 questions selected from 100. These 100 questions range across civics, American government, US history, a bit of geography, and even major holidays and symbols. The revealing 2018 Woodrow Wilson National Fellowship Foundation survey shows that…

Cognitive validity examines the relationship between what an assessment aims to measure and what it actually elicits from test takers. The present study examined whether multiple-choice items from the National Assessment of Educational Progress (NAEP) grade 12 U.S. history exam elicited the historical thinking processes they were designed to…

Learning standards across the United States have increasingly called for history students to engage in aspects of "historical thinking," a term used to describe the complex disciplinary processes that historians use to make sense of the past. Although students are expected to learn these complex processes, little is known about how to…

Test-score data show that both low-income and racial-minority children score lower, on average, on states' elementary-school accountability tests compared with higher-income children or white children. This report explores the relationship between racial and socioeconomic test-score gaps in New England metropolitan areas and two factors associated…

The Every Student Succeeds Act (ESSA), passed into law in 2015, explicitly prohibits the federal government from creating incentives to set national standards. The law represents a major departure from recent federal initiatives, such as Race to the Top, which beginning in 2009 encouraged the adoption of uniform content standards and expectations…

As researchers at a testing organization concerned with the appropriate uses and validity evidence for our assessments, we provide an applied perspective related to the issues raised in the focus article. Newton's proposal for elaborating the consensus definition of validity is offered with the intention to reduce the risks of inadequate…

Educational policy in the United States is highly decentralized. While the federal government subsidizes education across the country, and despite federal initiatives such as the Common Core and the Partnership for Assessment of Readiness for College and Careers to establish national standards and assessments, most states maintain control over the…

The impact of uncertainty about item parameters on test information functions is investigated. The information function of a test is one of the most important tools in item response theory (IRT). Inaccuracy in the estimation of test information can have substantial consequences on data analyses based on IRT. In this article, the major part (called…

The Oregon Statewide Report Card is an annual publication required by law (ORS 329.115), which reports on the state of public schools and their progress towards the goals of the Oregon Educational Act for the 21st Century. The purpose of the Oregon Report Card is to monitor trends among school districts and Oregon's progress toward achieving the…

The Oregon Statewide Report Card is an annual publication required by law (ORS 329.115), which reports on the state of public schools and their progress towards the goals of the Oregon Educational Act for the 21st Century. The purpose of the Oregon Report Card is to monitor trends among school districts and Oregon's progress toward achieving the…

This report measures trends in performance among urban schools receiving federal School Improvement Grant (SIG) awards as part of the American Recovery and Reinvestment Act of 2009 (ARRA). The Council of the Great City Schools aims to document how member districts of the Council of the Great City Schools implemented SIG and specifically what…

Washington, D.C., is leading the transformation of urban public education across the country--at least according to "Time" magazine, which featured D.C. Schools Chancellor Michelle Rhee on its cover, wearing black and holding a broom. But there is nothing remarkably visionary going on in Washington. The model of school reform that is…

Conclusions from an examination of the results of the National Assessment of Educational Progress indicate that it furnishes little help for those involved in the publication of composition textbooks. Four main difficulties in making inferences from the Assessment data on writing are (1) it is not clear why individuals perform as well or as poorly…