This report, which is based on an invited presentation given at the 2015 meeting of the Association of Test Publishers, is a response to the continuing proliferation of scale linking studies that have occurred since the publication of "Uncommon Measures" in 1999.The report has four parts. First, I restate the conclusions made in…

The U.S. Department of Education has not yet published an official guidance document for using NAEP achievement level scores to confirm state testing results. A review of the literature, however, identified four principles that inform the valid use of NAEP scores in a confirming analysis. The principles address the appropriate NAEP statistics to…

The National Assessment Governing Board has recognized the need to study associated policy and technical issues to ensure that the National Assessment of Educational Progress (NAEP) is ready to do the best job possible if called on to confirm the results of state achievement testing under the No Child Left Behind Act. This report describes the…

Maryland participated in the State National Assessment of Educational Progress (NAEP) in 1996 and 1998 when samples of approximately 2,500 fourth and eighth graders in 100 schools participated in the testing sessions for mathematics (1996) and reading (1998). This report is an initial attempt to return information to Maryland about the relations…

This document comments on the future of educational testing in the United States and the plans of the Bush administration for increased use of testing for educational accountability. The "achievement gap" does not appear to be closing. One of the keys to closing the gap is having the data to understand it so that teachers can use test…

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…

The 1972 assessment activities in the Massachusetts schools concentrated on the areas of citizenship and science, utilizing two seventh grade samples of 10,000 students each, with each group completing only one assessment form. The testing program utilized National Assessment Items for age 13, as well as a few items from the Measurement Research…

Texas students have made extraordinarily large gains on statewide achievement tests, the Texas Assessment of Academic Skills (TAAS), gains so dramatic that they have been dubbed the "Texas miracle." There is general agreement that these gains are attributable to the high stakes accountability system in Texas, but there is some question…

This paper explores the federal role in the development of state accountability systems for secondary school achievement. The first section of the paper examines seven suggested proximate causes for the poor performance of U.S. secondary school students. This section concludes that the causes for the relatively poor performance of U.S. secondary…

This study considered two questions about the use of national and state assessment databases: (1) Do state and national assessments provide the same information on the performance of an educational system? and (2) What are the factors that might affect the discrepancies between national and state assessment results? Kentucky and Maine were chosen…

Political and legislative pressures have posed a number of measurement issues and challenges to the development of sound, valid voluntary national tests (VNTs). This paper focuses on what appear to be the most difficult technical issues related to the VNT proposed by President Clinton in 1997. Technical issues refer to psychometric issues, as…

High stakes testing is associated with controversy and dialogue in this era of calls for accountability on the part of educators, and the controversy has been strengthened by the national testing plans included in the Leave No Child Behind Act (Elementary and Secondary Education Act of 2001). A look at the literature on high stakes testing and…

This paper is the first of a series that will compare estimates of error that arises when state assessments are linked to the National Assessment of Educational Progress (NAEP). Different forms of linkage are discussed. Comparisons are made between whole-sample regression, repeated half-sample replication, bootstrap, and jackknife estimates of the…

The adequacy of linking statewide standardized test results to the National Assessment of Educational Progress by using equipercentile equating procedures was investigated using statewide mathematics data from four states. Results suggest that the linkings are not sufficiently trustworthy to make comparisons based on the tails of the distribution.…

The National Assessment of Educational Progress (NAEP) measures the educational achievement of nationally representative samples of students in grades 4, 8, and 12. Local educational agencies tend to view the NAEP as a benchmark to which the educational achievement of their students can be compared. In particular, state departments of education…