This report, which is based on an invited presentation given at the 2015 meeting of the Association of Test Publishers, is a response to the continuing proliferation of scale linking studies that have occurred since the publication of "Uncommon Measures" in 1999.The report has four parts. First, I restate the conclusions made in…

Linking scores from the National Assessment of Educational Progress (NAEP) to statewide test results was studied. Results based on an equipercentile procedure suggest that such a link does not provide precise information. Information from a linking study should be limited to rough estimates of students in each NAEP achievement level. (SLD)

The U.S. Department of Education has not yet published an official guidance document for using NAEP achievement level scores to confirm state testing results. A review of the literature, however, identified four principles that inform the valid use of NAEP scores in a confirming analysis. The principles address the appropriate NAEP statistics to…

This study examined two major questions: do national and state assessments provide consistent information on the performance of state education systems, and what accounts for discrepancies between national and state assessment results if they are found? Data came from national and state assessments in grade 4 and grade 8 mathematics from 1992 to…

The National Assessment Governing Board has recognized the need to study associated policy and technical issues to ensure that the National Assessment of Educational Progress (NAEP) is ready to do the best job possible if called on to confirm the results of state achievement testing under the No Child Left Behind Act. This report describes the…

Reanalysis of data from the National Assessment of Educational Progress continues to support the position that high-stakes tests do not do much to improve academic achievement. Data indicate that the extent to which states with high-stakes tests outperform those without remains indeterminable. (SLD)

This study addressed statistical techniques that might ameliorate some of the sampling problems currently facing states with small populations participating in State National Assessment of Educational Progress (NAEP) assessments. The study explored how the application of finite population correction factors to the between-school component of…

This report contains state and school district student testing results for the Oklahoma Testing Program for the 1998-99 school year. Several benchmarks are reported, including the Iowa Tests of Basic Skills (ITBS), Oklahoma Core Curriculum Tests (OCCT), and American College Test Assessment (ACT) results. The National Assessment of Educational…

State mandated tests are being implemented in the public schools, but states differ greatly in the complexity of their tests, making comparisons very difficult. States may have widely different definitions of what counts as proficient, and it is evident that state standards are set arbitrarily. It is also important to consider the relationship of…

Maryland participated in the State National Assessment of Educational Progress (NAEP) in 1996 and 1998 when samples of approximately 2,500 fourth and eighth graders in 100 schools participated in the testing sessions for mathematics (1996) and reading (1998). This report is an initial attempt to return information to Maryland about the relations…

This paper is based on guidelines developed in 1989 for training workshops for state and local educators to demonstrate the processes by which performance assessments could be created, validated, and used in statewide assessment programs. These guidelines are based on work with the National Assessment of Educational Progress and several statewide…

This document comments on the future of educational testing in the United States and the plans of the Bush administration for increased use of testing for educational accountability. The "achievement gap" does not appear to be closing. One of the keys to closing the gap is having the data to understand it so that teachers can use test…

A systematic analysis of student assessment data from Maine and Kentucky, using National Assessment of Educational Progress (NAEP) data and state and local assessment results, was conducted to address issues of measurement and attribution involved in evaluating systemic school reform. This paper (1) examines ways to cope with the challenges of…

The steady growth of state testing programs and its implications for the measurement community are discussed in terms of testing purposes (monitoring, accountability, and curriculum advancement) and test development, administration, and reporting. It is important that the measurement community address crucial issues to maintain its substantial…

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…