This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

The 2011 NAEP-TIMSS linking study conducted by the National Center for Education Statistics (NCES) was designed to predict Trends in International Mathematics and Science Study (TIMSS) scores for the U.S. states that participated in 2011 National Assessment of Educational Progress (NAEP) mathematics and science assessment of eighth-grade students.…

The National Assessment of Educational Progress in-school sampling design is a three-stage stratified design. Stratification variables include region, size of community and socioeconomic status. The three levels of sample selection are Primary Sampling Units (PSUs), schools and students. In general, two and sometimes three PSUs are selected from…

The Primary Reading Program was initiated in 117 classrooms in 40 North Carolina schools, to improve the reading achievement of the primary school students. The same number of control classrooms were also selected for comparison. Features of the program included increased funding for instructional materials; use of volunteers and teacher aides for…

The operational preparations for the Dutch national assessment program in education started in 1986. The program's aim is to periodically describe the contents of the curriculum in use and the attainment of 8-year-old and 11-year-old students on a national basis by means of surveys. In this paper some of the guiding principles in instrument…

In 1982, the Educational Testing Service (ETS) proposed to implement a new, complex design for the National Assessment of Educational Progress (NAEP). The major features of this design are described in "A New Design for a New Era" (Messick, Beaton, and Lord, 1983). The purpose of this document is to describe the actual implementation of…

In 1959, the American Institutes for Research (AIR) and the University of Pittsburgh selected a stratified random probability sample of all secondary schools (public, parochial, and private) in the United States, tested all their students in grades 9-12 with a two-day battery of aptitude tests, information tests, tests of ability and achievement,…

The utility of the biomedical model of adjusted statistics is demonstrated. The model is recommended for use by educational researchers to randomize subjects for a more accurate estimate of school programs' success or failure when compared across classrooms or other units. (Author/MH)

This report of the results of the 1974-75 Florida National Assessment Replication in reading and mathematics at the 9-, 13-, and 17-year-old age levels consists of several major parts: an overview of the assessment design and methodology, comparisons of performance levels for groups of Florida students within each age level, comparisons of…