This article proposes that sampling design effects have potentially huge unrecognized impacts on the results reported by large-scale district and state assessments in the United States. When design effects are unrecognized and unaccounted for they lead to underestimating the sampling error in item and test statistics. Underestimating the sampling…

The National Assessment of Educational Progress in-school sampling design is a three-stage stratified design. Stratification variables include region, size of community and socioeconomic status. The three levels of sample selection are Primary Sampling Units (PSUs), schools and students. In general, two and sometimes three PSUs are selected from…

The primary sample for Year 11 of the National Assessment of Educational Progress (NAEP) was selected in March 1979, and was preceded by an 18-month planning effort. During the planning period, research concentrated in five specific areas: sampling frame construction, stratification criteria, efficiency study review, techniques and computer…

The National Assessment of Educational Progress (NAEP) is compared to the two studies of the National Educational Longitudinal Studies (NELS) Program--the National Longitudinal Study of the Class of 1972 (resurveyed in 1973, 1974, 1976, and 1979) and the 1980 High School and Beyond study (partially resurveyed and retested in 1982). The third phase…

This report documents the design and data analysis procedures of the Trial State Assessment Program of the National Assessment of Educational Progress (NAEP). Today the NAEP is the only survey using advanced plausible values methodology that uses a multiple imputation procedure in a psychometric context. The 1990 Trial State Assessment collected…

The operational preparations for the Dutch national assessment program in education started in 1986. The program's aim is to periodically describe the contents of the curriculum in use and the attainment of 8-year-old and 11-year-old students on a national basis by means of surveys. In this paper some of the guiding principles in instrument…

The National Assessment of Educational Progress (NAEP) and the Longitudinal Studies Program (LSP) are major survey projects on educational outcomes performed by the Center for Education Statistics. NAEP is a continuing cross-sectional survey of young Americans' skills, knowledge, and attitudes. The LSP studies follow a sample of students as they…

In 1982, the Educational Testing Service (ETS) proposed to implement a new, complex design for the National Assessment of Educational Progress (NAEP). The major features of this design are described in "A New Design for a New Era" (Messick, Beaton, and Lord, 1983). The purpose of this document is to describe the actual implementation of…

Recent investigations of the extent to which students with disabilities are allowed to participate in major national data collections used in measurement-driven education reform suggest that 40 to 50 percent of students with disabilities are typically excluded from major assessments, although they are included to a greater degree in assessments…

The utility of the biomedical model of adjusted statistics is demonstrated. The model is recommended for use by educational researchers to randomize subjects for a more accurate estimate of school programs' success or failure when compared across classrooms or other units. (Author/MH)

This report of the results of the 1974-75 Florida National Assessment Replication in reading and mathematics at the 9-, 13-, and 17-year-old age levels consists of several major parts: an overview of the assessment design and methodology, comparisons of performance levels for groups of Florida students within each age level, comparisons of…