When performing large scale evaluations (e.g., on a state-wide or national level) it may not be possible to administer all items in the item universe to all respondents in the subject population. One method which has been proposed to sample both items and respondents is multiple matrix sampling (MMS) in which a sample of the items is administered…

The National Assessment of Educational Progress (NAEP) has completed two assessments of mathematics, the first conducted in 1972-73 and the second during 1977-78. Each assessment surveyed the mathematics achievement of American 9-, 13-, and 17-year-olds, using a deeply stratified, multi-stage probability sample design. This report documents…

When evaluating the effectiveness of an educational program, multiple matrix sampling is particularly effective and efficient when the goal of the evaluation is estimating group (as opposed to individual) performance. The technique is described in some detail, with its advantages and disadvantages, and examples of its application are given.…

In 1982, the Educational Testing Service (ETS) proposed to implement a new, complex design for the National Assessment of Educational Progress (NAEP). The major features of this design are described in "A New Design for a New Era" (Messick, Beaton, and Lord, 1983). The purpose of this document is to describe the actual implementation of…

This study addressed statistical techniques that might ameliorate some of the sampling problems currently facing states with small populations participating in State National Assessment of Educational Progress (NAEP) assessments. The study explored how the application of finite population correction factors to the between-school component of…

The National Assessment of Educational Progress (NAEP) measures the educational achievement of nationally representative samples of students in grades 4, 8, and 12. Local educational agencies tend to view the NAEP as a benchmark to which the educational achievement of their students can be compared. In particular, state departments of education…

Latent trait model calibration procedures were used on data obtained from a group testing program. The one-parameter model of Wright and Panchapakesan and the three-parameter logistic model of Wingersky, Wood, and Lord were selected for comparison. These models and their corresponding estimation procedures were compared, using actual and simulated…

This document is the users' guide for Version 3.1 of the Public-Use data tapes compiled by the National Assessment of Educational Progress (NAEP), 1983-84. The Public-Use tapes are produced to allow outside researchers access to the NAEP data. The tapes accompanying this guide contain data assessing student achievement in reading and writing at…

This document is the users' guide for Version 1.0 of the Public-Use data tapes compiled by the National Assessment of Educational Progress (NAEP), 1985-86. The Public-Use tapes are produced to allow outside researchers access to the NAEP data. The tapes accompanying this guide, one for grade 3/age 9, one for grade 7/age 13, and one for grade…

The utility of the biomedical model of adjusted statistics is demonstrated. The model is recommended for use by educational researchers to randomize subjects for a more accurate estimate of school programs' success or failure when compared across classrooms or other units. (Author/MH)

This report of the results of the 1974-75 Florida National Assessment Replication in reading and mathematics at the 9-, 13-, and 17-year-old age levels consists of several major parts: an overview of the assessment design and methodology, comparisons of performance levels for groups of Florida students within each age level, comparisons of…