The work reported in this paper reflects a collaborative effort of many individuals representing multiple organizations. It began during a session at the October 2008 meeting of TILSA when a representative of a member state asked the group if any of their programs had experienced unexpected fluctuations in the annual state assessment scores, and…

In large-scale assessments, such as state-wide testing programs, national sample-based assessments, and international comparative studies, there are many steps involved in the measurement and reporting of student achievement. There are always sources of inaccuracies in each of the steps. It is of interest to identify the source and magnitude of…

Educational assessment and, more broadly, educational research in the United States have entered into an era characterized by a dramatic increase in the prevalence and importance of test score use in accountability systems. This volume covers a selection of contemporary issues about testing science and practice that impact the nation's public…

Political and legislative pressures have posed a number of measurement issues and challenges to the development of sound, valid voluntary national tests (VNTs). This paper focuses on what appear to be the most difficult technical issues related to the VNT proposed by President Clinton in 1997. Technical issues refer to psychometric issues, as…

The National Assessment of Educational Progress (NAEP) measures the educational achievement of nationally representative samples of students in grades 4, 8, and 12. Local educational agencies tend to view the NAEP as a benchmark to which the educational achievement of their students can be compared. In particular, state departments of education…

The redesign of the National Assessment of Educational Progress (NAEP) has resulted in improved usefulness of the data set to conduct policy relevant research on Hispanic student achievement. Improvements include changing the procedure for ethnic identification to self-reporting, modifying sample selection, and planning for the conduct of special…

The National Assessment of Educational Progress (NAEP) has completed two assessments of mathematics, the first conducted in 1972-73 and the second during 1977-78. Each assessment surveyed the mathematics achievement of American 9-, 13-, and 17-year-olds, using a deeply stratified, multi-stage probability sample design. This report documents…

The measurement dilemmas involved in assessing the national educational goals established by the President and governors at the 1989 education summit are discussed. The first and most important choice is what to assess and whether to align assessment to the vision of curriculum reform or to the curriculum that students are actually experiencing.…

In 1982, the Educational Testing Service (ETS) proposed to implement a new, complex design for the National Assessment of Educational Progress (NAEP). The major features of this design are described in "A New Design for a New Era" (Messick, Beaton, and Lord, 1983). The purpose of this document is to describe the actual implementation of…

This document is the users' guide for Version 3.1 of the Public-Use data tapes compiled by the National Assessment of Educational Progress (NAEP), 1983-84. The Public-Use tapes are produced to allow outside researchers access to the NAEP data. The tapes accompanying this guide contain data assessing student achievement in reading and writing at…

This document is the users' guide for Version 1.0 of the Public-Use data tapes compiled by the National Assessment of Educational Progress (NAEP), 1985-86. The Public-Use tapes are produced to allow outside researchers access to the NAEP data. The tapes accompanying this guide, one for grade 3/age 9, one for grade 7/age 13, and one for grade…

The utility of the biomedical model of adjusted statistics is demonstrated. The model is recommended for use by educational researchers to randomize subjects for a more accurate estimate of school programs' success or failure when compared across classrooms or other units. (Author/MH)

Results of the seventh year of testing by the Pupil Assessment Program of the Wisconsin Department of Public Instruction are presented. In 1982, objective-referenced tests in science, mathematics, and geometry were given to a sample of Wisconsin's public school students in grades 4, 8, 11, and 12. Students were also given the Comprehensive Tests…

Six research papers that have been published by the staff of the Center for Statewide Educational Assessment at Educational Testing Service are presented. In "A Selection of Self Concept Measures," Joan Knapp explores questions of defining and measuring self concept. In another paper, she examines some problems of measuring attitudes toward…

This report of the results of the 1974-75 Florida National Assessment Replication in reading and mathematics at the 9-, 13-, and 17-year-old age levels consists of several major parts: an overview of the assessment design and methodology, comparisons of performance levels for groups of Florida students within each age level, comparisons of…