Since its inception, the National Center for Education Statistics (NCES) has been committed to the practice of documenting its statistical methods for its customers and of seeking to avoid misinterpretation of its published data. The reason for this policy is to assure customers that proper statistical standards and techniques have been observed,…

The National Assessment Governing Board adopted a Program of Preparedness Research in March 2009. Several categories of research studies were recommended to produce results for reporting 12th grade preparedness for the 2009 grade 12 National Assessment of Educational Progress (NAEP) in reading and mathematics. The categories included content…

The trends and findings from a descriptive analysis of 25 years of research studies examining the effectiveness of technology to support the compositional writing of students with learning and academic disabilities are presented. A corpus of 85 applied research studies of writing technology effectiveness was identified from among 249 items in the…

A popular design in large-scale educational assessments is the balanced incomplete block design. The design assumes that the item pool is split into a set of blocks of items that are assigned to assessment booklets. This paper shows how the technique of 0-1 linear programming can be used to calculate a balanced incomplete block design. Several…

Explains how schools and students are selected for the National Assessment of Educational Progress (NAEP) and why high participation rates are important. Describes the multistage sampling method, which allows the National Center for Education Statistics to give an accurate picture of student performance while keeping the burden on schools and…

This paper discusses different perspectives associated with the use of multiple measures in educational assessment and explores some of the technical considerations for selecting and combining multiple measures. The paper concludes with an example of the use of multiple measures with regard to the recent No Child Left Behind (NCLB) Act of 2002.…

This paper describes the creation of the National Assessment Governing Board (NAGB) in 1998 and examines the background characteristics of the Board members and their attendance at NAGB meetings. The staffing and financing of the NAGB and the relationship between the agency and the National Center for Education Statistics is also considered. The…

This paper discusses the rationale for enhancing the current National Assessment of Educational Progress (NAEP) design by adding a capacity for adaptive testing. Items are tailored to the achievement level of the student in adaptive testing. The report describes a 1993 Ohio field trail of two-stage assessment carried out by the National Opinion…

This paper presents an overview of the design features that were developed for the Content Analysis Project. The purpose of the project was to examine the congruence between a state's test in eighth-grade mathematics and that used by the National Assessment of Educational Progress. The results of this analysis were then to be used to determine…

This chapter gives an overview of the design and statistical and psychometric analysis methods of the National Assessment of Educational Progress (NAEP). The evolution of the NAEP continues to provide challenges to statisticians and psychometricians, as demonstrated in the expansion of the NAEP to the assessment of individual states. (SLD)

With the growing interest in comparing student achievement state by state, there is a need to develop better techniques for making such comparisons. Approaches available now, particularly the use of Scholastic Aptitude Test (SAT) and American College Test (ACT) scores, have obvious shortcomings but nonetheless continue to be prominent because…

This paper overviews technical developments in data analysis procedures for the National Assessment of Educational Progress (NAEP) reading data during 1984. The highlight of the reshaping of the NAEP data has been the scaling using item response theory (IRT). AT this point in the data analysis, an IRT-based scale appears appropriate for reading…

Argues that geography education lacks empirical data that might inform and underpin decisions about standards setting, curriculum design, materials development, teaching strategies, and assessment procedures. Identifies four needs: (1) a new attitude toward research; (2) baseline studies; (3) a research agenda; and (4) a research clearinghouse.…

The material provides a comprehensive look at the design, goals, and methods to be used in the 1998 National Assessment of Educational Progress (NAEP) Civics Assessment. This assessment will attempt to gauge the civic knowledge and skills of the nation's 4th, 8th, and 12th grade students. To do well on the assessment, students will have to show…