Regression discontinuity (RD) designs are commonly used for program evaluation with continuous treatment assignment variables. But in practice, treatment assignment is frequently based on ordinal variables. In this study, we propose an RD design with an ordinal running variable to assess the effects of extended time accommodations (ETA) for…

The variance formula derived for a two-stage sampling design without replacement employs the joint inclusion probabilities in the first-stage selection of clusters. One of the difficulties encountered in data analysis is the lack of information about such joint inclusion probabilities. One way to solve this issue is by applying Hájek's…

Some form of a short interrupted time series (ITS) is often used to evaluate state and national programs. An ITS design with a single treatment group assumes that the pretest functional form can be validly estimated and extrapolated into the postintervention period where it provides a valid counterfactual. This assumption is problematic. Ambiguous…

The trends and findings from a descriptive analysis of 25 years of research studies examining the effectiveness of technology to support the compositional writing of students with learning and academic disabilities are presented. A corpus of 85 applied research studies of writing technology effectiveness was identified from among 249 items in the…

Explains how schools and students are selected for the National Assessment of Educational Progress (NAEP) and why high participation rates are important. Describes the multistage sampling method, which allows the National Center for Education Statistics to give an accurate picture of student performance while keeping the burden on schools and…

Describes and assesses missing data methods currently used to analyze data from matrix sampling designs implemented by the National Assessment of Educational Progress. Several improved methods are developed, and these models are evaluated using an EM algorithm to obtain maximum likelihood estimates followed by multiple imputation of complete data…

Identifies trends in educational achievement in the 1970s. Presents hypotheses concerning the relationship between research and gains/declines in educational achievement during that period. Discusses a project for individualized learning programs and its theoretical rationale, and describes a research project based on that educational improvement…

The effects of certain characteristics (e.g., sample design) of National Assessment of Educational Progress (NAEP) data on statistical analysis techniques are considered. Ignoring special features of NAEP data and proceeding with a standard analysis can produce inferences that underestimate the true variability and overestimate the true degrees of…

Several issues related to the design and reporting of results from the National Assessment of Educational Progress (NAEP) are discussed in the context of current expectations for the NAEP and its origins. These issues include: (1) content coverage and format; (2) estimation procedures; and (3) reporting problems. (SLD)

This chapter gives an overview of the design and statistical and psychometric analysis methods of the National Assessment of Educational Progress (NAEP). The evolution of the NAEP continues to provide challenges to statisticians and psychometricians, as demonstrated in the expansion of the NAEP to the assessment of individual states. (SLD)

Procedures for obtaining student samples for the National Assessment of Educational Progress (NAEP) and deriving survey weights for analysis of survey data are described. Sample designs are economically and operationally feasible, and weighting procedures result in increased precision of estimates as they account for the probabilities of student…

Features of the design of the National Assessment of Educational Progress (NAEP) are discussed, with emphasis on the design of the 1992 assessment. Student sample designs for the NAEP and the Trial State Assessment are described, and the focused-balanced incomplete block spiraling method of item sampling is discussed. (SLD)

Several developments growing out of the National Assessment of Educational Progress (NAEP) are reviewed, with a discussion of their extension and application to other projects. These developments include: (1) complex matrix item sampling designs; (2) performance-based items in large-scale assessments; (3) vertical scaling; and (4) innovative…

Argues that geography education lacks empirical data that might inform and underpin decisions about standards setting, curriculum design, materials development, teaching strategies, and assessment procedures. Identifies four needs: (1) a new attitude toward research; (2) baseline studies; (3) a research agenda; and (4) a research clearinghouse.…