Background/Context: Observational studies often employ regression discontinuity (RD) designs and multiple control-group designs to explore the causal quantities of interest. RD designs assess policy and program effectiveness by assigning subjects to treatment based on whether they exceed a pre-defined cutoff. RD designs are classified into two…

Background/Context: Some observational studies involve multiple layers of treatment selection, specifically in the context of the extended time accommodation (ETA) for English language learners (ELLs). In ETA settings, the first selection occurs due to the eligibility rule, where students whose ELL English proficiency is below a certain threshold…

Regression discontinuity (RD) designs are commonly used for program evaluation with continuous treatment assignment variables. But in practice, treatment assignment is frequently based on ordinal variables. In this study, we propose an RD design with an ordinal running variable to assess the effects of extended time accommodations (ETA) for…

The variance formula derived for a two-stage sampling design without replacement employs the joint inclusion probabilities in the first-stage selection of clusters. One of the difficulties encountered in data analysis is the lack of information about such joint inclusion probabilities. One way to solve this issue is by applying Hájek's…

Some form of a short interrupted time series (ITS) is often used to evaluate state and national programs. An ITS design with a single treatment group assumes that the pretest functional form can be validly estimated and extrapolated into the postintervention period where it provides a valid counterfactual. This assumption is problematic. Ambiguous…

The 2011 NAEP-TIMSS linking study conducted by the National Center for Education Statistics (NCES) was designed to predict Trends in International Mathematics and Science Study (TIMSS) scores for the U.S. states that participated in 2011 National Assessment of Educational Progress (NAEP) mathematics and science assessment of eighth-grade students.…

The purpose of this study was to examine patterns of computer use in U.S. schools and the relation of computer use to academic achievement in mathematics, reading, and writing. The report discusses methodological issues and presents the results of analyses of the social distribution of computer use and the relation of computer use to academic…

The organization of data at the National Assessment of Educational Progress (NAEP) is undergoing a significant transition from a system designed only for national assessment purposes to one designed both for assessment and a variety of academic research interests. The advent of NAEP public-use data files opens up many possibilities for those who…

The National Assessment of Educational Progress (NAEP), like most large national surveys, employs a complex stratified multistage unequal probability sample. The design provides a rigorous justification for extending survey results to the entire U.S. target population. Developments in the analysis of data from complex surveys which provide a…

The National Assessment of Educational Progress in-school sampling design is a three-stage stratified design. Stratification variables include region, size of community and socioeconomic status. The three levels of sample selection are Primary Sampling Units (PSUs), schools and students. In general, two and sometimes three PSUs are selected from…

Rigorous research provides information that will allow other schools and districts to select interventions that have a scientifically based track record of effectiveness. All Striving Reader grants include the mandate to evaluate literacy intervention(s) targeted to adolescents who are reading significantly below grade level. Although all studies…

The sampling designs and procedures used by the National Assessment of Educational Progress in its second year assessment activities are documented. The report is organized in three parts. Project objectives and other background information are discussed in the first section. The details of the second year school and household samples are…

Identifies trends in educational achievement in the 1970s. Presents hypotheses concerning the relationship between research and gains/declines in educational achievement during that period. Discusses a project for individualized learning programs and its theoretical rationale, and describes a research project based on that educational improvement…

Approaches to data analysis used by the National Assessment of Educational Progress (NAEP) and possible alternative methodologies are reviewed. Since various components of the NAEP model affect analysis, key elements of that model, including procedures for developing objectives and exercises, drawing the sample, collecting data and reporting…

To fulfill its mandate and its potential the National Assessment of Educational Progress (NAEP) must be a multi-content annual assessment of priority learning areas. This report describes a procedure under which measures of attainment can be charted over time in a broad range of skill domains, on item-invariant item response theory scales, using…