The American School District Panel (ASDP) is a nationally representative set of more than 1,000 school district leaders who agree to take surveys over time. RAND recruits ASDP members using probabilistic sampling methods, which allow researchers to weight survey results to generalize to the national population of school districts and charter…

When analyzing large-scale assessments (LSAs) that use complex sampling designs, it is important to account for probability sampling using weights. However, the use of these weights in multilevel models has been widely debated, particularly regarding their application at different levels of the model. Yet, no consensus has been reached on the best…

Policymakers have grown increasingly interested in how experimental results may generalize to a larger population. However, recently developed propensity score-based methods are limited by small sample sizes, where the experimental study is generalized to a population that is at least 20 times larger. This is particularly problematic for methods…

The American School District Panel (ASDP) is the newest addition to the RAND Corporation's American Educator Panels (AEP), which are designed to survey panels of educators several times each year. RAND recruits AEP members using probabilistic sampling methods, which allow researchers to weight survey results to generalize to the national…

This research empirically evaluates data sets from the National Center for Education Statistics (NCES) for design effects of ignoring the sampling design in weighted two-level analyses. Currently, researchers may ignore the sampling design beyond the levels that they model which might result in incorrect inferences regarding hypotheses due to…

This article considers various kinds of probability and non-probability samples in both experimental and survey studies. Throughout, how a sample is chosen is stressed. Size alone is not the determining consideration in sample selection. Good samples do not occur by accident; they are the result of a careful design. (Author/JAZ)

An "inference can" is described, with two games that allow students to observe and predict events, define population, and draw samples. (MP)

The National Education Longitudinal Studies Program (NELS) is a long-term effort that encompasses the educational experience of youth from three decades. This report is based on the National Education Longitudinal Study of 1988 (NELS:88), a component of the NELS series that began as a national probability sample of eighth grade schools and…

Advances in computer technology are making it possible for educational researchers to use simpler statistical methods to address a wide range of questions with smaller data sets and fewer, and less restrictive, assumptions. This digest introduces computationally intensive statistics, collectively called resampling techniques. Resampling is a…

Procedures for obtaining student samples for the National Assessment of Educational Progress (NAEP) and deriving survey weights for analysis of survey data are described. Sample designs are economically and operationally feasible, and weighting procedures result in increased precision of estimates as they account for the probabilities of student…