This guide will help researchers design and implement impact studies in education so that the findings are more generalizable to the study's target population. Guidance is provided on key steps that researchers can take, including defining the target population, selecting a sample of schools--and replacement schools, when needed--managing school…

Survey sampling is fundamentally an applied field. The goal in this book is to put an array of tools at the fingertips of practitioners by explaining approaches long used by survey statisticians, illustrating how existing software can be used to solve survey problems, and developing some specialized software where needed. This book serves at least…

This paper provides a guide to calculating statistical power for the complex multilevel designs that are used in most field studies in education research. For multilevel evaluation studies in the field of education, it is important to account for the impact of clustering on the standard errors of estimates of treatment effects. Using ideas from…

The Programme for International Assessment of Adult Competencies (PIAAC) will establish technical standards and guidelines to ensure that the survey design and implementation processes of PIAAC yield high-quality and internationally comparable data. This document provides a revised version of the technical standards and guidelines originally…

One purpose of educational research is to provide information about the likely impact of interventions or treatments on policy-relevant populations of students. Randomized experiments are useful for estimating the causal effects of interventions on the students in schools that participate in the experiments. Unfortunately, the samples of schools…

A brief, practical overview of "design effects" (DEFFs) is presented for users of the results of sample surveys. The overview is intended to help such users to determine how and when to use DEFFs and to compute them correctly. DEFFs are needed only for inferential statistics, not for descriptive statistics. When the selections for…

Present research connected with computer-based instruction indicates that many investigators rely on conventional experimental design and data analysis to address the research question. Although this is appropriate in many cases, the limits of hard and software resources and sample size in other cases have made conventional approaches a poor…

Provides an introduction to sampling, determination of sample size, and selection of the actual sample that would be useful for librarians conducting research and evaluation studies. Highlights include sampling method, sampling error, confidence level, and microcomputer software packages that help determine sample size. (Contains 26 references.)…

This paper summarizes and highlights some of the critical developments, issues, and trends which impact the work of survey research. The issue of preventing or minimizing nonresponse bias by successfully obtaining cooperation from people being surveyed continues to be of concern to survey research professionals. The most effective response rate…