This guide will help researchers design and implement impact studies in education so that the findings are more generalizable to the study's target population. Guidance is provided on key steps that researchers can take, including defining the target population, selecting a sample of schools--and replacement schools, when needed--managing school…

Underlying all What Works Clearinghouse (WWC) products are WWC Study Review Guides, which are intended for use by WWC certified reviewers to assess studies against the WWC evidence standards. As part of an ongoing effort to increase transparency, promote collaboration, and encourage widespread use of the WWC standards, the Institute of Education…

This toolkit is designed to assist states as they plan for and carry out their efforts to collect, report, analyze, and use high-quality parent and family involvement data. It defines key concepts; offers guidance on ways to improve the quality of the collection, analysis, and use of parent and family involvement data; and provides resources and…

This document provides step-by-step instructions on how to complete the Study Review Guide (SRG, Version S3, V2) for single-case designs (SCDs). Reviewers will complete an SRG for every What Works Clearinghouse (WWC) review. A completed SRG should be a reviewer's independent assessment of the study, relative to the criteria specified in the review…

This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

This paper provides practical guidance for researchers who are designing and analyzing studies that randomize schools--which comprise three levels of clustering (students in classrooms in schools)--to measure intervention effects on student academic outcomes when information on the middle level (classrooms) is missing. This situation arises…

This guide is designed to help researchers make sure that their research reports include enough information about study measures so that readers can assess the quality of the study's methods and results. The guide also provides examples of write-ups about measures and suggests resources for learning more about these topics. The guide assumes…

This manual provides guidance and documentation for users of the longitudinal kindergarten-fourth grade (K-4) public-use data file of the Early Childhood Longitudinal Study, Kindergarten Class of 2010-11 (ECLS-K:2011), which includes the first release of the public version of the third-grade data. This manual mainly provides information specific…

To support and promote secondary analyses, the International Association for the Evaluation of Educational Achievement (IEA) is making the SITES 2006 international database and accompanying User Guide available to researchers, analysts, and public users. The database comprises national contexts and school- and teacher-level data from 23 education…

The popularity of sample surveys in evaluation and research makes it necessary for consumers to tell a good survey from a poor one. Several sources were identified that gave advice on how to evaluate a sample design used in a survey study. The sources are either too limited or too extensive to be useful practically. The purpose of this paper is to…

Presents guidelines about how to conduct a public opinion poll and discusses such specific areas as the sample, the questionnaire, the interviewers, and the poll report. (DF)

The main features of a multiple site, structured case study design are presented. The nature of explanatory patterns, how case study investigators pursue and recognize valid patterns, and how an analyst can apply the same logic to cross-site analysis are discussed. (Author/BW)

Situations in which mailed questionnaires are most appropriate are identified. Population variables, characteristics of questionnaires, and social desirability variables are examined in depth. (Author)

Sampling problems related to the use of system-identified subjects in special education research are considered. Differences in criteria and selection of mildly handicapped students have resulted in limited generalizability of findings. Among suggested approaches are using rationally defined subgroups, cluster analysis, and marker variables.…

As part of a high-risk youth grant from the Center for Substance Abuse Prevention, the Southwest Regional Laboratory developed and implemented a survey of alcohol sales establishments. The purpose was to assess the availability of alcohol in the community and changes in availability over time that may have an impact on findings related to project…