When and how to survey potential respondents is often determined by budgetary and external constraints, but choice of survey modality may have enormous implications for data quality. Different survey modalities may be differentially susceptible to measurement error attributable to interviewer assignment, known as interviewer effects. In this…

Underlying all What Works Clearinghouse (WWC) products are WWC Study Review Guides, which are intended for use by WWC certified reviewers to assess studies against the WWC evidence standards. As part of an ongoing effort to increase transparency, promote collaboration, and encourage widespread use of the WWC standards, the Institute of Education…

This document provides step-by-step instructions on how to complete the Study Review Guide (SRG, Version S3, V2) for single-case designs (SCDs). Reviewers will complete an SRG for every What Works Clearinghouse (WWC) review. A completed SRG should be a reviewer's independent assessment of the study, relative to the criteria specified in the review…

This three-volume report describes the "SAM (School Administration Manager) process," an approach that about 700 schools around the nation are using to direct more of principals' time and effort to improve teaching and learning in classrooms. Research has shown that a principal's instructional leadership is second only to teaching among…

Many out-of-school time programs want to learn more about how the children and youth they serve are faring. Outcome evaluations allow programs to do just that. This brief provides a basic review of outcome evaluations, discusses why they are important and when they are useful, and presents guidelines, strategies, and techniques for their use in…

Written by a social worker for social work students, this is a nuts and bolts guide to statistics that presents complex calculations and concepts in clear, easy-to-understand language. It includes numerous examples, data sets, and issues that students will encounter in social work practice. The first section introduces basic concepts and terms to…

This study empirically investigates the effectiveness of Distributed Leadership Teacher Training (DLT) program on improving student's academic achievement. In addition, it both tests the assumption that the year 1 impacts are stable across calendar years and examines the importance of properly accounting for the fact that the standard error of the…

Analysis of data of two cooperative extension studies suggests that research costs can be lowered by reducing sample size without compromising results, descriptive studies can have a larger margin of error in calculating sample size without compromise, and comparative studies' results are unaffected by a 3% margin of error but are dramatically…

A theory-driven approach to validity is proposed. The central argument is that a model or theory should be formulated in a program evaluation and the modeling process should include the identification of potential threats to validity in research. (Author/LMO)

Outcomes evaluation of community partnerships to prevent substance abuse poses many methodological challenges. The nine articles of this special section illustrate the variety of approaches evaluators have taken to studies that are often complicated because of small sample size. (SLD)

Discusses a technique for estimating sample size that does not require an a priori definition of desired precision. Presents five modifications that make the method easier to use and reduce the probability of estimating a larger sample size than necessary. The technique can guide the design of environmental sampling programs. (Contains 31…

Data from 86 Early Childhood Education (ECE) projects in Oregon were analyzed using methods prescribed by the Value Added model for ECE evaluation. The extent to which appropriate model implementation procedures were followed is unknown. Thus, the results represent an empirical account of the model's estimates of project impact, rather than a…

Significant questions are raised concerning the Baker/de Kanter review, which concluded that "the case for the effectiveness of transitional bilingual education is so weak that exclusive reliance on this instructional method is clearly not justified." Sources used show methodological problems and multiple examples of deficiences in nine…

This report develops the sample design for evaluating five Federal manpower programs in terms of their effects upon trainees' incomes. The study involves a large 10-city sample of trainees in Job Corps, Neighborhood Youth Corps, Job Opportunities in the Business Sector, and Manpower and Development Act Institutional Training Programs (New Careers…

Simple methods for detecting attrition (nonresponse) in longitudinal evaluations are reviewed, focusing on regression-based analyses of data from a longitudinal evaluation. The approaches are illustrated with data from the Fort Bragg Evaluation, an evaluation of a major demonstration in children's mental health services. (SLD)