This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

The third-year evaluation of the federally funded Washington, D.C. voucher program shows that low-income students offered vouchers in the first two years of the program had modestly higher reading scores after three years but showed no significant difference in mathematics. Students were randomly assigned to treatment and control groups, and the…

This article discusses the use of propensity scoring in experimental program evaluations to estimate impacts for subgroups defined by program features and participants' program experiences. The authors discuss estimation issues and provide specification tests. They also discuss the use of an overlooked data collection design--obtaining predictions…

This article examines the effectiveness of incentives in improving survey response rates of school counselors and compares the findings with those of previously researched populations. A $1 cash incentive increased response rates for a one-wave mailing of a questionnaire, while a raffle opportunity did not. The number and length of optional…

Sharp limitations on measuring the impact of Volunteers in Service to America (VISTA) can be largely overcome by developing an improved system and techniques for planning projects and their likely effects. The distinguishing characteristics of VISTA for measurement purposes are: a large number of volunteer program activities and sponsors, hence…

The experience of a research group in studying Neighborhood Youth Corps (NYC) programs provides the framework for a discussion of the methodological difficulties of conducting research on disadvantaged groups. However, the report does not deal with the programs and operations of NYC itself. Four problem areas are described: (1) criterion, program,…

In evaluation research studies, it often occurs that several program participants (experimentals) drop out of the program prior to completion. Since noncompleters generally differ substantially from completers in many respects, a control group which originally was representative of the participant group will most likely not be representative of…

Criticizes the research design in "The Small ICF/MR program: Dimensions of Quality and Cost" (Conroy), that found small Intermediate Care Facilities (ICF) for individuals with mental retardation are inferior to other community programs. Discusses the problem in selecting a control group on the basis of pretest matching. (CR)

The three RMC models endorsed by the U.S. Office of Education for the evaluation of Elementary and Secondary Education Act Title I programs are based on narrowly conceived approaches to evaluation--the measurement of cognitive achievement gains. Each model requires the comparison of observed student performance with an estimate of what level of…

The focus of future Follow Through research should be oriented toward showing what can be done in order to offer information to both federal and local planners on which systems of curriculum design, classroom management, and parent involvement appear to be most effective. To assure this goal, the issues of program efficacy and implementation…

The New York State Experimental Prekindergarten Program (PreK) evaluation studied successive waves of children while they were in PreK, and as they progressed through the third grade. For each wave, two control groups were obtained: (1) A waiting-list control group, children in districts offering PreK programs who were identified as eligible for…

The orientation of this report is that of identifying educational projects which can be considered clearly exemplary. The largest section consists of a 22-step procedure for validating the effectiveness of educational projects using existing evaluation data. It is not intended as a guide for conducting evaluations but rather for interpreting data…