This guide for district and school leaders shows how to recognize opportunities to embed randomized controlled trials (RCTs) into planned policies or programs. Opportunistic RCTs can generate strong evidence for informing education decisions--with minimal added cost and disruption. The guide also outlines the key steps to conduct RCTs and responds…

This "What Works Clearinghouse Procedures and Standards Handbook (Version 3.0)" provides a detailed description of the standards and procedures of the What Works Clearinghouse (WWC). The remaining chapters of this Handbook are organized to take the reader through the basic steps that the WWC uses to develop a review protocol, identify…

This guide summarizes "Effective Programs in Elementary Mathematics: A Best-Evidence Synthesis" and "Effective Programs in Middle and High School Mathematics: A Best-Evidence Synthesis," two research reviews conducted by Johns Hopkins University's Center for Research and Reform in Education. The purpose of the reviews was to evaluate the…

This guide is intended to be useful to educators in high schools and middle schools, to superintendents and school boards, and to state policymakers in planning and executing dropout prevention strategies. The target audience includes school administrators as well as district-level administrators, seeking to help develop practice and policy…

Although the need for evaluation of training programs administered in organizations is recognized and widely discussed, program evaluation is not easy, and there exists a gap between discussion and practice. Cohen notes an absence of research efforts demonstrating the application of evaluation methods, particularly within control groups. This…

This guide is designed as a resource for leaders and evaluators of K-12 online learning programs. In this guide, the term "online learning" is used to refer to a range of education programs and resources in the K-12 arena, including distance learning courses offered by universities, private providers, or teachers at other schools;…

This paper presents a new technique in which covariates are controlled and evaluation data still are presented graphically in a manner that makes sense to policy makers. An illustration is provided using data drawn from an evaluation by the author of a major National Science Foundation (NSF) university funding program. (Author)

Develops generalizations for empirical evaluation of software based upon suitability of several research designs--pretest posttest control group, single-group pretest posttest, nonequivalent control group, time series, and regression discontinuity--to type of software being evaluated, and on circumstances under which evaluation is conducted. (MBR)

The author discusses the selection and use of control groups, particularly in studies evaluating gifted programs. Factors affecting evaluation design decisions are outlined, the control and abuse of control groups is discussed, and some useful data collection design procedures are reviewed. Also considered is the analysis of data from contrast…

This is a checklist of key items to get right when conducting a randomized controlled trial to evaluate an educational program or practice ("intervention"). It is intended as a practical resource for researchers and sponsors of research, describing items that are often critical to the success of a randomized controlled trial. A significant…

Addresses a number of ethical and methodological issues related to research involving vulnerable populations such as the frail elderly, when the research design calls for a control or nonintervention group. Techniques are presented for building a "limited" service component into the research design. (Author)

The evaluation design, which prescribes when and from whom to gather data, is described as significant because it can lend credibility to evaluation results. The objectives of this booklet are to aid the evaluator in: choosing a design; putting it into operation; and analyzing and reporting the data. Examples include both formative and summative…

The failure of educational research to fully allow for limitations in methodology when drawing conclusions is faulted. In addition to this, a failure on the part of the media--educational and other--to fully publicize these limitations is also criticized. Methodological shortcomings of the 1977-78 American Institutes of Research (AIR) study of…

Expresses the importance of scientifically based research in education reform and explains how to judge the validity of educational research. Describes control groups, randomized and matched experiments, statistical educational significance, sample size, and the difference between scientifically based and rigorously evaluated research. (Contains…