Underlying all What Works Clearinghouse (WWC) products are WWC Study Review Guides, which are intended for use by WWC certified reviewers to assess studies against the WWC evidence standards. As part of an ongoing effort to increase transparency, promote collaboration, and encourage widespread use of the WWC standards, the Institute of Education…

This document provides step-by-step instructions on how to complete the Study Review Guide (SRG, Version S3, V2) for single-case designs (SCDs). Reviewers will complete an SRG for every What Works Clearinghouse (WWC) review. A completed SRG should be a reviewer's independent assessment of the study, relative to the criteria specified in the review…

Traditionally, evaluation has primarily tried to answer the question "Does a program, service, or policy work?" Recently, more attention is given to questions about variation in program effects and the mechanisms through which program effects occur. Addressing these kinds of questions requires moving beyond assessing average program…

"FRIENDS for Life" is a cognitive behavioural therapy (CBT) programme which aims to reduce anxiety and promote resilience among children. This study evaluated the "FRIENDS for Life" (FRIENDS) programme used as an intervention for seven children between the ages of 10 and 11 presenting with high functioning autism spectrum…

Sound evaluation planning requires numerous decisions about how constructs in a program theory will be translated into measures and instruments that produce evaluation data. This article, the first in a dialogue exchange, examines how decisions about measurement are (and should be) made, especially in the context of small-scale local program…

Over the past decade and a half, state governments have assumed greater responsibility over demand-side management (DSM) operations. Whereas DSM programs formerly were initiated primarily by utilities or state public utility commissions, they are now becoming increasingly state-initiated and incentivized through funding mechanisms or…

When measuring outcomes in corporate training, the authors recommend that it is essential to introduce a comprehensive plan, especially when resources are limited and the company needs are vast. The authors hone in on five critical components for shaping a measurement plan to determine the success and ROI of training. The plan's components should…

How discrete measures can be used for needs assessment. (HB)

Not all policy questions can be addressed by social experiments. Nonexperimental evaluation methods provide an alternative to experimental designs but their results depend on untestable assumptions. This paper presents evidence on the reliability of propensity score matching (PSM), which estimates treatment effects under the assumption of…

Strength and integrity issues are central to planning and interpreting evaluation studies. In the absence of actual data from previous studies, estimates of strength and integrity can often be derived in other ways. These issues of strength and integrity are described in the context of resource allocation in evaluation research. (Author/BS)

Educational evaluation and design are discussed. Five essential steps in evaluation are: (1) define educational objectives in behavioral terms, (2) translate the objective into descriptions of behavior, (3) identify situations in which the designated behavior can be observed, (4) establish an interpretative device which can measure the desired…

A representative sample of studies drawn from the published program evaluation literature is examined. It is concluded that weak designs, low statistical power, ad hoc measurement, and neglect of treatment implementation and program theory characterize the state of the art in program evaluation. (Author/BS)

The desirability of combining tests of theory with evaluations of treatment modalities is argued in an investigation of the effectiveness of a juvenile diversion program. Using a true experimental design (with randomization), recidivism analyses dependent on court record data failed to demonstrate the relative superiority of any of three treatment…

Discusses relative merits of various outdoor education research and evaluation methodologies and includes a list of available measurement instruments which are each keyed to one or more of the 126 entries in a seven-section bibliography. Approximately half of the entries have ERIC (Educational Resources Information Center) accession numbers. (AN)

The experiences of a group of evaluators evaluating a multisite integrated human service delivery system illustrate many design and measurement considerations in the preimplementation and implementation phases of evaluation. The reemergence of human service integration approaches will make such evaluation issues increasingly common. (SLD)