Background: Recent reviews suggest that many plausible programs are found to have at best small impacts not commensurate with their cost, and often have no detectable positive impacts at all. Even programs with initial rigorous impact evaluation (RIE) that show them to be effective often fail a second test with an expanded population or at…

This study is an exploratory examination of the projected sustainability of more than 100 projects funded by the Australian government. Using data collected by the body that evaluated the projects and data from a government database, it examines the predictors of various forms of sustainability. Findings show that some two thirds of the project…

Though collaboration is often required in community initiatives, little evidence documents relationships between collaboration and program success. The authors contend that clarification of the construct collaboration is necessary for investigating its contribution to the success of community initiatives. After respecifying collaboration, they…

Some questions about the relationship between program evaluation and forecasting are raised. Contrasting the two fields in terms of mind-set, purpose, problems, advantages, and use shows that although their modes of inquiry are indeed very different in many ways, there is interdependence between the two in several areas. (Author/JAZ)

Statistical approaches to assess how prevention and intervention programs achieve their effects are described and illustrated through the evaluation of a health promotion program to reduce dietary cholesterol and a school-based drug prevention program. Analyses require the measurement of intervening or mediating variables to represent the…

The problem associated with evaluating an econometric model using values outside those used in the model estimation is illustrated in the evaluations of a residential load management program during each of two successive years. Analysis reveals that attention must be paid to this problem. (Author/TJH)

A meta-program theory is proposed to overcome the limitations and improve the use of program theory as an approach to faith-based program evaluation. The essentials for understanding religious organizations, their various programs, and faith and spirituality are discussed to support a rationale for developing a faith-based program theory that…

A technique to estimate variances of weighted estimates in program evaluation is discussed. BRR estimates of variance are constructed from orthogonally weighted subsamples and can provide better estimates from complex samples than can other methods. Use of BRR is illustrated in a government evaluation of a food service program. (SLD)

Five causal metaphors running throughout youth employment and education programs are reviewed: (1) the functionalist economic model; (2) the institutional socialization model; (3) a psychosocial view of youth development; (4) the subcultural model; and (5) a self-determined community development vision. (Author/GK)

The role of program evaluation is examined in relation to policy analysis. Program evaluation is most persuasive as a component of the policy process when its role is clearly understood. Clarity can be achieved by using the program mandate to guide evaluation and by including practitioners in evaluation model developments. (SLD)

It is argued that the Gang Resistance Education and Training Program, developed by the Phoenix (Arizona) police department and the Bureau of Alcohol, Tobacco, and Firearms, consisted of pedagogical elements with strong conceptual and operational ties to social learning and self-control theories, and two mainstream criminological theories. (SLD)

This article examines the effect of the Massachusetts workforce development system on the earnings of disadvantaged adults using nonexperimental data from the late 1990s. The authors construct a comparison sample for program participants using individuals who apply for and are offered services yet do not participate in a training program. They…

One source of bias, regression artifacts, in program evaluations that use regression discontinuity design is identified, and its importance is discussed. A method is suggested for its correction. Although use of this method does not solve the problem of selection bias, it does improve the reliability of nonexperimental methods. (SLD)

After a brief discussion of the terms implementation and monitoring, this article illustrates a strategy for monitoring program implementation. The strategy, called model-guided method, offers a way to develop conceptual and empirical specifications for testing the adequacy of a program implementation. It also provides feedback to program…

The use of theoretical models in impact assessment can heighten the power of experimental designs and compensate for some deficiencies of quasi-experimental designs. Theoretical models of implementation processes are examined, arguing that these processes are a major obstacle to fully effective programs. (Author/CM)