Discusses the sources and signs of excessive evaluation anxiety in program evaluation and provides some strategies to help evaluators prevent and manage this common problem. Shows how more than technical skills are required to conduct high quality program evaluation. (SLD)

Proposes a method for synthesizing findings within mixed-method program evaluations. The proposed method uses a set of criteria and analytic techniques to assess the worth of each data source or type and to establish what each says about program effect. Once data are on a common scale, simple mathematics allows synthesis across data sources or…

Describes the number needed to treat (NNT) as an indicator of a program's efficacy. L'Abbe plots compare several programs in terms of the event rates that constitute the NNTs. Explains how an evaluator may extend the NNT concept by calculating and plotting event rates on a continuous ordinal basis. (SLD)

Presents, in light-hearted way, a few rules of evaluation practice wisdom that, if followed, would result in more rigorous and useful evaluations of human services programs. Although none of the ideas is totally original, it is suggested that as a group they provide handy checklist for practitioners who are developing or assessing evaluation…

Reviews evaluation strategies that have been used to assess process and outcome of suicide intervention, ranging from macroanalyses of impact of crisis services on suicide rates in community to microanalyses of competence of individual suicide interventionists. Considers Suicide Intervention Response Inventory, self-administered test of suicide…

Illustrates use of time-series designs for determining efficacy of interventions with fictitious data describing drug-abuse prevention program. Discusses problems and procedures associated with time-series data analysis using Auto Regressive Integrated Moving Averages (ARIMA) models. Example illustrates application of ARIMA analysis for…

Identifies five themes that illustrate different aspects of the process of diffusing democratic deliberation into more widespread use: (1) appreciation; (2) addition; (3) apprehension; (4) application; and (5) adaptation. These themes give guidance concerning evaluation practice and the role of evaluation in society. (Author/SLD)

Describes the development of program theory evaluation and the various versions of program theory evaluation currently in use. Discusses some of the differences between theory and evaluation practice. Program theory evaluation consists of an explicit theory or model of how a program causes outcomes and an evaluation that is at least partially…

Provides guidance about which links in program theory to study and which theories to use. In choosing the links to study, the first criterion is to choose the links that are most critical to the success of the program. The second criterion is the degree of uncertainty about the linkage. (SLD)

Summarizes interesting aspects of the preceding chapters and the issues and concerns raised related to program theory evaluation. Suggests that evaluators may be fighting a losing battle in their efforts to shore up weak programs through the introduction of program theory evaluation, asserting that the development of strong program theory should…

Studied the convergence of evaluator and non-evaluator perspectives about collaborative evaluation. Results based on work of 67 pairs of evaluators and program practitioners show that, generally, program practitioners were more conservative in their opinions. Many differences in the two perspectives are noted. (SLD)

Describes the dialogue in an informal discussion group and asserts that because the group is interactive, dynamic, and applied it is an embodiment of the nature of evaluation knowledge. Discusses ways in which this group teaches about evaluation. (SLD)

A central issue in the use of rapid evaluation and assessment methods (REAM) is achieving a balance between speed and trustworthiness. In this article, the authors review the key differences and common features of this family of methods and present a case example that illustrates how evaluators can use rapid evaluation techniques in their own…

This article examines the case for the use of the creative arts in the process of designing, conducting, analyzing, and disseminating evaluations. The authors argue that using the creative arts in the process of evaluation evokes different ways of knowing and understanding the values of a program. The insights gained offer a unique addition to…

In May 2008, the Center for Evaluation & Education Policy (CEEP) issued the Education Policy Brief, "Calculating High School Graduation Rates," which discussed the importance of accurate and reliable high school graduation data, various graduation rate calculation methods, the history behind the use of particular methodologies, and…