The authors propose a comprehensive evaluation framework to prepare for evaluating school emergency management programs. This framework involves a logic model that incorporates Government Performance and Results Act (GPRA) measures as a foundation for comprehensive evaluation that complements performance monitoring used by the U.S. Department of…

The chapters in this volume set a rich context for understanding the challenges that environmental evaluators face in their everyday work. In particular, the authors highlight the need for responsive, contextual, flexible, adaptive, multidisciplinary, and mixed-methods evaluation approaches. In this chapter, I reinforce their call and further…

This chapter examines how factors both internal and external to Cooperative Extension have influenced its commitment and capability to assess the quality and impact of its programs. The authors begin by documenting how the nature of Extension programming has changed dramatically in response to societal needs over the course of the organization's…

Three primary stances on the wisdom of mixing evaluation models while mixing evaluation methods frame the challenges to defensible mixed-method evaluative inquiry. These challenges are addressed by shifting the mixed-method controversy from models toward other critical features of disparate traditions of inquiry. (Author/SLD)

Describes the development of program theory evaluation and the various versions of program theory evaluation currently in use. Discusses some of the differences between theory and evaluation practice. Program theory evaluation consists of an explicit theory or model of how a program causes outcomes and an evaluation that is at least partially…

Provides guidance about which links in program theory to study and which theories to use. In choosing the links to study, the first criterion is to choose the links that are most critical to the success of the program. The second criterion is the degree of uncertainty about the linkage. (SLD)

Summarizes and analyzes the four case studies of this theme issue. The analyses consider the three structural elements of evaluation capacity building (ECB): overall ECB process; actual ECB practices; and ECB occupational orientation and practitioner role. Provides a practical checklist for assessing ECB at an organization and a framework for…

Evaluation capacity building, or ECB, is an area of great interest within the field of evaluation as well as in Extension evaluation. Internal Extension evaluators have long offered training and technical assistance to help Extension educators conduct evaluation. Today ECB in Extension encompasses myriad activities and processes to advance…

Presents a framework for judging evaluations on the basis of their potential for democratic deliberation that includes the interrelated requirements of inclusion, dialogue, and deliberation. Operationalizes these requirements in 10 questions to guide evaluation and meta-evaluation from a democratic viewpoint. (SLD)

This monograph identifies, analyzes, and judges 22 evaluation approaches used in program evaluation. Two approaches, labeled psuedoevaluations, are politically oriented and often used to misrepresent a program's value. The remaining 20, judged legitimate, are categorized by their orientations, and rated for their value. (SLD)

Two broad classes of mixed-method designs--component and integrated--that have the potential to combine elements of different inquiry traditions are described. The conceptual ideas advanced in the first chapter are illustrated through selected examples of several mixed-method integrated models. (Author/SLD)

A pragmatic framework for making decisions about mixed-method designs is proposed and then applied to illustrative evaluation case studies to help identify the strengths and limitations of making practical, contextual, and consequential considerations a primary basis for evaluation design decisions. (Author)

Crude mental models should take priority over designs in guiding evaluative inquiry. Three illustrative mental models are shown to have implications for how method mixing is carried out in practice. One of the models, a complex and contextually contingent model, is applied to the Arizona Student Assessment Program. (SLD)

Proposes a framework for the evaluation of health and human services programs in community settings. Applies this framework to the discussions in this special issue to see how well the chapters advance community-based program evaluation. Concludes that the chapters are valuable for those interested in improving the evaluation of community-based…

Illustrative case studies support a contingency approach to mixed-method evaluation in which the evaluation team bases its selection of methods on the information to be provided, the availability of data, and the degree to which the program environment is an open or closed system. (SLD)