In 1999, the National Science Foundation (NSF) awarded funds to the Evaluation Center at Western Michigan University to conduct an external evaluation of the Advanced Technological Education (ATE) program. ATE, a federally mandated program designed to increase the number and quality of skilled technicians in the U.S. workforce, has funded over 346…

A cross-case analysis of four National Science Foundation (NSF) case studies identified both unique details and common themes related to promoting the use and influence of multisite evaluations. The analysis provided evidence of diverse evaluation use by stakeholders and suggested that people taking part in the multisite evaluations perceived…

In 1995, the National Science Foundation (NSF) contracted with principal investigator Iris Weiss and an evaluation team at Horizon Research, Inc. (HRI) to conduct a national evaluation of the Local Systemic Change for Teacher Enhancement program (LSC). HRI conducted the core evaluation under a $6.25 million contract with NSF. This program…

Case studies about managing evaluation are examined for perspectives on expertise in managing evaluation. There are lessons on a geography of managing, managing as organizational work, the notions of "competency" and "expertise," and managing evaluation as professional work. Dreyfus and Dreyfus (2004) offer a framework for an introductory…

Donald W. Compton, the first director of evaluation services at the National Home Office (Atlanta) of the American Cancer Society, tells the story of building the unit in conditions of high demand and a limited budget. Along the way, evaluation was brought to regional divisions and to local offices in part as a response to United Way and to his…

The impact of No Child Left Behind (NCLB) is usually understood in relation to schools and districts, but the legislation has also affected community-based organizations that operate school-linked programs. This case study of an after-school program in California demonstrates how educational accountability systems that emphasize students' academic…

This chapter describes the adaptation of the case study method to assessing increasingly complex, comprehensive reform initiatives that highlight the blurring of the boundaries between phenomenon and context and the concurrence of multiple interventions. Completed studies of two education reform programs illustrate the ongoing challenges of…

Summarizes and analyzes the four case studies of this theme issue. The analyses consider the three structural elements of evaluation capacity building (ECB): overall ECB process; actual ECB practices; and ECB occupational orientation and practitioner role. Provides a practical checklist for assessing ECB at an organization and a framework for…

Summarizes efforts to strengthen program evaluation capacity at the Centers for Disease Control and Prevention. Reviews the circumstances that triggered an interest in building this capacity in public health and the principles and procedures used by the working group charged to achieve this goal. (Author/SLD)

Two broad classes of mixed-method designs--component and integrated--that have the potential to combine elements of different inquiry traditions are described. The conceptual ideas advanced in the first chapter are illustrated through selected examples of several mixed-method integrated models. (Author/SLD)

A pragmatic framework for making decisions about mixed-method designs is proposed and then applied to illustrative evaluation case studies to help identify the strengths and limitations of making practical, contextual, and consequential considerations a primary basis for evaluation design decisions. (Author)

Describes how the first evaluation practitioner for the American Cancer Society (ACS) came to do evaluation capacity building (ECB) because of the need for evaluation following changes in the organizational structure. Provides a brief history of these changes as a background for understanding the seven principles of ECB at the ACS. (Author/SLD)

Reviews critical dimensions in evaluation that emerge from efforts to promote use within a context of stakeholder participation. Case examples illustrate two potentially problematic domains: stakeholder selection and depth of stakeholder involvement. (Author/SLD)

Uses the results of an instrumental case study to identify issues connected to evaluation participation and its representation and the role of the internal evaluator in democratic, deliberative evaluation. Identified direct participation and participation by representation, sanctioned or unsanctioned representation, and extrinsic and intrinsic…

Uses a case study of an evaluation conducted in a psychiatric institution to illustrate the issues that arise when techniques of deliberative democratic evaluation are applied in an antidemocratic climate. Illuminates strategies for stakeholder inclusion from a deliberative, democratic point of view. (SLD)