Mixed methods evaluation has a long-standing history of enhancing the credibility of evaluation findings. However, using mixed methods in a utilitarian way implicitly emphasizes convenience over engaging with its philosophical underpinnings (Denscombe, 2008). Because of this, some mixed methods evaluators and social science researchers have been…

The quality of mixed methods systematic reviews relies on the quality of primary-level studies. The synthesis of qualitative evidence and the recent development of synthesizing mixed methods studies hold promise, but also pose challenges to evidence synthesis.

Evaluation of programs or projects is often perceived as a threat. This is to a great extent related to the anticipated use of evaluation for accountability, which is often prioritized at the expense of using evaluation as a learning tool. Frequently it is argued that there is a trade-off between these two evaluation functions. An alternative…

The act of valuing in an evaluation may be perceived in different ways. We consider the multiple theoretic perspectives that govern an evaluator's behavior and present a typology of evaluator valuing roles. Within this typology we describe three ways in which value judgments are typically reached--by stakeholders alone, stakeholders and evaluators…

The aim of this chapter is to characterize educational reforms in Latin America over the last 25 years, and the way they reflect the role, method, and use of evaluation processes. The main theoretical and methodological tensions that are created by the development of evaluations will be reviewed, concluding with the identification of some of the…

In contrast to typical National Science Foundation program evaluations, the Utah State Math Science Partnership-Research, Evaluation and Technical Assistance Project (MSP-RETA) provided technical assistance (TA) in two forms: direct TA for up to 10 projects a year, and professional development sessions for a larger number of project staff. Not…

In 1999, the National Science Foundation (NSF) awarded funds to the Evaluation Center at Western Michigan University to conduct an external evaluation of the Advanced Technological Education (ATE) program. ATE, a federally mandated program designed to increase the number and quality of skilled technicians in the U.S. workforce, has funded over 346…

A cross-case analysis of four National Science Foundation (NSF) case studies identified both unique details and common themes related to promoting the use and influence of multisite evaluations. The analysis provided evidence of diverse evaluation use by stakeholders and suggested that people taking part in the multisite evaluations perceived…

New and novel uses of evaluation processes and findings are possible when a community of practice develops as evaluation stakeholders participate in multisite evaluations in multiple ways. Developing such communities takes advantage of what makes multisite evaluations special. This chapter uses the example of the Innovative Technology Experiences…

With the vast array of contextual factors, pedagogical approaches, models of implementation, and purposes of education and training related to online learning, educators, learners, and the general public alike are seeking answers regarding utility and effectiveness of online learning. This article identifies and responds to many of the challenges…

A team at the University of Minnesota conducted the Collaboratives for Excellence in Teacher Preparation (CETP) core evaluation between 1999 and 2004. The purpose of the CETP core evaluation was to achieve consensus among CETP project leaders and project evaluators on evaluation questions; to develop, pilot, and field test evaluation instruments…

In 1995, the National Science Foundation (NSF) contracted with principal investigator Iris Weiss and an evaluation team at Horizon Research, Inc. (HRI) to conduct a national evaluation of the Local Systemic Change for Teacher Enhancement program (LSC). HRI conducted the core evaluation under a $6.25 million contract with NSF. This program…

The authors propose a comprehensive evaluation framework to prepare for evaluating school emergency management programs. This framework involves a logic model that incorporates Government Performance and Results Act (GPRA) measures as a foundation for comprehensive evaluation that complements performance monitoring used by the U.S. Department of…

Programs and policies invariably contain new knowledge. Theories about knowledge utilization, diffusion, implementation, transfer, and knowledge translation theories illuminate some mechanisms of change processes. But more often than not, when it comes to understanding patterns about change processes, "the foreground" is privileged more…

Case studies about managing evaluation are examined for perspectives on expertise in managing evaluation. There are lessons on a geography of managing, managing as organizational work, the notions of "competency" and "expertise," and managing evaluation as professional work. Dreyfus and Dreyfus (2004) offer a framework for an introductory…