Mixed methods evaluation has a long-standing history of enhancing the credibility of evaluation findings. However, using mixed methods in a utilitarian way implicitly emphasizes convenience over engaging with its philosophical underpinnings (Denscombe, 2008). Because of this, some mixed methods evaluators and social science researchers have been…

The goal of this chapter is to recommend quality criteria to guide evaluators' selections of sampling designs when mixing approaches. First, we contextualize our discussion of quality criteria and sampling designs by discussing the concept of interpretive consistency and how it impacts sampling decisions. Embedded in this discussion are…

The author argues that evaluators who are comfortable with the interpretation of competing values--an ability that can be fostered by exposure to the humanities--might be able to contribute significant advances toward finding a better balance of methodologies in an ever-more-ambiguous world. This argument is made by describing a…

This chapter outlines the core tenets of critical social theory and describes inherent issues facing evaluators conducting critical theory evaluation. Using critical pedagogy as an example, the authors describe the issues facing evaluators by developing four of the subtheories that comprise a critical social theory: (a) a theory of false…

The act of valuing in an evaluation may be perceived in different ways. We consider the multiple theoretic perspectives that govern an evaluator's behavior and present a typology of evaluator valuing roles. Within this typology we describe three ways in which value judgments are typically reached--by stakeholders alone, stakeholders and evaluators…

This chapter discusses the impact that four multisite National Science Foundation (NSF) evaluations had on the broader field of science, technology, engineering, and mathematics education and evaluation. Three approaches were used to investigate the broader impact of these evaluations on the field: (a) a citation analysis, (b) an on-line survey,…

In 1999, the National Science Foundation (NSF) awarded funds to the Evaluation Center at Western Michigan University to conduct an external evaluation of the Advanced Technological Education (ATE) program. ATE, a federally mandated program designed to increase the number and quality of skilled technicians in the U.S. workforce, has funded over 346…

Five knowledge-for-action theories are summarized and compared in this chapter for their evaluation implications: knowledge utilization, diffusion, implementation, transfer, and translation. Usually dispersed across multiple fields and disciplines, these theories are gathered here for a common focus on knowledge and change. Knowledge in some form…

New and novel uses of evaluation processes and findings are possible when a community of practice develops as evaluation stakeholders participate in multisite evaluations in multiple ways. Developing such communities takes advantage of what makes multisite evaluations special. This chapter uses the example of the Innovative Technology Experiences…

Whether looking at the spread and adoption of an intervention across a community, across multiple units, or within a single unit, an understanding of diffusion theory can help evaluators uncover patterns and impacts that might otherwise be overlooked. The theory alerts evaluators to examine why uptake of an intervention appeared different in…

A team at the University of Minnesota conducted the Collaboratives for Excellence in Teacher Preparation (CETP) core evaluation between 1999 and 2004. The purpose of the CETP core evaluation was to achieve consensus among CETP project leaders and project evaluators on evaluation questions; to develop, pilot, and field test evaluation instruments…

In 1995, the National Science Foundation (NSF) contracted with principal investigator Iris Weiss and an evaluation team at Horizon Research, Inc. (HRI) to conduct a national evaluation of the Local Systemic Change for Teacher Enhancement program (LSC). HRI conducted the core evaluation under a $6.25 million contract with NSF. This program…

Transfer is a term used in many fields to describe a change process involving movement of knowledge, skills, or policy from one place to another. The central components of transfer invite the evaluator to conceptualize the change process in terms of a starting point, different understandings of what is being transferred, the medium or mechanism,…

Translation theory originates in the field of applied linguistics and communication. The term knowledge translation has been adopted in health and other fields to refer to the exchange, synthesis, and application of knowledge. The logic model is a circular or iterative loop among various knowledge translation actors (knowledge producers and users)…

Programs and policies invariably contain new knowledge. Theories about knowledge utilization, diffusion, implementation, transfer, and knowledge translation theories illuminate some mechanisms of change processes. But more often than not, when it comes to understanding patterns about change processes, "the foreground" is privileged more…