Drawing on a qualitative study of an educational reform and its external evaluation, I describe how a well-intentioned but poorly conceptualized evaluation helped perpetuate asymmetries in the generation and use of evaluation findings. This article explores this project's failure to clarify evaluator roles, identify intended users and expected…

We conducted a youth participatory evaluation of a bullying prevention curriculum before the curriculum was implemented in communities. We partnered with youths from a young women leaders' program to reduce the number of lessons in an existing curriculum and determine which activities were likely to have the greatest impact. To evaluate the…

From a utilization-focused evaluation perspective, the success of an evaluation is rooted in the extent to which the evaluation was used by stakeholders. This paper details the "Expectations to Change" (E2C) process, an interactive, workshop-based method designed to engage primary users with their evaluation findings as a means of…

This article explores the relationship between the lack of visible attention to formative assessment in degree specifications and its marginalization in practice. Degree specification documents form part of the quality apparatus emphasizing the accountability and certification duties of assessment. Ironically, a framework designed to assure…

This article presents an interview with Michael Patton whose professional evolution has contributed to the way evaluation in the United States is understood and practiced today. Patton is an evaluation and organizational development consultant who spent 18 years at the University of Minnesota (1973-1991), including 5 years as the director of the…

The research reported in this paper is focused directly on assessing the validity of the "Teaching Knowledge about Reading and Reading Practices" (TKRRP) assessment. Following the recommendations of the Standards for Educational and Psychological Testing (APA/AERA, 1999), the authors see validation as a process of constructing an…

In spite of the scarcity of empirical studies of evaluation, such studies are critical to development of evaluation theory. Illustrative examples are given of studies of evaluation practice that operationalize theory. Although practitioners should continue public reflection, they must also focus on the independent and empirical study of…

This paper reviews models of program evaluation. Major topics and issues found in the evaluation literature include quantitative versus qualitative approaches, identification and involvement of stakeholders, formulation of research questions, collection of data, analysis and interpretation of data, reporting of results, evaluation utilization, and…

Ethnographic qualitative assessment methods can be used to evaluate gifted programs. Noted are the use of multiple tools in fieldwork, allowing an extended time span, the research as the research instrument, ethnographics research cycle, and use of both macro and micro approaches to the evaluation product. (Author/CB)

The use of qualitative evaluation methods is explored as a means of overcoming constraints and complexities of evaluation of development programs. A case study demonstrating the application of qualitative analysis to monitoring and evaluation of the Basic Minimum Needs program in Thailand is presented. (SLD)

Continuing the interchange of ideas about evaluation methodology, the authors argue the advisability of using the entire array of methods to produce useful and persuasive findings. There is, ultimately, a truth to be sought, but no one approach has a monopoly on finding it. (SLD)

Empowerment evaluation is an innovative approach that uses evaluation concepts and techniques to foster improvement and self-determination. Empowerment evaluation employs qualitative and quantitative methodologies. Although it can be applied to individuals and organizations, the usual focus is on programs. The value orientation of empowerment…

Qualitative evaluation and quantitative evaluation are discussed, examining how the perspective of each can and should create a critical debate that encourages inquiry instead of hostility. To achieve the major goal of linking evaluation information to the organization's culture, the evaluator needs to use multiple methods in a responsive,…

This paper explores the impact that the evaluation industry has had on the development and implementation of social policy and programs, primarily as carried out by the U.S. Departments of Labor and Health and Human Services. In addition, major tools evaluators have developed and used, and the institutional arrangements through which they have…

The evaluation of a science education project for teachers in Durban (South Africa) illustrates some problems inherent in the application of the fourth-generation evaluation approach of Guba and Lincoln. One of the strongest concerns is that full participation by stakeholders may be an unrealistic assumption. (SLD)