The authors tell about their heterogeneous 91 person research and evaluation unit at an operating foundation in St. Paul, Minnesota. They focus on evaluation for program improvement, one of several purposes of studies they work on. The three authors write from their different manager positions within the unit. Included are the context of the…

The impact of No Child Left Behind (NCLB) is usually understood in relation to schools and districts, but the legislation has also affected community-based organizations that operate school-linked programs. This case study of an after-school program in California demonstrates how educational accountability systems that emphasize students' academic…

Understanding the influence of multisite evaluation requires careful consideration of cultural context. The author illustrates dimensions of influence and culture with excerpts from four National Science Foundation evaluation case studies and summarizes what influence teaches everyone about culture and what culture teaches everyone about…

The author considers whether current evaluation practice is of value to the Cooperative Extension System. Evaluation use and influence in Extension are characterized through literature review and examination of case examples informed by correspondence with study authors. The more than 675 evaluations examined consistently yielded specific and…

In 1999, the National Science Foundation (NSF) awarded funds to the Evaluation Center at Western Michigan University to conduct an external evaluation of the Advanced Technological Education (ATE) program. ATE, a federally mandated program designed to increase the number and quality of skilled technicians in the U.S. workforce, has funded over 346…

A cross-case analysis of four National Science Foundation (NSF) case studies identified both unique details and common themes related to promoting the use and influence of multisite evaluations. The analysis provided evidence of diverse evaluation use by stakeholders and suggested that people taking part in the multisite evaluations perceived…

The authors present the argument that evaluation as currently practiced is failing the needs of the social sector, if the goal is to help organizations achieve their mission. Three case studies are presented in which evaluation played a key role in the development of a learning culture within the organization. Each case highlights the positive…

In 1995, the National Science Foundation (NSF) contracted with principal investigator Iris Weiss and an evaluation team at Horizon Research, Inc. (HRI) to conduct a national evaluation of the Local Systemic Change for Teacher Enhancement program (LSC). HRI conducted the core evaluation under a $6.25 million contract with NSF. This program…

Case studies about managing evaluation are examined for perspectives on expertise in managing evaluation. There are lessons on a geography of managing, managing as organizational work, the notions of "competency" and "expertise," and managing evaluation as professional work. Dreyfus and Dreyfus (2004) offer a framework for an introductory…

The authors explore what evaluation looks like, in practice, among today's nonprofit organizations on the basis of their survey results. The types of evaluation activities nonprofit organizations are engaging in on a regular basis, as well as the types of data they are collecting and how they are using these data, are described. How nonprofits…

Donald W. Compton, the first director of evaluation services at the National Home Office (Atlanta) of the American Cancer Society, tells the story of building the unit in conditions of high demand and a limited budget. Along the way, evaluation was brought to regional divisions and to local offices in part as a response to United Way and to his…

Focuses on the evaluation capacity building (ECB) outreach activities of the World Bank with regard to provision of advice and assistance to individual governments. The primary story is that of the ECB lessons learned through working with a range of governments; the secondary story is how ECB is becoming a recognized and valued activity within the…

The six chapters of this theme issue attempt to define conceptual and methodological issues in the evaluation of integrated services systems and to begin to synthesize some of these issues. An introduction to these evaluation issues is followed by case studies and a discussion of implications for program and policy development. (SLD)

A review of qualitative methods used in a predominantly quantitative evaluation indicates a variety of roles for such a mixing of methods, including framing and revising research questions, assessing the validity of measures and adaptations to program implementation, and gauging the degree of uncertainty and generalizability of conclusions.…

The role of nonprofit human service executive directors in their organizations' program evaluation process is described. Recognizing that the leader's perspective from within the organization is fundamental to building capacity for and utilizing program evaluation, this study examines 42 executive directors to determine how they view program…