The second article in this series on the history of evaluation use has three sections. The first and longest develops a functional definition of the term "use," noting that a thorough definition of evaluation use includes the initial stimulus (i.e., evaluation findings or process), the user, the way people use the information, the aspect…

Eleven years ago, this author became the director of the Idaho State Legislature's Office of Performance Evaluations. As only the second person in that role, he considered the office and its function to be still evolving and because he understood legislative leadership to be interested in seeing evaluation work that could actually…

This paper addresses the issue of the knowledge gap between evaluators and the entity being evaluated: the dilemma of the knowledge of professional evaluators vs. the in-depth knowledge of the evaluated subjects. In order to optimize evaluative outcomes, the author suggests an approach based on ideas borrowed from the science of cybernetics as a…

The Case of Top Beginnings and the Missing Child Outcomes is a fictionalized case study of a set of evaluation challenges faced in evaluating comprehensive initiatives that are seeking to build systems. In this case, the issue is a multistate foundation-funded early learning system building initiative that has to date primarily employed a case…

Discusses ethical challenges faced by evaluators, especially those who have gotten into problems while conducting the evaluation. Introduces the other articles in this theme section. (SLD)

Challenges the assumption that evaluation should aim for fostering deliberative democracy. A modest effort by an evaluator to contribute to deliberative democracy is defensible, but vigorous political advocacy violates social expectation. (Author/SLD)

While legislative oversight offices, like many evaluation and policy analysis units, face substantial challenges in promoting use of their work by policymakers, they often have not taken steps to overcome these challenges by adopting the strategies suggested by the evaluation literature. Although the offices seek utilization, they have not fully…

Outlines a scenario in which an evaluator wants to ask questions of teenagers that may pose ethical problems, or may be perceived as posing such problems. The hypothetical situation is the evaluation of a life skills program aimed at reducing the teen birth rate. (SLD)

Although the need for evaluation of prevention programs is clear, the implementation of evaluation, particularly for large, complex projects with multiple investigators, poses numerous challenges. Program evaluators in these circumstances do not have the same degree of control as, say, experimental psychologists and must find ways to obtain data…

How can indigenous evaluators implement culturally competent models in First Nations communities while ensuring that government grant evaluation requirements are met? Through describing the challenges in one tribal community in the United States, this article will discuss how American Indian/Alaska Native substance abuse prevention programs are…

Describes the challenges faced by researchers in evaluating a neighborhood revitalization project. Places the challenges in the context of three of the Program Evaluation Standards of the Joint Committee on Standards for Educational Evaluation: Values Identification, Fiscal Responsibility, and Analysis of Quantitative Information. (SLD)

The American Indian Higher Education Consortium (AIHEC), comprising 34 American Indian tribally controlled colleges and universities, has undertaken a comprehensive effort to develop an "Indigenous Framework for Evaluation" that synthesizes Indigenous ways of knowing and Western evaluation practice. To ground the framework, AIHEC engaged…

The events leading up to a controversial external evaluation in a small school district in Chicago are described from the client's viewpoint. Focus is on the community unrest and tension that shaped the evaluation contract. (TJH)

Anecdotal evidence from interviews with some program managers gives evidence that unintended negative consequences of evaluations are more than a theoretical concern; they are a real problem deserving an evaluator's attention and energy. Negative consequences usually include: (1) wasted resources; (2) demotivation; and (3) program destruction and…

This article refers to two uses of the term "program theory": (1) microtheory to describe the model of the program; and (2) macrotheory which is concerned with factors that affect social change both within and outside programs. Barriers to successful utilization of evaluation and suggestions to overcome those barriers are discussed. (JAZ)