In this column, the author revisits who we are as assessment professionals, how we are trained, what our role is, and what our responsibilities are--to ourselves as a community, to our colleagues in education, at our institution, and to those we serve-- especially from an equity lens. They also share a few strategies to address the gaps they see.

The European Research Council (ERC) receives many high-quality applications, but funds only a few. We analyze how members of ERC review panels assess applications in the first, highly competitive step of evaluations for ERC Starting and Consolidator Grants. Drawing on interviews with ERC panel members in different fields, we show that they adopt a…

The second article in this series on the history of evaluation use has three sections. The first and longest develops a functional definition of the term "use," noting that a thorough definition of evaluation use includes the initial stimulus (i.e., evaluation findings or process), the user, the way people use the information, the aspect…

Evaluation professionals need to be nimble and innovative in their approaches in order to be relevant and provide useful evidence to decision-makers, stakeholders, and society in the crowded public policy landscape. In this article, we offer serious games as a method that can be employed by evaluators to address three persisting challenges in…

Internal evaluators encounter risks but also significant opportunities to strengthen organizational and professional ethics. Potential contributions depend, in part, on the conjunction of ethics and evaluation in the role of the internal evaluator as the person specially commissioned to investigate value and render judgment based on evidence…

This chapter describes the author's experience and insights as the chief of evaluation for public diplomacy at the U.S. Department of State, and as a consultant assisting federal agencies in a multitude of evaluation activities relating what helps and hinders internal evaluation functions. The article discusses the challenges faced by the internal…

This chapter features a recent conversation with Dr. Arnold J. Love, a long-time proponent of internal evaluation and one of the most cited internal evaluation authors. In 1983, Love edited the first issue of "New Directions for Program Evaluation" on the topic of internal evaluation. He is the author of the book "Internal…

In a 2004 interview with the late Everett Rogers, author of the book "Diffusion of Innovation", Rogers lamented that in 1963, he and other members of a prominent research group expected to solve the remaining international development problems and end poverty within ten to fifteen years. Now, forty-five years hence, it is time for a "reality…

Develops a constructivist view of evaluation as learning, arguing for a more complex and variegated understanding of use. Elaborates the notion of evaluation serving an educative purpose and suggests that the evaluator is a partner in the construction of knowledge. Illustrates the critical inquiry process that fosters knowledge construction.…

While legislative oversight offices, like many evaluation and policy analysis units, face substantial challenges in promoting use of their work by policymakers, they often have not taken steps to overcome these challenges by adopting the strategies suggested by the evaluation literature. Although the offices seek utilization, they have not fully…

This paper discusses two models that hold promise for helping evaluators understand and cope with different decision contexts: (1) the conflict Model (Janis and Mann, 1977) and the Social Process Model (Vroom and Yago, 1974). Implications and guidelines for using decisionmaking models in evaluation settings are presented. (BS)

This paper considers the setting of evaluation from the perspective of the situations and stages of problem solving in which institutional leaders might call for the assistance of evaluators. This discussion should provide evaluators with a framework to understand and adjust their interactions with the environmental context of the evaluation. R.…

Various strategies for optimizing the use of program evaluation information are recommended, based on a thorough evaluation of the literature. The recently revised "Program Evaluation Standards" (Joint Committee, 1994) are then reviewed point by point as regards sensitivity to these recommendations. It appears that the new standards…

Discusses ways in which a community-based program evaluation can be enhanced by using a screening tool to delineate the program's evaluative needs, resources, and commitments. Describes use of the Evaluation Pre-Screening Tool and reports on some examples of successful use. (SLD)

The user-oriented and utilization-focused evaluation design of the two-year Caribbean Agricultural Extension Project, funded by Aid to International Development, is reviewed. The evaluation scope, stakeholders, evaluation team credibility, official approval of evaluation, and confidence in the evaluation process are addressed, within a…