Premised on the idea that evaluators should be familiar with a range of approaches to program modifications, I review several existing approaches and then describe another, less well-recognized option. In this newer option, evaluators work with others to identify potentially needed adaptations for select program aspects "in advance." In…

In this study, we investigated the impact of the evaluation capacity building (ECB) efforts of an organization by examining the evaluation plans included in funding proposals over a 14-year period. Specifically, we sought to determine the degree to which and how evaluation plans in proposals to one National Science Foundation (NSF) program changed…

Within the context of intentional collaboration between doctoral-level program evaluation and counselor educators, this article addresses the need for advanced training in program evaluation for preservice doctoral-level counselor education (CE) students. To determine the current level of evaluation training provided to doctoral students attending…

As global discussions of evaluation standards become more contextually nuanced, culturally responsive conceptions of ethics have not been sufficiently discussed. In academic social research, ethical clearance processes have been designed to protect vulnerable people from harm related to participation in a research project. This article expands the…

In this paper we describe an evaluation training program sponsored by the Robert Wood Johnson Foundation and led by Duquesne University and OMG Center for Collaborative Learning designed to meet the challenge of developing a cadre of diverse evaluation professionals, specifically those from traditionally underrepresented or underserved…

Extracted from a larger study of the educational evaluation profession, this qualitative analysis explores how evaluator identity is shaped with constant reference to political economy, knowledge work, and personal history. Interviews with 24 social scientists who conduct or have conducted evaluations as a major part of their careers examined how…

In this paper we share our reflections, as evaluators, on an evaluation where we encountered Excessive Evaluation Anxiety (XEA). The signs of XEA which we discerned were particularly evident amongst the program head and staff who were part of a new training program. We present our insights on the evaluation process and its difficulties, as well as…

Program evaluation is recognized as an essential skill set for practitioners in service-related fields, such as education, nonprofit management, social work, and public health. Recently, the need for a public workforce trained in evaluation has increased and is driven primarily by our nation's emphasis on accountability during a time when…

The author is increasingly sensitive to the Venn diagram of overlapping expertise in which program evaluation intersects a content area such as public health, urban education, or--in the case of Katherine Hay--international development. Many evaluators practice in these areas of overlap, experts in the evaluation of a specific domain. Given her…

No self-report measure of cultural competence currently exists in program evaluation. Adapting items from cultural competence measures in fields such as counseling and nursing, the researchers developed the Cultural Competence of Program Evaluators (CCPE) self-report scale. The goals of this study were to validate the CCPE and to assess…

We tested for inflationary bias introduced through retrospective pretests by analyzing traditional pretest, retrospective pretest, and posttest evaluation data collected on a first-line supervisory leadership training program, involving 196 supervisors and their subordinates, across 17 organizational settings. Retrospective pretest ratings by both…

Increasingly, staff members in community and public health programs and projects are required to undertake evaluation activities. There is, however, limited capacity for, and understanding of, evaluation within this workforce. Building the capability of individual workers and thereby contributing to the overall capacity among the community and…

Brinkerhoff's Success Case Method (SCM) was developed with the specific purpose of assessing the impact of organizational interventions (e.g., training and coaching) on business goals by analyzing extreme groups using case study techniques and storytelling. As an efficient and cost-effective method of evaluative inquiry, SCM is attractive in other…

Proposes a multifaceted approach to making evaluation a part of organizational culture. The approach includes using allies, examples, models, research, process guides, and trainers/developers. (SLD)

Discusses teaching and training about evaluation with metaphors. Helping those who study evaluation perceive analogies and metaphors related to evaluation helps them understand truths about the rich diversity of evaluation. (SLD)