Knowledge brokering is a promising practice for addressing the challenge of using research evidence, including evaluation findings, in policy implementation. For public policy practitioners, it means playing the role of an intermediary who steers the flow of knowledge between producers (researchers) and users (decision makers). It requires a set…

Joseph S. Wholey is Professor Emeritus in the University of Southern California's (USC) School of Public Policy, Planning, and Development. He received his BA from Catholic University, Phi Beta Kappa and his MA in mathematics and PhD in philosophy from Harvard University. His work focuses on the use of strategic planning, performance measurement,…

In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between…

Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome…

In the past few years researchers have published lists of evidence-based practices that research indicates "should" be in place in programs and supports for students with emotional or behavioral disorders (EBD) (e.g., Farley, Torres, Wailehua, & Cook, 2012; Ryan, Pierce, & Mooney, 2008; Simpson, Peterson, & Smith, 2011). Some…

For the internal evaluator, the issue of trust can be one of the more difficult ethical matters to manage. An organization might choose to conduct an internal program evaluation for a variety of reasons, including capitalizing on the abilities of invested stakeholders to assess aspects of a program, building an institutional culture oriented…

The authors tell about their heterogeneous 91 person research and evaluation unit at an operating foundation in St. Paul, Minnesota. They focus on evaluation for program improvement, one of several purposes of studies they work on. The three authors write from their different manager positions within the unit. Included are the context of the…

The impact of No Child Left Behind (NCLB) is usually understood in relation to schools and districts, but the legislation has also affected community-based organizations that operate school-linked programs. This case study of an after-school program in California demonstrates how educational accountability systems that emphasize students' academic…

This article discusses how to make process use an independent variable in evaluation practice: the purposeful means of building an organization's capacity to conduct and use evaluations in the long run. The goal of evaluation capacity building (ECB) is to strengthen and sustain effective program evaluation practices through a number of activities:…

Discusses the importance of program evaluation, detailing the first step, selecting and working with an evaluator, and the terminology and uses of evaluation. Argues that evaluations should be cooperative ventures between evaluators and those evaluated, and should be part of a program from its inception; and that evaluators have both rights and…

The various arts and sciences that comprise the field of program evaluation are discussed. It is argued that emphasis on rigor and expressive content has left other aspects of evaluation unexplored. Educational evaluators need to consider what programs mean and how they contribute to understanding. (SLD)

Evaluability assessment is a diagnostic and prescriptive technique that can be used to determine the extent to which different problems inhibit program evaluation. It involves policymakers, managers, and staff in developing program theory, clarifying intended uses of evaluation information, and planning further evaluations that would stimulate…

This article refers to two uses of the term "program theory": (1) microtheory to describe the model of the program; and (2) macrotheory which is concerned with factors that affect social change both within and outside programs. Barriers to successful utilization of evaluation and suggestions to overcome those barriers are discussed. (JAZ)

Describes the rationale, structure, and operation of a new evaluation procedure in which pro and con presentations are made to a hearing panel that recommends action on the question posed. Suggestions are made for further improvement and development of this new procedure. (Author)

It is suggested that the developmental phases of program evaluators replicate those of the profession of program evaluation. A trend in program evaluation from program amelioration to program advocacy and ultimately to program accountability is projected. (Author/MH)