Joseph S. Wholey is Professor Emeritus in the University of Southern California's (USC) School of Public Policy, Planning, and Development. He received his BA from Catholic University, Phi Beta Kappa and his MA in mathematics and PhD in philosophy from Harvard University. His work focuses on the use of strategic planning, performance measurement,…

In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between…

Blending high-quality and rigorous research with pure evaluation practice can often be best accomplished through thoughtful collaboration. The evaluation of a high school drug prevention program (All Stars Senior) is an example of how perceived competing purposes and methodologies can coexist to investigate formative and summative outcome…

In the past few years researchers have published lists of evidence-based practices that research indicates "should" be in place in programs and supports for students with emotional or behavioral disorders (EBD) (e.g., Farley, Torres, Wailehua, & Cook, 2012; Ryan, Pierce, & Mooney, 2008; Simpson, Peterson, & Smith, 2011). Some…

For the internal evaluator, the issue of trust can be one of the more difficult ethical matters to manage. An organization might choose to conduct an internal program evaluation for a variety of reasons, including capitalizing on the abilities of invested stakeholders to assess aspects of a program, building an institutional culture oriented…

This fact sheet summarizes data gathered in the 2012 survey of National Science Foundation (NSF) Advanced Technological Education (ATE) grant recipients. Conducted by EvaluATE, the evaluation resource center for the ATE program located at The Evaluation Center at Western Michigan University, this was the thirteenth annual survey of ATE projects…

The authors tell about their heterogeneous 91 person research and evaluation unit at an operating foundation in St. Paul, Minnesota. They focus on evaluation for program improvement, one of several purposes of studies they work on. The three authors write from their different manager positions within the unit. Included are the context of the…

This fact sheet summarizes data gathered in the 2011 survey of National Science Foundation (NSF) Advanced Technological Education (ATE) grant recipients. Conducted by EvaluATE, the evaluation resource center for the ATE program located at The Evaluation Center at Western Michigan University, this was the twelfth annual survey of ATE projects and…

The impact of No Child Left Behind (NCLB) is usually understood in relation to schools and districts, but the legislation has also affected community-based organizations that operate school-linked programs. This case study of an after-school program in California demonstrates how educational accountability systems that emphasize students' academic…

This article discusses how to make process use an independent variable in evaluation practice: the purposeful means of building an organization's capacity to conduct and use evaluations in the long run. The goal of evaluation capacity building (ECB) is to strengthen and sustain effective program evaluation practices through a number of activities:…

This fact sheet summarizes data gathered in the 2010 survey of National Science Foundation (NSF) Advanced Technological Education (ATE) grant recipients. Conducted by EvaluATE, the evaluation resource center for the ATE program located at The Evaluation Center at Western Michigan University, this was the eleventh annual survey of ATE projects and…

Three specific points are made about helping program managers improve their use of information: (1) program managers appear to be the easiest group for evaluators to work with to improve use; (2) realistically, these managers may be the most difficult group to help; and (3) several strategies exist that evaluators use to help program people…

Outside evaluators of a writing program can assess the program's effectiveness, can support the work in a program that has become visible and subject to criticism, are easier to listen to than local faculty members, and can help clarify and resolve conflicting notions members of the department may have about the program's reason for being. First,…

Discusses the importance of program evaluation, detailing the first step, selecting and working with an evaluator, and the terminology and uses of evaluation. Argues that evaluations should be cooperative ventures between evaluators and those evaluated, and should be part of a program from its inception; and that evaluators have both rights and…

The various arts and sciences that comprise the field of program evaluation are discussed. It is argued that emphasis on rigor and expressive content has left other aspects of evaluation unexplored. Educational evaluators need to consider what programs mean and how they contribute to understanding. (SLD)