In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between…

Each year a great many evaluations are conducted of international development efforts around the world. These development evaluations study projects, programs, country-wide portfolios, policy reform efforts, and other topics of interest to funders, governments, program managers, and other involved stakeholders. Although some of these evaluations…

This study examines ways in which evaluators' principles influence decisions about evaluation resources. Evaluators must seek-out and allocate (often scarce) resources (e.g., money, time, data, people, places) in a way that allows them to conduct the best possible evaluation given clients' and evaluation participants' constraints. Working within…

This fact sheet summarizes data gathered in the 2012 survey of National Science Foundation (NSF) Advanced Technological Education (ATE) grant recipients. Conducted by EvaluATE, the evaluation resource center for the ATE program located at The Evaluation Center at Western Michigan University, this was the thirteenth annual survey of ATE projects…

This fact sheet summarizes data gathered in the 2011 survey of National Science Foundation (NSF) Advanced Technological Education (ATE) grant recipients. Conducted by EvaluATE, the evaluation resource center for the ATE program located at The Evaluation Center at Western Michigan University, this was the twelfth annual survey of ATE projects and…

This fact sheet summarizes data gathered in the 2010 survey of National Science Foundation (NSF) Advanced Technological Education (ATE) grant recipients. Conducted by EvaluATE, the evaluation resource center for the ATE program located at The Evaluation Center at Western Michigan University, this was the eleventh annual survey of ATE projects and…

Evaluation capacity building, or ECB, is an area of great interest within the field of evaluation as well as in Extension evaluation. Internal Extension evaluators have long offered training and technical assistance to help Extension educators conduct evaluation. Today ECB in Extension encompasses myriad activities and processes to advance…

This fact sheet summarizes data gathered in the 2009 survey of National Science Foundation (NSF) Advanced Technological Education (ATE) grant recipients. Conducted by The Evaluation Center at Western Michigan University, this was the tenth annual survey of ATE projects and centers. Included here are statistics about the program's grantees and…

Anecdotal evidence from interviews with some program managers gives evidence that unintended negative consequences of evaluations are more than a theoretical concern; they are a real problem deserving an evaluator's attention and energy. Negative consequences usually include: (1) wasted resources; (2) demotivation; and (3) program destruction and…

Data from two studies of evaluation budgeting practices are presented to determine how resources are typically allocated across budget categories in evaluation studies. A common pattern showed these allocations: (1) 61 percent to personnel; (2) 13 to 14 percent to overhead; and (3) 15 percent to all other categories. (Author/LMO)

Although a necessary component of good program management and accountability, monitoring data do not usually provide answers to questions about whether, how, and why a specific program works. More in-depth, systematic inquiry is needed to do this. In this article, the authors focus on the evaluation of human immunodeficiency virus (HIV)-prevention…

This fact sheet summarizes data gathered in the 2008 survey of National Science Foundation (NSF) Advanced Technological Education (ATE) grant recipients. Conducted by The Evaluation Center at Western Michigan University, this was the ninth annual survey of ATE projects and centers. Included here are statistics about the program's grantees and…

This paper reports results of a 1979 survey of heads of evaluation units in public school districts and state departments of education. The survey was primarily concerned with current versus ideal procedures for determining program evaluation budgets and evaluators' perceived reasons for the low fiscal priority given evaluation activities.…

Data from two studies on evaluation budgeting practices are presented. In the first study, estimated budget figures are provided for formative and summative evaluations by 29 state education agency evaluators. In the second study, initial budget figures, final costs, and study characteristics are abstracted from the records of 85 evaluations…

The evaluation team of the Lincoln Public Schools (Nebraska) used the multi-attribution utility technology (MAUT) approach to prioritize potential evaluation projects. The priorities were used to allocate resources to the district's most important projects, and to eliminate or scale down less important projects. The problem was caused initially…