Surveys are frequently employed in needs assessment to collect information about gaps (the needs) in "what is" and "what should be" conditions. Double-scale Likert-type instruments are routinely used for this purpose. Although in accord with the discrepancy definition of need, the quality of such measures is being questioned to…

This study challenges persistent misrepresentations of evaluation as a value-neutral inquiry process by presenting an empirical study that deepens understanding of evaluators' values and how they "show up" in evaluation practice. Through semistructured interviews and inductive analysis, we examined the values advanced by a sample of…

This article outlines a three-phase, team-based approach used to analyze qualitative data from a nation-wide needs assessment of access to Veteran Health Administration services for rural-dwelling veterans. The method described here was used to develop the trustworthiness of findings from analysis of a large qualitative data set, without the use…

One of the most widely used communication tools in evaluation is the logic model. Despite its extensive use, there has been little research into the visualization aspect of the logic model. To assess the impact that design modifications would have on its effectiveness, we applied established visualization principles to revise a program model.…

Several analytic strategies exist for opening up the "black box" to reveal more about what drives policy and program impacts. This article focuses on one of these strategies: the Analysis of Symmetrically-Predicted Endogenous Subgroups (ASPES). ASPES uses exogenous baseline data to identify endogenously-defined subgroups, keeping the…

The connection between evaluation practice and its ultimate goal--social betterment--is indirect. With little or no direct control over social programs and policies, many evaluators rely on the actions of stakeholders to bridge the gap between evaluation practice and its purpose. Consequently, communicating with influence becomes key. The present…

Program evaluation is generally viewed as a set of mechanisms for collecting and using information to learn about projects, policies and programs, to understand their effects as well as the manner in which they are implemented. AEA has espoused principles for evaluation that place emphasis on competent, honest inquiry that respects the security,…

This article presents an interview with Eric Barela, a K-12 school district internal evaluator who conducted the Title I Best Practices study for the Los Angeles Unified School District (LAUSD), Research and Planning Division (formerly known as the Program Evaluation and Research Branch). In this interview, the author focuses not only on the…

This research describes, classifies, and comparatively evaluates national models and mechanisms used to evaluate research and allocate research funding in 16 countries. Although these models and mechanisms vary widely in terms of how research is evaluated and financed, nearly all share the common characteristic of relating funding to some measure…

Chelimsky, former head of the Program Evaluation and Methodology Division of the General Accounting Office, suggested that advocacy by evaluators destroys their credibility. Evaluators should, this author argues, be advocates for democracy and the public interest, with the question being how explicitly and how defensibly. (SLD)