In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between…

For the internal evaluator, the issue of trust can be one of the more difficult ethical matters to manage. An organization might choose to conduct an internal program evaluation for a variety of reasons, including capitalizing on the abilities of invested stakeholders to assess aspects of a program, building an institutional culture oriented…

The impact of No Child Left Behind (NCLB) is usually understood in relation to schools and districts, but the legislation has also affected community-based organizations that operate school-linked programs. This case study of an after-school program in California demonstrates how educational accountability systems that emphasize students' academic…

This article discusses how to make process use an independent variable in evaluation practice: the purposeful means of building an organization's capacity to conduct and use evaluations in the long run. The goal of evaluation capacity building (ECB) is to strengthen and sustain effective program evaluation practices through a number of activities:…

The various arts and sciences that comprise the field of program evaluation are discussed. It is argued that emphasis on rigor and expressive content has left other aspects of evaluation unexplored. Educational evaluators need to consider what programs mean and how they contribute to understanding. (SLD)

Described is a procedure (Audit Dress Rehearsal) used in a special education program audit consultation service which included a practice audit designed to lower anxiety and raise awareness of concern for program success. The introduction includes sections dealing with evaluation and audit personnel, planning and implementing an audit, and stages…

This article refers to two uses of the term "program theory": (1) microtheory to describe the model of the program; and (2) macrotheory which is concerned with factors that affect social change both within and outside programs. Barriers to successful utilization of evaluation and suggestions to overcome those barriers are discussed. (JAZ)

Describes the rationale, structure, and operation of a new evaluation procedure in which pro and con presentations are made to a hearing panel that recommends action on the question posed. Suggestions are made for further improvement and development of this new procedure. (Author)

There is a need for a set of organizing principles that will provide a clear rationale for the field of program evaluation. It is contended that the concept of evaluation promoted by Ralph W. Tyler, pioneer in the field, suggests such a set of principles. Data were derived from a two-year prescriptive case study of Tyler's contributions through…

A good formative evaluator, who helps programs become as effective as possible, behaves remarkably like a good personal coach. Nine ways in which a formative evaluator can help a program manager are listed, and implications for practicing evaluators and the evaluation profession are detailed. (SLD)

Program theory can be used to improve programs and policies. This article describes a set of techniques for complicating and simplifying program theory, referred to as conceptual and action heuristics. Methods such as analyzing metaphors, clarifying concepts, mapping, component assessment, causal modeling, and decision analysis are discussed. (JAZ)

Ethical issues relating to naturalistic evaluation are addressed, focusing on the role of the evaluator, problems of privacy and data gathering techniques, and issues relating to the use/abuse of findings. Benefits and costs of the naturalistic approach to program evaluation are also identified. (EGS)

This issue of "The Evaluation Exchange" describes new developments in evaluating advocacy and policy change efforts that attempt to inform or influence public policy at the local, state, or federal levels. Heather B. Weiss introduces the themes in this issue in "From the Director's Desk," examining how evaluation of advocacy…

A legal model, involving a courtroom and jury, is presented as a method of educational evaluation. The negative reactions to the approach's previous supporters--Robert L. Wolf and Murray Levine--are discussed. The author interprets the trial in judicial educational evaluation as an adversarial process used to probe the complexities underlying an…

Discussed are the processes involved in course evaluation to promote course improvement, some problems of the methodology employed, including the psychometric and illuminative methods, and implications for universities. (JMD)