Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between…

The papers in this dialogue help develop evaluation as a field (both in South Asia and other regions). What comes through in all of the papers is both humility of where evaluation is as a field and imagination and ambition of where evaluators could be in the near future. Reading the papers in this forum makes them enthusiastic about being…

Grantees on national projects are often required by their funders to take part in evaluation activities. While the requirement can encourage compliance, grantees can feel overburdened and disempowered with their evaluation experience. Evaluators in a national cross-site evaluation utilized multiple strategies for obtaining buy-in of participating…

Studies were conducted by the American Institute for Research (AIR) under contract with the Department of Education (ED). An evaluability assessment determines the extent to which a program is ready for evaluation, the changes needed to make the program more manageable and accountable, and toward what questions a more extensive evaluation might…

This paper reviews what has been learned about evaluation ultilization during the past 20 years. Evaluation utilization is discussed in terms of what is used, who uses evaluation, when evaluation is used, how evaluation is used, where evaluation is used, and why evaluation is used. It is suggested that the personal factor - the interests and…

Brief case studies of three projects are presented to illustrate the steps which open "Wonderful Programs" to evaluation research. The evaluator is provided with the perspective needed to believe the evaluation is worth doing. The project staff is then redirected to the need for a new type of evidence. An ongoing review of the commitment…

Strategies for use by clients who commission evaluation studies in the private, university, or governmental sector are outlined. Topics covered include establishing the purpose of the evaluation, assembling in-house management staff, specifying work and expertise requirements, establishing confidentiality and project control, and managing results.…

Four functions of federal project officers in managing program evaluations with support from contract research firms are described: (1) articulating evaluation requirements; (2) providing for fairness in contract awards; (3) monitoring ongoing studies; and (4) transmitting evaluation results to decision makers. (Author/PN)

An evaluation of the in-service education and training (INSET) of teachers in Britain is based on careful analysis of the characteristics of the evaluation task, target, and agent and, more specifically, upon the way in which these three factors interact in any one cell of the model. (JMF)

A framework is presented to identify programs with the highest potential for payoffs to management resulting from evaluation. Several program initiatives may be evaluated in organizations. Criteria for assessing needs and standards for prioritizing programs are presented. Evaluators must analyze alternatives and determine which one successfully…

This paper proposes a humanistic approach that may not be evaluation as commonly regarded, but it does have a much greater chance to enact program improvement. It assumes that program developers and directors really want their activities to be effective and relevant. The role of the evaluator is that of facilitator, that of a linking pin to…

Selected aspects of the problem of obtaining unbiased program or product evaluation are discussed. An evaluator who is a member of the project staff will have difficulty producing an evaluation which is credible and valid. Project monitors will also have a problem since they are often required to assume the conflicting roles of external evaluator…

Findings from a study of Illinois' educational evaluation process, in which external evaluators conduct the evaluation, are presented in this paper. Methodology involved analysis by State Board of Education staff of requests for proposals (RFPs); these were mailed to 121 potential bidders for external evaluation. Bidders included universities,…

Evaluation must take into account both executive and legislative politics and their interactions. A five-part continuum evaluation process is suggested for the development of a policy question and its translation into knowledge that is credible, timely, responsive, and usable. Evaluators have a major responsibility in this process. (Author/JAZ)