Certain expectations that federal officials have about evaluation researchers are discussed. Included are: (1) presence of a clear understanding of what evaluation means; (2) procedure for carrying out an evaluation; and (3) understanding by the evaluator of how the research relates to the decision-making process. (Author/GK)

The nine articles of this theme issue provide overviews of legislative program evaluation and demonstrate the tensions caused by the conflict between utility and rigor in such evaluations. Legislative evaluation is concerned with evaluation utilization because legislators commission evaluations they expect to use. (SLD)

Bertram S. Brown, former director of the National Institute of Mental Health, discusses conflicts between scientific and value dimensions of evaluation. He relates this conflict to: usefulness of mental health program evaluations; conduct of internal evaluations; release of findings; training; rating of reports; and planned change consultation.…

This paper provides a summary of cost-benefit and cost-effectiveness analyses and their potential importance for decision making. The extent to which these tools are actually used, the possible connections between meta-analysis and cost-effective analysis, and the connection between effect sizes and benefit-cost ratios are discussed. (JAZ)

A program can be evaluated, and a cost-benefit ratio can be calculated to five decimal places, without ever directly examining outcomes. A useful vocabulary in economics and an understanding of the concepts involved is provided evaluators by an economist. (Author/RL)

To enable decision makers to become more aware of the levels of confidence that can be placed in the results of particular computerized decision models, methods for establishing confidence levels are discussed. The U.S. General Accounting Office has developed criteria and review procedures for evaluating computerized policy analysis models.…

Evaluation must take into account both executive and legislative politics and their interactions. A five-part continuum evaluation process is suggested for the development of a policy question and its translation into knowledge that is credible, timely, responsive, and usable. Evaluators have a major responsibility in this process. (Author/JAZ)

Evaluation is discussed as an information-gathering process. Currently popular evaluation programs are reviewed in relation to decision making and various approaches that seem to contribute to the decision utility of evaluation (e.g. classical approaches, Bayesian approaches, adaptive designs, and model-based evaluations) are described. (Author/AL)

Good evaluation shares much with good teaching. What makes an evaluation useful can depend on qualities of teaching brought to the evaluator's role. (Available from: Jossey-Bass, Inc., 433 California St., San Francisco, CA 94104, single issue, $6.95.) (Author)

Program theory can be used to improve programs and policies. This article describes a set of techniques for complicating and simplifying program theory, referred to as conceptual and action heuristics. Methods such as analyzing metaphors, clarifying concepts, mapping, component assessment, causal modeling, and decision analysis are discussed. (JAZ)

This sourcebook presents information about three types of federal decision makers who are frequent clients of evaluation: career government executives; political appointees; and congressional staff members. Differences among these decision makers are highlighted in seven articles, with emphasis on meeting client needs and process dimensions of…

The methodology of data envelopment analysis, (DEA) a linear programming-based method, is described. Other procedures often used for measuring relative productive efficiency are discussed in relation to DEA, including ratio analysis and multiple regression analysis. The DEA technique is graphically illustrated for only two inputs and one output.…

Seven papers are presented that demonstrate new directions and practices in the evaluation of training programs. Different perspectives and approaches are represented, but in each case the evaluation described has been successful in making trainers more effective and accountable. (SLD)