The emergence of a new, naturalistic, paradigm of inquiry has led to a demand for rigorous criteria that meet traditional standards of inquiry. Two sets are suggested, one of which, the "trustworthiness" criteria, parallels conventional criteria, while the second, "authenticity" criteria, is implied directly by new paradigm…

An innovative new evaluation unit in the U.S. Department of Health and Human Services is detailed. This unit, the Office of Service Delivery Assessment (SDA), regularly briefs the Secretary on the services delivered to clients at the local level. The process of the SDA is described and conclusions are offered. (Author/GK)

The user-oriented and utilization-focused evaluation design of the two-year Caribbean Agricultural Extension Project, funded by Aid to International Development, is reviewed. The evaluation scope, stakeholders, evaluation team credibility, official approval of evaluation, and confidence in the evaluation process are addressed, within a…

The nine articles of this theme issue provide overviews of legislative program evaluation and demonstrate the tensions caused by the conflict between utility and rigor in such evaluations. Legislative evaluation is concerned with evaluation utilization because legislators commission evaluations they expect to use. (SLD)

Ten functions of program theory are reviewed: contributing to social science knowledge; assisting policymakers, discriminating between theory failure and program failure, identifying the problem and target group, providing program implementation description, uncovering unintended effects, specifying intervening variables, improving formative use…

This review of evaluation findings on Dutch government policy successes and failures points to the influence of political culture on policy effectiveness. Public policy goal attainment is more likely when the government acts purposively, on the basis of relevant information, with power, and with integration. (Author/BS)

This article refers to two uses of the term "program theory": (1) microtheory to describe the model of the program; and (2) macrotheory which is concerned with factors that affect social change both within and outside programs. Barriers to successful utilization of evaluation and suggestions to overcome those barriers are discussed. (JAZ)

The evaluation activities of HEW's Office of the Assistant Secretary for Planning and Evaluation are used as a case study of a central evaluation unit in a multilevel organization. Several evaluation roles are discussed: oversight, coordination, leadership, and information dissemination. (Author/AL)

Program theory and implementation process theory contribute, respectively, to specifying the what and the why of program delivery. This article discusses the relationship between these two theories and the types of data collection methods that can be derived from each in order to contribute to more comprehensive evaluation designs. (JAZ)

These authors argue that evaluation in medical settings is best taught using experimental and quasi-experimental paradigms as a basic framework. Three types of health evaluation courses at the master's, doctoral, and professional doctoral levels at the University of Michigan that stress the crucial connection between evaluation and policy are…

Evaluation must take into account both executive and legislative politics and their interactions. A five-part continuum evaluation process is suggested for the development of a policy question and its translation into knowledge that is credible, timely, responsive, and usable. Evaluators have a major responsibility in this process. (Author/JAZ)

Evaluation synthesis, a meta-evaluation method developed by the General Accounting Office to improve evaluation utilization by legislators, is described. It is designed to: (1) focus on the information needs and priorities of legislators, and (2) ensure continuous communication between sponsor and evaluator. The strengths and limitations of this…

Program theory can be used to improve programs and policies. This article describes a set of techniques for complicating and simplifying program theory, referred to as conceptual and action heuristics. Methods such as analyzing metaphors, clarifying concepts, mapping, component assessment, causal modeling, and decision analysis are discussed. (JAZ)

The substantial differences in program evaluation practices in Canada and the United States are discussed focussing on the historical context and the political and cultural environments. Program evaluation has developed in Canada to address the concerns of accountability of public funds in a context of economic restraint. (Author/BS)

In evaluation, the whole is greater than the sum of the parts when quantitative and qualitative approaches and methods are combined. Some circumstances in which both approaches can be effectively combined are considered, and case studies of two evaluations using multiple methods are presented. (LMO)