This paper proposes ten steps to make evaluations matter. The ten steps are a combination of the usual recommended practice such as developing program theory and implementing rigorous evaluation designs with a stronger focus on more unconventional steps including developing learning frameworks, exploring pathways of evaluation influence, and…

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

The purposes of this study were to evaluate a federal and state-funded Family Caregiver Support Program (FCSP) and explore what types of caregiver support service are associated with what caregiver outcomes. Information was obtained on a sample of 164 caregivers' use of eleven different types of support service. Descriptive and comparative…

There is increasing recognition of the need for evaluations that identify program processes or mediators and assess degree of program implementation rather than focusing solely on outcome evaluation. This paper describes the application of complementary qualitative and quantitative evaluation procedures to assess the degree of implementation of…

This article describes standards setting in an evaluation of the structure of 15 of the nation's university hospitals who participated in the Teaching Hospital General Medicine Group Practice Program. Standards were (1) selected from many sources; (2) formed in a participatory, competing forum for discussion; and (3) set in advance of information…

Activities during the initial 18-month cycle of the Demand and Resource Evaluation (DARE) Program of the Puget Sound Power and Light Company (Washington State) are described. The role of evaluation in public utility planning is discussed. Cooperation, communication, and consensus among utility planning staff are concluded to be vital. (SLD)

Concept mapping was used to assess the fidelity of an experimental program model for psychiatrically disabled street dwellers. Concept maps portrayed the program as conceptualized by its Boston University developers and program staff. Quantitative and descriptive analyses of the maps indicated good fidelity of model transfer. (SLD)

Evaluation is often both conceptually and functionally separate from program planning and operations management. There are a number of potentially beneficial side effects to be realized from close collaboration between program administrators and evaluators: when the evaluation task is broadly defined and when both administrators recognize their…

Six case studies are discussed, which illustrate the experimental and pragmatic epistemological paradigms as they function independently, compete with one another, or complement each other. Researchers should consider not only the substantive goals of an evaluation, but also the epistemological goals. (SLD)

Procedures for setting and monitoring program goals are discussed, using a drug treatment project as an example. Implementation steps include goal setting, checking for consistency, monitoring, and providing feedback. The advantages and limitations of this goal-oriented approach are described. Available from: Pergamon Press, Maxwell House,…

This article describes the on-going evaluation of a pilot program characterized by: (1) cooperation between program managers and evaluators; (2) first-hand knowledge about the implementation of the pilot; and (3) a focus on summative and formative evaluations. Evaluators participated actively in the design of the pilot. (Author/SLD)

Challenges encountered in developing and maintaining an extensive evaluation program at Ohio State University are retrospectively reconstructed. The setting, the history of program development, and the nature of the program are described as a backdrop for discussion of six issues with implications for program development. (SLD)

Some specific opportunities and techniques are described for combining and integrating qualitative and quantitative methods from the design stage of a substance abuse program evaluation through implementation and reporting. The multiple problems and requirements of such an evaluation make integrated methods essential. (SLD)

The current conceptualization in the mental retardation-developmental disability field regarding quality of life, quality enhancement, and quality assurance is summarized. Implications of these issues for program planning and evaluation are discussed, with attention to management and a framework for quality assurance. (SLD)

An evaluation of case management services to families on public assistance suggests that a "logic model" and an "open systems" evaluation approach might be useful in program evaluation. A second study describes how the logic model and open systems evaluation were used to develop an evaluation plan for services to homeless…