In this paper, the author talks about some recent developments in the methodology of program evaluation and about what he calls "responsive evaluation." He discusses two models for program evaluation, namely (1) informal study or self-study; and (2) the pretest/posttest model. Then, he describes an approach that he has been working on, which will…

Background: Schools experience a wide range of crime and disorder, victimizing students and staff, and undermining attempts to create a safe and orderly environment for student learning. Police have long established programs with schools, but there has been no systematic review of evaluations of these programs, outside of police-led prevention…

In this paper, the author considers certain aspects of the problem of obtaining unbiased information about the merits of a program or product, whether for purposes of decision making or for accountability. The evaluation of personnel, as well as the evaluation of proposals and evaluations, generally involves a different set of problems than those…

It is a special characteristic of all modern societies that people consciously decide on and plan projects designed to improve their social systems. It is their universal predicament that their projects do not always have their intended effects. It seems inevitable that in most countries this common set of problems, combined with the obvious…

Background: Turkey is a fast-developing country facing a lot of different problems. One of the problems is inadequate education. A large project was started to improve Turkish elementary education. The project includes many different purposes from physical refurbishment of school buildings, to increasing technology use in education. The author of…

The purpose of this paper is to provide a basis for judging the adequacy of evaluation plans or, as they are commonly called, evaluation designs. The authors assume that using the procedures suggested in this paper to determine the adequacy of evaluation designs in advance of actually conducting evaluations will lead to better evaluation designs,…

Background: Businesses have been exposed to many positive accounts of the benefits of employee wellness to improve employee performance as well as reduce health and injury claims costs for the employer. However, many do not have the tools or experience to effectively demonstrate the benefits of a workplace wellness program for their own management…

Background: A music education program with a goal of enhancing cognitive development of preschool-aged children enrolled in local preschools is evaluated by The Evaluation Center at Western Michigan University. The budget for the evaluation was small, and therefore presented several challenges to the evaluation team. Purpose: Through a case study…

Background: Return on investment (ROI) is one of the most popular evaluation metrics. ROI analysis (when applied correctly) is a powerful tool of evaluating existing information systems and making informed decisions on the acquisitions. However, practical use of the ROI is complicated by a number of uncertainties and controversies. The article…

Background: In program evaluation interventions are usually examined for global effects but not always for differential effects. The reasoning behind the focus on global effects is that most of the concepts applied in data analyses, and most of the hypotheses being assessed, are variable-oriented. Consequently, existing differential effects will…

Background: Since the late 1970s participatory approaches have been widely promoted to evaluate international development programs. However, there is no universal agreement of what is meant by participatory evaluation. For some evaluators, participatory evaluations involve the extensive participation of all stakeholder groups (from donor to…

Background: Community health efforts often include outreach activities designed to increase awareness and ensure uptake of services or programs. Yet, few comprehensive outreach evaluations exist, particularly those designed to improve access to and use of mental health services. Purpose: This article summarizes the use of two established…

Background: Evaluation is a tool that can promote accountability and enhance organizational improvement. For these reasons funding entities from government to foundations are increasingly relying on program evaluation as a key instrument to determine effectiveness and hold recipient organizations accountable. What has ensued is an environment of…

Background: The philosophical underpinnings of evaluation guidelines set forth by a funding agency can sometimes seem inconsistent with that of the intervention. Purpose: Our purpose is to introduce questions pertaining to the contrast between the instructional program's underlying philosophical beliefs and assumptions and those underlying our…

Good evaluation requires that evaluation efforts themselves be evaluated. Many things can and often do go wrong in evaluation work. Accordingly, it is necessary to check evaluations for problems such as bias, technical error, administrative difficulties, and misuse. Such checks are needed both to improve ongoing evaluation activities and to assess…