This paper addresses the issue of the knowledge gap between evaluators and the entity being evaluated: the dilemma of the knowledge of professional evaluators vs. the in-depth knowledge of the evaluated subjects. In order to optimize evaluative outcomes, the author suggests an approach based on ideas borrowed from the science of cybernetics as a…

Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific…

Presents a framework to describe typical constraints that program evaluators face. The framework encompasses the usual evaluation costs and other factors that impede data collection or the implementation of strong evaluation designs. These are characterized as internal/substantive or external/political. (SLD)

In most cases, questions of cause and effect cannot be answered by social science methods. However, it is argued that evaluation should not be freed from dealing with missing causal links. It is possible to predict whether a causal question is likely to be measured or assessed. (SLD)

Reviews the state of the art in performance measures and assessment processes in program evaluation before the passage of the Government Performance and Results Act (GPRA), and discusses difficulties in fitting these practices into the GPRA format. Presents a simple logic model for evaluating research programs. (SLD)

The impact of a newly instituted prime vendor (wholesaler) pharmaceutical system at Veterans Affairs (VA) hospitals was studied at 33 VA centers and 32 matched comparison hospitals. Results indicate satisfaction with the new system and illustrate the solutions to some interesting evaluation problems. (SLD)

Many evaluation researchers are now attempting to synthesize quantitative and qualitative approaches. Although such efforts appear to carry great promise, some subtleties and incompatibilities of these approaches are perhaps being overlooked. Implications for social inquiry are discussed. (Author/GDC)

Twelve articles discuss the advantages of theory-driven evaluation for: (1) identifying crucial issues; (2) integrating program implementation into evaluation; (3) diagnosing problems in program studies; (4) diagnosing problems in program structures; and (5) enhancing evaluation utilization. Topics include optimizing validity in program and…

Challenges encountered in developing and maintaining an extensive evaluation program at Ohio State University are retrospectively reconstructed. The setting, the history of program development, and the nature of the program are described as a backdrop for discussion of six issues with implications for program development. (SLD)

The rationale for a multistage approach to evaluating services demonstration programs is discussed. The approach takes into account limitations that are often found in such programs. The National Evaluation of Models for Linking Drug Abuse Treatment and Primary Care provides an example. (SLD)

Use-oriented approaches to evaluation have been challenged by contentions that the responsiveness of such evaluations undermines their technical quality. This discussion analyzes purported conflicts between these evaluation criteria of utility and accuracy by examining underlying assumptions related to evaluation's purpose and politics. (TJH)

Discusses methodological issues that emerged in evaluating a three-year paternal involvement demonstration project for poor inner-city noncustodial fathers. The dilemmas that arose from the contradictory goals of program evaluation and the need to meet federal and state waiver goals are discussed, and the tradeoffs needed to ensure a meaningful…

Explores implications for evaluation practice of using five different perspectives on organizations, drawing on the four models of social program implementation developed by R. F. Elmore (1978). It is argued that evaluation will only really be effective when its focus, methods, and management reflect realistic assumptions about how organizations…

A between method triangulation strategy was used to evaluate a process for long-range program planning. One study team conducted interviews and the other used a mail questionnaire. The resulting problems in coordination between teams are discussed. (Author/GDC)

Some of the conceptual, methodological, and logistical impediments to sound evaluations of jail-based drug-treatment programs are described. The focus is on a program in a large urban jurisdiction that illustrates difficulty in tracking clients and coordinating agency responses. Some suggestions are offered to help future researchers. (SLD)