Reflects on an evaluation that aspired to be inclusive but generally failed to provide a backdrop for a discussion of inclusive evaluation. Identifies issues of absence of significant stakeholders, making of values by method, and the limited authority of the evaluation. Shows how easily deliberative intentions are distorted. (SLD)

Analyzes the complexities surrounding the concept of dialogue in evaluation through a critical examination of current theory and practices. Uses a descriptive typology based on genre, process, goal, evaluator identity, orientation, and epistemology to analyze two vignettes of dialogue in evaluation. (Author/SLD)

Challenges the assumption that evaluation should aim for fostering deliberative democracy. A modest effort by an evaluator to contribute to deliberative democracy is defensible, but vigorous political advocacy violates social expectation. (Author/SLD)

Presents a three-part evaluation schema that provides the framework for describing a methodology that facilitates the evaluation process. Provides details on how to develop and use trainee reaction forms and opinionnaires. Includes sample forms and questionnaires. (Author/JOW)

This monograph identifies, analyzes, and judges 22 evaluation approaches used in program evaluation. Two approaches, labeled psuedoevaluations, are politically oriented and often used to misrepresent a program's value. The remaining 20, judged legitimate, are categorized by their orientations, and rated for their value. (SLD)

Discusses the use of Planned Variation evaluations, evaluations that implement and compare two or more promising variations of an educational or social program. Suggests several advantages for the Planned Variation approach and describes the Planned Variation Cross Validation Model. (SLD)

Outlines essential features of program theory evaluation and discusses how it has been used to address concerns about inadequacies of performance information systems. Suggests enhancing the usefulness of program evaluation theory by incorporating information about program contexts, defining success criteria and comparisons for judging and…

Suggests that research, development, and evaluation of social and educational programs should routinely be integrated through a planned variation approach that involves the design, implementation, and evaluation of an enhanced, as well as the standard, variation of a program. Compares the planned variation approach to other types of theory-based…

Methods suggested by research for evaluating training were compared to survey responses from 202 Canadian organizations regarding actual evaluation practices. Most organizations appeared to evaluate at only one or two of Kirkpatrick's four levels. However, this may be appropriate in light of program objectives, type of organization, and purposes…

Describes key aspects of an integrative framework that may help evaluators move beyond paradigm wars and the segmentation of evaluation practices. Proposes a scheme for categorizing evaluation methods with four inquiry modes, or clusters of methods: description, classification, causal analysis, and values inquiry. (Author/SLD)

Illustrates the difficulties of managing conflicts among formal standards in codes of ethics and among professional and personal standards through two examples from evaluation practice. The mediation of human judgment reveals an inevitable subjectivity that threatens the credibility of the field. (Author/SLD)

Opposes the practice of aggregating impacts on outcome dimensions to arrive at one summary assessment of program merit. Suggests that impacts should be kept separate and unweighted, expressed in their own measurement scales. Illustrates this method through an evaluation of the effects of research grants on a university. (SLD)

Shows how to bridge the gap between collaborative evaluations with extensive stakeholder participation and noncollaborative evaluations in which stakeholders do not participate to a great degree. Synthesizes research that shows that interaction with stakeholders helps enhance validity in noncollaborative evaluations. (SLD)

Describes key issues to consider in evaluating community capacity based on four community-based health programs that have included increasing community capacity or a related concept as one of the defined outcomes of their program and their subsequent evaluations. Two programs were rural, and the others, urban. (SLD)

Studied the perspectives of 15 individuals in 3 different stakeholder groups in the context of training evaluation: training sponsors, training providers, and training participants. Discusses the differing perspectives in terms of a three-dimensional schema of collaborative inquiry and evaluation and discusses implications for training and program…