Notes that regression discontinuity designs offer tool to evaluate effects of programs on individuals in cases where selection into program is based on continuous variables; program outcomes may be meaningfully measured; and it is not possible to assign candidates randomly to program/no program conditions. Procedures for conducting regression…

Methods of preparing for and conducting an adult education program evaluation are discussed: using standards and quality indicators, involving stakeholders, collecting program information, conducting a self-evaluation, and participating in the exit interview. (SK)

Describes the Logic Model process, a tool used by program evaluators to tell the performance story of their program. The model describes the logical linkages among program resources, activities, outputs, customers reached, and short, intermediate, and longer-term outcomes. (SLD)

Presents a framework for judging evaluations on the basis of their potential for democratic deliberation that includes the interrelated requirements of inclusion, dialogue, and deliberation. Operationalizes these requirements in 10 questions to guide evaluation and meta-evaluation from a democratic viewpoint. (SLD)

Reflects on an evaluation that aspired to be inclusive but generally failed to provide a backdrop for a discussion of inclusive evaluation. Identifies issues of absence of significant stakeholders, making of values by method, and the limited authority of the evaluation. Shows how easily deliberative intentions are distorted. (SLD)

Analyzes the complexities surrounding the concept of dialogue in evaluation through a critical examination of current theory and practices. Uses a descriptive typology based on genre, process, goal, evaluator identity, orientation, and epistemology to analyze two vignettes of dialogue in evaluation. (Author/SLD)

Challenges the assumption that evaluation should aim for fostering deliberative democracy. A modest effort by an evaluator to contribute to deliberative democracy is defensible, but vigorous political advocacy violates social expectation. (Author/SLD)

Presents a three-part evaluation schema that provides the framework for describing a methodology that facilitates the evaluation process. Provides details on how to develop and use trainee reaction forms and opinionnaires. Includes sample forms and questionnaires. (Author/JOW)

This monograph identifies, analyzes, and judges 22 evaluation approaches used in program evaluation. Two approaches, labeled psuedoevaluations, are politically oriented and often used to misrepresent a program's value. The remaining 20, judged legitimate, are categorized by their orientations, and rated for their value. (SLD)

Discusses the use of Planned Variation evaluations, evaluations that implement and compare two or more promising variations of an educational or social program. Suggests several advantages for the Planned Variation approach and describes the Planned Variation Cross Validation Model. (SLD)

Outlines essential features of program theory evaluation and discusses how it has been used to address concerns about inadequacies of performance information systems. Suggests enhancing the usefulness of program evaluation theory by incorporating information about program contexts, defining success criteria and comparisons for judging and…

Suggests that research, development, and evaluation of social and educational programs should routinely be integrated through a planned variation approach that involves the design, implementation, and evaluation of an enhanced, as well as the standard, variation of a program. Compares the planned variation approach to other types of theory-based…

Methods suggested by research for evaluating training were compared to survey responses from 202 Canadian organizations regarding actual evaluation practices. Most organizations appeared to evaluate at only one or two of Kirkpatrick's four levels. However, this may be appropriate in light of program objectives, type of organization, and purposes…

Describes key aspects of an integrative framework that may help evaluators move beyond paradigm wars and the segmentation of evaluation practices. Proposes a scheme for categorizing evaluation methods with four inquiry modes, or clusters of methods: description, classification, causal analysis, and values inquiry. (Author/SLD)

Illustrates the difficulties of managing conflicts among formal standards in codes of ethics and among professional and personal standards through two examples from evaluation practice. The mediation of human judgment reveals an inevitable subjectivity that threatens the credibility of the field. (Author/SLD)