Background: Mid-semester evaluations are gaining traction as a means to gather evaluation data for formative purposes. However, it is not clear if course coordinators who conduct these evaluations are adequately equipped with evaluative knowledge and skills to guide them through their evaluative processes. Objectives: This study is a…

Research on the evaluation of large-scale public-sector reforms is rare. This article sets out to fill that gap in the evaluation literature and argues that it is of vital importance since the impact of such reforms is considerable and they change the context in which evaluations of other and more delimited policy areas take place. In our…

Drawing on a qualitative study of an educational reform and its external evaluation, I describe how a well-intentioned but poorly conceptualized evaluation helped perpetuate asymmetries in the generation and use of evaluation findings. This article explores this project's failure to clarify evaluator roles, identify intended users and expected…

Developmental evaluation (DE), essentially conceptualized by Patton over the past 30 years, is a promising evaluative approach intended to support social innovation and the deployment of complex interventions. Its use is often justified by the complex nature of the interventions being evaluated and the need to produce useful results in real time.…

This study addresses the central question "How do evaluators' background characteristics relate to their evaluation design choices?" Evaluators were provided with a fictitious description of a school-based program and asked to design an evaluation of that program. Relevant background characteristics such as level of experience,…

This paper presents the results of a cross-sectional survey on evaluation use completed by 1,140 U.S. American Evaluation Association members. This study had three foci: evaluators' current attitudes, perceptions, and experiences related to evaluation use theory and practice, how these data are similar to those reported in a previous study…

Research has suggested that evaluators vary in the extent to which they interpret the challenges they face in ethical terms. The question of what accounts for these differences was explored through a survey completed by 391 individuals listed in the database of the American Evaluation Association. The first section of the questionnaire presented…

A survey was sent to members of the Evaluation Use Topical Interest Group (TIG) to determine their perceptions about and experiences with evaluation use. Responses from 282 members show agreement on the major purposes of evaluation and an increased use of performance-results oriented and formative evaluations. (SLD)

Explored evaluator roles and strategies that have the potential to increase the likelihood that the evaluation process will have an influence on an organization and its members. Conducted a brief case study of an evaluation work group to illustrate evaluator roles in task-focused and task-related discussions. (SLD)

In a survey of 128 manufacturing employees, the perception that performance appraisal had developmental uses was associated with satisfaction with appraisals and appraisers. Reaction to the evaluation did not depend on the outcome of the appraisal or its perceived fairness. (SK)

This paper reports on the factors that characterize high-utilization evaluations. It is based on materials submitted to an American Educational Research Association (AERA) Division H competition for outstanding examples of evaluation utilization. The paper is organized into three sections. The first section outlines the background of the study:…

Results of a survey of 564 Canadian and American evaluators and evaluation project descriptions provided by a subsample of 348 evaluators indicate that evaluators support a utilization-focused, stakeholder service orientation and think that maximizing evaluation use is a primary responsibility of evaluators. (SLD)

There has been much literature on the effectiveness of program evaluation. Many feel evaluation has lost its justification; others are more optimistic and feel evaluation can make a difference if the use levels are viewed realistically. Administrators must not regard program evaluation as merely complying with various agency requirements or…

The viability of persuasion theory as a framework for the assessment of program evaluation utilization was assessed. Independent variables studied included credibility, involvement, and role groups. More specifically, the research was designed to address three questions concerning: (1) the occurrence of peripheral involvement persuasive effects…

Evaluability assessment is a diagnostic and prescriptive technique that can be used to determine the extent to which different problems inhibit program evaluation. It involves policymakers, managers, and staff in developing program theory, clarifying intended uses of evaluation information, and planning further evaluations that would stimulate…