Carol Weiss did much to enhance the role of evaluation in her writings. Her work shows evaluators what affects their roles as they evaluate programs. Furthermore, her theory of change spells out the complexities involved in program evaluation. There are various processes involved in the evaluation of programs. The paper looks at some of the…

This study addresses the central question "How do evaluators' background characteristics relate to their evaluation design choices?" Evaluators were provided with a fictitious description of a school-based program and asked to design an evaluation of that program. Relevant background characteristics such as level of experience,…

The authors of this article consider how education researchers can improve school violence and school safety research by (a) examining gaps in theoretical, conceptual, and basic research on the phenomena of school violence; (b) reviewing key issues in the design and evaluation of evidence-based practices to prevent school violence; and (c)…

This guide is designed to help districts and schools evaluate reform efforts related to the American Recovery and Reinvestment Act (ARRA), including School Improvement Grants. It includes practical, how-to tips for conducting program evaluations, whether one takes a "do-it-yourself" approach or seeks outside assistance to evaluate reform…

This article presents an interview with Michael Patton whose professional evolution has contributed to the way evaluation in the United States is understood and practiced today. Patton is an evaluation and organizational development consultant who spent 18 years at the University of Minnesota (1973-1991), including 5 years as the director of the…

It is common practice to associate recommendations for program improvement with evaluation reports. In this article, several classes of recommendations are identified, and aspects of one class are explored in some detail. Consideration is given to certain logical, methodological, and practical issues relating to the derivation of recommendations…

In recent years, the European Commission has undertaken a number of initiatives to improve evaluation in the European Union. This article reviews these initiatives and focuses on the work of the Commission's evaluation study group. The future of evaluation in the Commission is discussed in the context of management of change. (SLD)

Suggests research designs and methodologies that are useful in program evaluation when information is hard to measure, or sensitive in nature, or difficult for the respondent to articulate. Illustrates the application of these methods, which include intersubjective certifiability and triangulated respondent groups among other approaches, through…

This digest describes some of the basic logic-of-evaluation skills and some of the basic methodological skills that need to be mastered in order to practice the art and science of evaluation. Some topics from the logic of evaluation that must be dealt with include understanding : (1) the differences and connections between evaluation and other…

In spite of the scarcity of empirical studies of evaluation, such studies are critical to development of evaluation theory. Illustrative examples are given of studies of evaluation practice that operationalize theory. Although practitioners should continue public reflection, they must also focus on the independent and empirical study of…

The National Assessment of Educational Progress (NAEP) has been the subject of many evaluations during its history. Those evaluations are reviewed, focusing on external evaluations, and the influences of recommendations made in the evaluations are discussed. The report concludes that many of the recommendations of evaluators have been heeded by…

Evaluators must use a flexible, open-minded approach oriented toward a holistic view of the implementation and operation of the program they are analyzing. The use of more than one methodology expands the potential findings and avoids the limitations of a unidimensional approach. (SLD)

This paper reviews empirical research conducted during the past 15 years on the use of evaluation results. Sixty-five studies in education, mental health, and social services are described in terms of their methodological characteristics, their orientation toward dependent and independent variables and the relationships between such variables.…

The extent to which evaluation and auditing have converged on procedures in recent years and the extent to which they remain different are examined in the five chapters of this special issue. Different emphases, the question of collaboration with the subjects of inquiry, and issues of routinized performance are explored. (SLD)

Proposals satisfy a number of functions in evaluation work. This article examines how these functions differ depending on whether the proposal concerns a preordinate study in which methods are prespecified or an emergent study in which decisions about methods are made as the study proceeds. (Author/SLD)