Although the general conceptual basis appeared far earlier, theory-driven evaluation came to prominence only a few decades ago with the appearance of Chen's 1990 book "Theory-Driven Evaluations." Since that time, the approach has attracted many supporters as well as detractors. In this paper, 45 cases of theory-driven evaluations, published over a…

Background/Context: A thorough understanding of the information-seeking behaviors of specific disciplines, as well as distinct user groups within a discipline, is fundamental to the process of development of disciplinary informatics. Significant research has been conducted, largely by library and information science scholars across a range of…

How do evaluation practitioners make choices when they evaluate a program? What function do evaluation theories play in practice? In this article, I report on an exploratory study that examined evaluation practices in France. The research began with observations of practitioners' activities, with a particular focus on the phases of evaluation…

This article summarizes critical evaluation needs, challenges, and lessons learned in translational research. Evaluation can play a key role in enhancing successful application of research-based programs and tools as well as informing program refinement and future research. Discussion centers on what is unique about evaluating programs and…

Evaluations of practice have often adopted experimental or quasi-experimental approaches and have focused heavily on outcomes of innovative programmes. This creates problems in replicating studies and effectively creates obstacles to the sharing of good practice. In this paper, ideas from Pawson and Tilley's (1997) approach to Realistic Evaluation…

Examines the original Hawthorne relay-assembly research. Asserts the "Hawthorne misunderstanding" is common in criminology and criminal justice because authors have failed to properly attribute the explanation of increased work output to the Hawthorne effect. Describes the Hawthorne effect, how it is produced, and ways to achieve the…

Propositions about what works in program evaluation are presented: (1) evaluators should be involved from the beginning; (2) evaluation should be based on explicit programmatic theory; (3) quasi-experimental designs must have high internal validity; and (4) evaluators must combat the deterioration of experimental control that occurs in…

Describes quasi-experimental designs to be used as alternatives to randomized controlled trials in decisions concerning clinical practice and policy-making in the child mental health field. Highlights importance of taking a systems-level approach to evaluation, and describes ways in which qualitative outcomes measures can be used to sensitively…

Based on experiences in working with school district staff, suggestions for enhancing evaluation use through stakeholder involvement are discussed in terms of who should be involved, when involvement should occur, and how stakeholders should be involved via a dialogue-dependent process. (SLD)

An experimenting society is one that vigorously tries out proposed solutions to recurrent problems and then tries other alternatives if evaluation shows that previous efforts are ineffective or harmful. Methods that social scientists could use if the experimenting society becomes a reality are explored. (SLD)

This article focuses on strategies that can be used to evolve an evidence-based practice. It describes methods for gathering research information, for reviewing studies critically, and for summarizing information for practice using a model supporting evidence-based practice. An example of the application of these strategies to early intervention…

This review offers a general theory of utilization of educational evaluation and considers factors affecting utilization, including evaluation context factors and evaluator-controlled factors. Special challenges in evaluating programs for gifted students and design shortcomings common in evaluation of such programs are identified. Specific…

Submits that interinstitutional research in mass communication exhibits complex, interrelated problems regarding tactics, sampling, data reliability, and causality. Confronts difficulties and suggests ways to deal with them. Draws on storytelling and cognitive aesthetics to broaden the criteria for judging research. Encourages ambitious…

Considers the competing demands placed on evaluators in relation to the service (characteristics of the intervention), the sample (people participating), and methodology or research design. Explores compromises that may be required between scientific ideals and real-world limitations, and assesses implications for obtaining meaningful results in…

This practical guide is one of a series aimed at assisting academics in higher education in researching specific aspects of their work. Focusing on small-scale insider research in colleges and universities, the handbook covers contemporary issues, research methods, and existing practice and values in the area of assessment and evaluation. Issues,…