We present the results of a study of local education agency (LEA)-based interventions to improve the reading outcomes of struggling readers in sixth grade. The sample included 1,076 intervention students and 3,644 comparison students. Regression discontinuity was used to evaluate intervention impact. The study contributes to the field by…

Background: One of the reasons for the slow and uncertain translation of research into practice is likely due to the emphasis in science on explanatory models and efficacy designs rather than more pragmatic approaches. Methods: Following a brief definition of what constitutes a pragmatic approach, I provide examples of pragmatic methods, measures,…

This brief is part of a series that explores key implementation considerations. It focuses on the importance of identifying, operationalizing, and implementing the "core components" of evidence-based and evidence-informed interventions that likely are critical to producing positive outcomes. The brief offers a definition of "core components",…

The aim of this study was to identify the needs of third grade classroom teaching students about science teaching course in terms of Parlett's Illuminative program evaluation model. Phenomographic research design was used in this study. Illuminative program evaluation model was chosen for this study in terms of its eclectic and process-based…

Although the general conceptual basis appeared far earlier, theory-driven evaluation came to prominence only a few decades ago with the appearance of Chen's 1990 book "Theory-Driven Evaluations." Since that time, the approach has attracted many supporters as well as detractors. In this paper, 45 cases of theory-driven evaluations, published over a…

This article addresses a void in the literature about social work research and evaluation (R&E) designs, in particular related to the quality of its published work. Data were collected by reviewing three empirically oriented journals, "Research on Social Work Practice", "Journal of Social Service Research", and "Social Work Research" over three…

How do evaluation practitioners make choices when they evaluate a program? What function do evaluation theories play in practice? In this article, I report on an exploratory study that examined evaluation practices in France. The research began with observations of practitioners' activities, with a particular focus on the phases of evaluation…

In an attempt to move, if not balance, the scales of activity toward increasing scientific capability across a diverse national population, U.S. federal funding agencies are purposefully linking research funding to broad national impact. Among United States federal agencies, the National Science Foundation (NSF) has led the way in the integration…

Evaluations of practice have often adopted experimental or quasi-experimental approaches and have focused heavily on outcomes of innovative programmes. This creates problems in replicating studies and effectively creates obstacles to the sharing of good practice. In this paper, ideas from Pawson and Tilley's (1997) approach to Realistic Evaluation…

Presents the conceptual, philosophical, and methodological basis for the "Procedural and Coding Manual for Review of Evidence-Based Interventions." Discusses key conceptual issues and areas of potential controversy surrounding the manual and the research framework for coding evidence-based interventions (EBIs). Presents methodological…

Explores the role of theory in strengthening causal interpretations in nonexperimental research. Evaluators must conduct theory-driven research, concentrating on "small theory," in that the focus is on the explanation of processes specific to the program being evaluated. Theory-guided treatment research must be programmatic and…

Propositions about what works in program evaluation are presented: (1) evaluators should be involved from the beginning; (2) evaluation should be based on explicit programmatic theory; (3) quasi-experimental designs must have high internal validity; and (4) evaluators must combat the deterioration of experimental control that occurs in…

This review offers a general theory of utilization of educational evaluation and considers factors affecting utilization, including evaluation context factors and evaluator-controlled factors. Special challenges in evaluating programs for gifted students and design shortcomings common in evaluation of such programs are identified. Specific…

Considers the competing demands placed on evaluators in relation to the service (characteristics of the intervention), the sample (people participating), and methodology or research design. Explores compromises that may be required between scientific ideals and real-world limitations, and assesses implications for obtaining meaningful results in…

The design and evaluation of a rating scale for program evaluation in problem-based medical curricula are described. The design process was guided by a theory of how students learn in problem-based learning as modeled by W. H. Gijselaers and H. G. Schmidt (1988). The rating scale was used in an evaluation of a new problem-based, community-oriented…