The article by Davis, Engberg, Epple, Sieg, and Zimmer (2010) represents one of the recent research efforts from economists in evaluating the impact of gifted programs. It can serve as a worked example of the implementation of the regression discontinuity (RD) design method in gifted education research. In this commentary, we first illustrate the…

The report of the national response to intervention (RTI) evaluation study, conducted during 2011-2012, was released in November 2015. Anyone who has read the lengthy report can attest to its complexity and the design used in the study. Both these factors can influence the interpretation of the results from this evaluation. In this commentary, we…

Productive dialogue is informed best by multiple and diverse voices. Five seasoned evaluators, representing a range of evaluation perspectives, offer their views in two- to three-page discussant contributions. These individuals were asked to reflect and comment on the previous chapters in the spirit of critical review as a key source of evidence…

D'Eon et al. concluded that change in performance self-assessment means from before to after a workshop can detect workshop success in their and other situations. In this commentary, their recommendation is refuted by showing that (a) self-assessments with balanced over- and underestimations are still biased and should not be used to evaluate…

This response to Slavin's article (2008) explores the issues of transparency, representation, and warranting of claims in Slavin's descriptions of the work of others and his suggestions for program evaluation syntheses. Through contrastive analyses between Slavin's representations of the program evaluation synthesis efforts of five organizations…

Describes problems in implementing placebo controls in psychotherapy including the difficulty of ensuring that therapists and their patients will view both the experimental and placebo treatments as comparably credible. Considers six research issues stemming from the definitional requirement that the placebo control for the critical and specific…

Explores the problems involved in conducting program evaluation in the field of energy conservation. Highlights similarities between evaluation research and basic research. Examines stages of evaluation research within the context of energy conservation programs and argues that experimental evaluations are desirable and feasible. (Author/MK)

The terms "rigor" and "relevance" most often surface in discussions of methodological adequacy. Assessing epistemological relevance is equivalent to answering the question, "Is this particular research question worth asking at all?" Epistemological rigor refers to the properties of a "researchable" problem.…

It is argued that outcome evaluation should include efforts to identify and measure unintended outcomes. A systems perspective is presented which treats governmental actions as disequilibrating intrusions into reacting systems. Both intended and unintended outcomes of such intrusions can be valued monetarily, in terms of human rights, or both.…

An examination of the scientific basis of both control group designs and comparative designs in outcome research reveals that comparative designs generally have fewer threats to validity and provide a more efficient means of control for nonspecific treatment factors suggesting that comparative studies warrant a larger role in the study of…

Encourages the use of evaluation research rather than process, impact, or comprehensive evaluation; and notes that meaningful evaluation research can occur when the true experiment is combined with longitudinal designs. (JEG)

National Institute of Education (NIE) research priorities indicate the use of panel measures only during the time children are in Follow Through programs and further seem to indicate that only implementation variables should be measured. This paper raises questions about the desirability of the narrow focus implied by the NIE priorities, the…

This paper provides guidlines for formally evaluating extended-day programs. Extended-day programs are defined as those attended before and after school by children between the ages of 5 and 14. A seven step evaluation process, in which the practitioner responsible for program administration plays a key role, is outlined and discussed. (Author/RH)

The choice between experimental research or process-oriented oriented research as the only valid paradigm of evaluation research is rejected. It is argued that there is a middle ground. Suggestions are made for mixing the two approaches to suit particular research settings. (Author/GK)

Describes recent developments in United Kingdom politics that have affected development of evidence-based policy for children. Examines the notion of "what works," leading to a suggestion that evaluators be concerned with "what is worth doing" for children. Considers robustness as a guiding principle for evaluation design and…