Given the widespread use of non-experimental (NE) methods for assessing program impacts, there is a strong need to know whether NE approaches yield causally valid results in field settings. In within-study comparison (WSC) designs, the researcher compares treatment effects from an NE with those obtained from a randomized experiment that shares the…

Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…

In this article, we test an alternative approach to creating a counterfactual basis for estimating individual and average treatment effects. Instead of using control/comparison groups or before-measures, the so-called Counterfactual as Self-Estimated by Program Participants (CSEPP) relies on program participants' self-estimations of their own…

Researchers may be interested in examining the impact of programs that prepare youth and adults for successful careers but unable to implement experimental designs with true randomization of participants. As a result, these studies can be compromised by underlying factors that impact group selection and thus lead to potentially biased results.…

This article proposes an innovative approach to estimating the counterfactual without the necessity of generating information from either a control group or a before-measure. Building on the idea that program participants are capable of estimating the hypothetical state they would be in had they not participated, the basics of the Roy-Rubin model…

With research indicating substantial differences among teachers in terms of their effectiveness (Nye, Konstantopoulous, & Hedges, 2004), a major focus of recent research in education has been on improving teacher quality through professional development (Desimone, 2009; Institute of Educations Sciences [IES], 2012; Measures of Effective…

Across the country, a growing number of recent high school graduates are participating in summer bridge programs. These programs provide accelerated and focused learning opportunities in order to help students acquire the knowledge and skills needed for college success. The state of Texas has given particular attention to summer programs as a way…

The authors of this article consider how education researchers can improve school violence and school safety research by (a) examining gaps in theoretical, conceptual, and basic research on the phenomena of school violence; (b) reviewing key issues in the design and evaluation of evidence-based practices to prevent school violence; and (c)…

Increasing demands for evidence-based early childhood services and the need by policymakers to know whether a program is effective or whether it warrants a significant investment of public and/or private funds--coupled with the often-politicized debate around these topics--make it imperative for policymakers and civic leaders to have independent…

An examination of the scientific basis of both control group designs and comparative designs in outcome research reveals that comparative designs generally have fewer threats to validity and provide a more efficient means of control for nonspecific treatment factors suggesting that comparative studies warrant a larger role in the study of…

This guide is designed as a resource for leaders and evaluators of K-12 online learning programs. In this guide, the term "online learning" is used to refer to a range of education programs and resources in the K-12 arena, including distance learning courses offered by universities, private providers, or teachers at other schools;…

The author compares his experiences evaluating Peace Corps volunteers in Kenya and evaluating a health promotion program for adolescents in Orange County, California. Doing international evaluations can improve domestic evaluations by heightening awareness of often unrecognized cultural variations in the domestic setting. (BS)

This investigation examines two contrasting evaluations of early childhood education: the Westinghouse-Ohio University study and the Ypsilanti Perry Preschool Project. The Westinghouse study concluded that Head Start experience had very little, if any, academic value for participating children, whereas the Perry Preschool Project concluded that…

Preparation for Parenthood is a city-wide program designed for the purpose of: (1) decreasing the complication of pregnancy for school-age girls due to poor nutrition and poor prenatal care, and consequently reducing infant mortality, mental retardation, and birth defects; and (2) enabling the girls to continue their educational ambitions, thus…

Ten evaluation models are examined in terms of their applicability to investigative, emergent design programs: Stake's portrayal, Wolf's adversary, Patton's utilization, Guba's investigative journalism, Scriven's goal-free, Scriven's modus operandi, Eisner's connoisseurial, Stufflebeam's CIPP, Tyler's objective based, and Levin's cost…