This article reviews important statistical methods for estimating the impact of interventions on outcomes in education settings, particularly programs that are implemented in field, rather than laboratory, settings. We begin by describing the causal inference challenge for evaluating program effects. Then four research designs are discussed that…

While regression discontinuity has usually been applied retrospectively to secondary data, it is even more attractive when applied prospectively. In a prospective design, data collection can be focused on cases near the discontinuity, thereby improving internal validity and substantially increasing precision. Furthermore, such prospective…

Purpose: The purpose of this paper is to analyse the effect of an Italian training program on the re-employment probability of young unemployed workers. The program consists exclusively of workplace training and is coordinated by employment centers, even if it is fully implemented by firms. Design/Methodology/Approach: The authors develop a…

The cost of attending college has risen steadily over the past 30 years, making financial aid an important determinant of college choice for many students and a subject of concern for colleges and state governments. In this paper, we estimate the effect of rule-based merit aid assignment on students' enrollment decisions at the University of Iowa.…

Propensity score applications are often used to evaluate educational program impact. However, various options are available to estimate both propensity scores and construct comparison groups. This study used a student achievement dataset with commonly available covariates to compare different propensity scoring estimation methods (logistic…

Objective: Young people in urban areas are often the focus of pregnancy and sexually transmitted infection (STI) prevention programmes because of their high risk of unwanted pregnancy and contracting an STI. Young people in rural areas are far less studied but also have a high risk of similar outcomes. This study evaluates Giving Our Girls…

Conditional cash transfers (CCTs) are used to reduce poverty while incentivizing investments in children. Targeting CCTs to certain groups of children can improve efficiency, but positive effects on eligible children may be offset by reductions in investments for ineligible siblings. Using data from Nicaragua, we estimate program effects on…

The Success By 6® (SB6) initiative is designed to support early care and education centers in improving and sustaining quality in Pennsylvania's Keystone STARS Quality Rating and Improvement System (QRIS). The SB6 evaluation report examines implementation and outcomes. The findings have implications for SB6 continous quality improvement process…

Recently, the authors have been exploring the use of propensity score methods for developing evidence of program impact. Specifically, they have been developing evidence (after one year of implementation) of the effects of the Math Science Partnership in New York City ("MSPinNYC2") on high school students' achievement--both in terms of…

The researcher for this evaluative study investigated the efficacy and impact of the iStartSmart college success course by examining the first-term retention, fall-to-fall persistence, and three-year completion rates of community college students who enrolled in the one- or three-credit course at a community college in Arizona and the rates of…

The Pittsburgh Promise is a scholarship program that provides $5,000 per year toward college tuition for public high school graduates in Pittsburgh, Pennsylvania who earned a 2.5 GPA and a 90% attendance record. This study used a difference-in-difference design to assess whether the introduction of the Promise scholarship program directly…

In order to study whether college scholarships can be an effective tool in raising students' performance in secondary school, we use one aspect of the Kalamazoo Promise that resembles a quasi-experiment. The surprise announcement of the scholarship created a large change in expected college tuition costs that varied across different groups of…

This investigation sought to determine when colleges should conduct assessments to identify first-year students at risk of dropping out. Thirty-five variables were used to predict the persistence of 2,024 first-year students from four universities in the southeastern United States. The predictors were subdivided into groups according to when they…

A review of vocational rehabilitation (VR) data from a Midwestern state was conducted to identify predictors of rehabilitation outcomes for African American consumers. The database included 37,404 African Americans who were referred or self-referred over a period of five years. Logistic regression analysis indicated that except for age and…

Objectives: The purpose of this study was to develop a realist evaluation paradigm in social work evidence-based practice. Method: Wraparound (at Gateway-Longview Inc., New York) used a reliable outcome measure and an electronic database to systematically collect and analyze data on the interventions, the client demographics and circumstances, and…