Propensity score matching and weighting methods are applied to balance covariates and reduce selection bias in the analysis of observational study data, and ultimately estimate a treatment effect. We wish to evaluate the impact of a Supplemental Instruction (SI) program on student success in an Introductory Statistics course. In such student…

Supplemental Instruction (SI) is a voluntary, non-remedial, peer-facilitated, course-specific intervention that has been widely demonstrated to increase student success, yet concerns persist regarding the biasing effects of disproportionate participation by already higher-performing students. With a focus on maintaining access for all students, a…

When implementing environmental education and interventions to promote one pro-environmental behavior, it is seldom asked if and how non-target pro-environmental behaviors are affected. The spillover effect proposes that engaging in one behavior affects the probability of engagement or disengaging in a second behavior. Therefore, the positive…

While regression discontinuity has usually been applied retrospectively to secondary data, it is even more attractive when applied prospectively. In a prospective design, data collection can be focused on cases near the discontinuity, thereby improving internal validity and substantially increasing precision. Furthermore, such prospective…

The cost of attending college has risen steadily over the past 30 years, making financial aid an important determinant of college choice for many students and a subject of concern for colleges and state governments. In this paper, we estimate the effect of rule-based merit aid assignment on students' enrollment decisions at the University of Iowa.…

A hallmark of efforts to implement the $862 billion American Recovery and Reinvestment Act of 2009 (Recovery Act) is to be transparent and accountable about what the money is being spent on and what is being achieved. To help achieve these goals, recipients are to report every 3 months on their award activities and expected outcomes, among other…

A review of vocational rehabilitation (VR) data from a Midwestern state was conducted to identify predictors of rehabilitation outcomes for African American consumers. The database included 37,404 African Americans who were referred or self-referred over a period of five years. Logistic regression analysis indicated that except for age and…

Given the recent rise in childhood obesity, the School Breakfast Program (SBP) and National School Lunch Program (NSLP) have received renewed attention. Using panel data on more than 13,500 primary school students, we assess the relationship between SBP and NSLP participation and (relatively) long-run measures of child weight. After documenting a…

U.S. social programs, set up to address important problems, often fall short by funding specific models/strategies ("interventions") that are not effective. When evaluated in scientifically-rigorous studies, social interventions in K-12 education, job training, crime prevention, and other areas are frequently found ineffective or…

In many evaluations, presenting probability distributions of cost-effectiveness results offers a convenient way to show the likelihood of various conclusions given the uncertainties in the inputs. The techniques presented in this paper should be useful for many programs characterized by controversy over perspectives, assumptions, and dollar…

Process Analysis is described as a method for identifying and measuring the probability of events that could cause the failure of a program, resulting in a cause-and-effect tree structure of events. The method is illustrated through the evaluation of a pilot instructional program at an elementary school. (SLD)

Presented is a description of the experimental first-year algebra materials "Algebra Through Applications"; a description of the procedure used in evaluating these materials; and recommendations for changes in the materials, implementation, evaluation, and funding. The evaluation indicates that these materials can be effectively used in a variety…

The Gaining Early Awareness and Readiness for Undergraduate Program (GEAR UP) is designed to provide assistance to low income students. The program provides discretionary grants for the purpose of increasing the readiness of low income students to attend and succeed in postsecondary education. The grants are up to six years in length and provide…