Our study used a case-control matching design to assess the influence of a voluntary tutoring program in improving first-year students' Grade Point Averages (GPA). To evaluate program effectiveness, we applied case-control matching to obtain 215 pairs of students with or without participation in tutoring, but matched on high school GPA and…

Background: Recruiting schools into a matched-pair randomized control trial (MP-RCT) to evaluate the efficacy of a school-level prevention program presents challenges for researchers. We considered which of 2 procedures would be most effective for recruiting schools into the study and assigning them to conditions. In 1 procedure (recruit and…

In this set of four supplemental tables, the authors compare the baseline test scores of the treatment and matched control group samples observed in each year after KIPP entry (outcome years 1 to 4). As discussed in Chapter III, the authors used an iterative propensity score estimation procedure to calculate each student's probability of entering…

This pilot study proposes a set of analytical steps for comparing schools that participate in the National Science Foundation's Math and Science Partnership (MSP) Program and their nonparticipating peers in the same state. This pilot is part of a larger effort to evaluate the MSP Program's role in student achievement, with two companion analyses.…

This article discusses the difficulties in conducting intervention research or evaluating intervention programs in a school setting. In particular, the problems associated with randomization and obtaining control groups are examined. The use of quasi-experimental designs, specifically a paired comparison design using the individual as his or her…

Since usually no defensible option for performing a task within quasi-experimentation is unbiased, it is desirable to select several options that reflect biases in different directions. The benefits of applying a critical multiplism approach to causal hypotheses, group nonequivalence, and units of analysis in quasi-experimentation is discussed.…

The Voluntary Public School Choice (VPSC) Program supports the emergence and growth of choice initiatives across the country, by assisting states and local school districts in developing innovative strategies to expand public school choice options for students. This report contains the final assessment of the first five years of the VPSC Program…

The study under review is the second-year evaluation report of the Milwaukee Parental Choice Program (MPCP), a publicly funded voucher program that allows low-income students in Milwaukee to attend secular and religious private schools in that city. Its primary finding is that there were no overall statistically significant differences in…

The Evaluation of the Emergency School Assistance Program (ESAP) for the 1971-72 school year is the first application of full-blown experimental design with randomized experimental and control cases in a federal evaluation of a large scale program. It is also one of the very few evaluations which has shown that federal programs can raise tested…

This paper shows that Garfinkel and Gramlich's conclusion about the average performance of the contractors is not supported by the data. The discussion focuses on three issues: (1) The study was conducted in such a way that performance contracting schools and the comparison schools were generally not comparable in terms of initial achievement,…

Problems with conducting randomized field experiments in education are explored. Focus is on problems encountered while evaluating a group of dropout prevention projects. Project planners were asked to manipulate the subject eligibility criteria until they identified as eligible three to four times as many students as they could serve. They were…

This brief report summarizes the analysis and conclusions presented in detail in Interim Report VI regarding the feasibility of conducting a longitudinal study of Project Developmental Continuity (PDC). This project is a Head Start demonstration program aimed at providing educational and developmental continuity between children's Head Start and…

The Worker Profiling and Reemployment Services (WPRS) program requires states to establish systems for identifying Unemployment Insurance (UI) claimants likely to exhaust their UI benefits and refers them to reemployment services. An evaluation was conducted to assess the reliability of the impact estimates provided in the evaluation of the WPRS…

This interim report of a pilot year impact study on evaluation methodology is part of a series of documents on the evaluation of Project Developmental Continuity, a Head Start demonstration program aimed at promoting educational and developmental continuity between children's Head Start and primary school experiences. This report deals with…

The National Job Corps Study was conducted in 1994-1996 to provide a thorough and rigorous assessment of the impacts of the Job Corps on key participant outcomes. To ensure that the study was well implemented, a study team from Mathematica Policy Research, Inc., (MPR) investigated outcome and admission (OA) procedures in each Job Corps region and…