Short comparative interrupted times series (CITS) designs are increasingly being used in education research to assess the effectiveness of school-level interventions. These designs can be implemented relatively inexpensively, often drawing on publicly available data on aggregate school performance. However, the validity of this approach hinges on…

Treatment effect estimates from a "regression discontinuity design" (RDD) have high internal validity. However, the arguments that support the design apply to a subpopulation that is narrower and usually different from the population of substantive interest in evaluation research. The disconnect between RDD population and the…

This article presents findings from a quasi-experimental evaluation of quality with a sample of 28 family child care providers in the All Our Kin Family Child Care Network, a staffed family child care network which offers a range of services including relationship-based intensive consultation, and 20 family child care providers who had no…

The present article considers a fundamental question in evaluation research: "By how much do program effects vary across sites?" The article first presents a theoretical model of cross-site impact variation and a related estimation model with a random treatment coefficient and fixed site-specific intercepts. This approach eliminates…

The results of previous research on the "Language for Learning" programme suggest that it produces positive effects on the intellectual, language, and social skills of young children with and without disabilities [Benner, G. J., Trout, A., Nordness, P. N., Nelson, J. R., Knobel, M. L., Epstein, A.,…Epstein, M. H. (2002). "The…

We used a comparative interrupted time series design to examine the impact of the Massachusetts' Wraparound Zone Initiative on student achievement, attendance, retention, and suspension. This initiative was designed to create coordinated district systems that allow schools to proactively and systematically address students' nonacademic needs. The…

Background: Afterschool programs (ASPs) in the United States have been implemented in low income neighborhoods to enable at-risk youth to access educational support services to increase academic skills. However, mixed findings about the ASPs positively affecting academic performance suggests a need for additional evaluative studies. Objective: The…

The present study examined undergraduate peer tutoring in three phases. Phase I qualitatively surveyed students' perceptions about the effectiveness of tutoring. Phase II examined the usefulness of promoting regular use of services through a tutoring contract. Phase III utilized an archival, quasi-experimental approach to estimate the effect of…

Objective: Suicide remains a pressing issue for college communities. Consequently, gatekeeper trainings are often provided for staff. This study examines the effect of one such program, Applied Suicide Intervention Skills Training (ASIST). Participants: 51 college employees received ASIST in August of 2014 and were compared to 30 wait-list control…

"12 for Life" is an Investing in Innovation (i3) development grant funded by the Office of Innovation and Improvement, U.S. Department of Education. "12 for Life" provides a rigorous STEM curriculum, combined with on-the-job-training, work/life skills development, mentoring, and employment opportunities to high school students…

Objective: This study tested the effects of integrating evidence-based practice (EBP) process material into a research curriculum for master of social work (MSW) students. Methods: A quasi-experimental design (N = 152) was used across 12 sections of a required program evaluation course, with half integrating EBP process material and half using the…

The National Science Foundation contracted with Abt Associates to conduct an evaluation of its Partnerships for International Research and Education (PIRE) program, which supports intellectually substantive collaborations between U.S. and foreign researchers in which the international partnership is essential to the research effort. The evaluation…

The National Science Foundation contracted with Abt Associates to conduct an evaluation of its Partnerships for International Research and Education (PIRE) program, which supports intellectually substantive collaborations between U.S. and foreign researchers in which the international partnership is essential to the research effort. The evaluation…

Considering the amount of funding that is distributed to educational research each year, leaders and policymakers have a vested interest in finding scientifically based evidence that answers causal questions regarding program effectiveness. The importance of program evaluation has long been recognized in many fields of research; however, the most…

The focus of this quantitative comparative study was to analyze school achievement on third-grade reading assessments in 60 similar schools over a three-year period on Washington state standardized criterion-referenced assessments. This study provides statistical data showing the non-scripted programs were consistent for all three years while…