Programs that improve teaching effectiveness represent a core strategy to improve student educational outcomes and close student achievement gaps. This article compiles empirical values of intraclass correlations for designing effective and efficient experimental studies evaluating the effects of these programs. The Early Childhood Longitudinal…

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

The problem of assessing whether experimental results can be replicated is becoming increasingly important in many areas of science. It is often assumed that assessing replication is straightforward: All one needs to do is repeat the study and see whether the results of the original and replication studies agree. This article shows that the…

Contradictory findings from "well-implemented" rigorous evaluations invite researchers to identify the differences that might explain the contradictions, helping to generate testable hypotheses for new research. This panel will examine efforts to ensure that the large number of local evaluations being conducted as part of four…

One factor that may facilitate a successful reunification of children in foster care with their parents--or failing that, provide an alternate route to permanency through adoption or guardianship--is children's connections with extended family. However, because foster care frequently disrupts social connections, practitioners may need to take…

This document was produced by the authors based on their research for the report, "Family Finding Evaluations: A Summary of Recent Findings. Publication #2015-01," and is an added resource for further information. The report reviews the results from 13 evaluations of Family Finding. The Family Finding model provides child welfare…

This article proposes an innovative approach to estimating the counterfactual without the necessity of generating information from either a control group or a before-measure. Building on the idea that program participants are capable of estimating the hypothetical state they would be in had they not participated, the basics of the Roy-Rubin model…

Written by a social worker for social work students, this is a nuts and bolts guide to statistics that presents complex calculations and concepts in clear, easy-to-understand language. It includes numerous examples, data sets, and issues that students will encounter in social work practice. The first section introduces basic concepts and terms to…

Studies that examine the impacts of education interventions on key student, teacher, and school outcomes typically collect data on large samples and on many outcomes. In analyzing these data, researchers typically conduct multiple hypothesis tests to address key impact evaluation questions. Tests are conducted to assess intervention effects for…

This guide to program evaluation presents questions that illuminate aspects of the evaluation process. Issues to consider in program evaluation are: (1) the intended results of the program; (2) hypotheses about the possible results of the program; (3) the types of data that will indicate achievement of the intended results and the variables that…

The desirability of combining tests of theory with evaluations of treatment modalities is argued in an investigation of the effectiveness of a juvenile diversion program. Using a true experimental design (with randomization), recidivism analyses dependent on court record data failed to demonstrate the relative superiority of any of three treatment…

In reexamining the implementation results from a true experiment in criminal justice, this analysis brackets true treatment effects by partitioning experimental and control groups into treated and untreated subgroups and by combining two independent data sources. A positive association was found between magnitude of experimental treatment…

The authors respond to criticism and analyses by Eva Rezmovic (TM 507 851) of their experimental design, particularly the suggested use of information on the amount of program service received by the control group comparable to the treatment group in their study of the relationship between program implementation levels and program outcomes. (CM)

The popularity of semestered timetable organization is founded on the belief that this organizational change makes a positive contribution to the social, emotional, and cognitive growth of students. This research attempted to test the validity of that belief by identifying the claims made for timetable reorganization, formulating these claims as…

In spite of many inherent problems, impact evaluation should remain an integral part of program evaluation, both because impact evaluation brings its budget justification with it, and because its focus on causal hypotheses is an essential part of evaluation. Methodology based on the author's body of work is reviewed. (SLD)