Researchers commonly interpret effect sizes by applying benchmarks proposed by Jacob Cohen over a half century ago. However, effects that are small by Cohen's standards are large relative to the impacts of most field-based interventions. These benchmarks also fail to consider important differences in study features, program costs, and scalability.…

This study was carried out to determine the effectiveness of the Flipped Classroom Model (FCM) in an educational setting. For this purpose, a multi-complementary approach (MCA) was used including both quantitative (meta-analysis) and qualitative (thematic). MCA consists of three parts, the first of which is the pre-complementary information stage.…

This report summarizes the complex research literature on quantitative methods for assessing how impacts of educational interventions on instructional practices and student learning differ across students, educators, and schools. It also provides technical guidance about the use and interpretation of these methods. The research topics addressed…

The focus of this article is two-fold. First, it describes a model that can be used to guide the evaluation of teacher professional development. The model combines important components of existing models and incorporates the use of students' perceptions for examining teacher change. Second, the article reports the evaluation of a teacher…

We meta-analyze for impact and cost-effectiveness 94 studies from 47 conditional cash transfer programs in low- and middle-income countries worldwide, focusing on educational outcomes that include enrollment, attendance, dropout, and school completion. To conceptually guide and interpret the empirical findings of our meta-analysis, we present a…

Augustine and Hemenover (2013) were right to state that meta-analyses should be accurate and generalizable. However, we disagree that our meta-analysis of emotion regulation strategies (Webb, Miles, & Sheeran, 2012) fell short in these respects. Augustine and Hemenover's concerns appear to have accrued from misunderstandings of our inclusion…

A theory-driven approach to evaluation (TDE) emphasizes the development and empirical testing of conceptual models to understand the processes and mechanisms through which programs achieve their intended goals. However, most reported applications of TDE are limited to large-scale experimental/quasi-experimental program evaluation designs. Very few…

This article proposes an innovative approach to estimating the counterfactual without the necessity of generating information from either a control group or a before-measure. Building on the idea that program participants are capable of estimating the hypothetical state they would be in had they not participated, the basics of the Roy-Rubin model…

Objectives: The purpose of this study was to develop a realist evaluation paradigm in social work evidence-based practice. Method: Wraparound (at Gateway-Longview Inc., New York) used a reliable outcome measure and an electronic database to systematically collect and analyze data on the interventions, the client demographics and circumstances, and…

Background: Large-scale randomised controlled trials are relatively rare in education. The present study approximates to, but is not exactly, a randomised controlled trial. It was an attempt to scale up previous small peer tutoring projects, while investing only modestly in continuing professional development for teachers. Purpose: A two-year…

Cost studies are program evaluations that judge program worth by relating program costs to program benefits. There are three sets of strategies: cost-benefit, cost-effectiveness, and cost-utility analysis, although the last appears infrequently. The authors searched relevant databases to identify 103 cost studies in education and then reduced the…

A meta-analysis encompassing all studies evaluating the impact of the Triple P-Positive Parenting Program on parent and child outcome measures was conducted in an effort to identify variables that moderate the program's effectiveness. Hierarchical linear models (HLM) with three levels of data were employed to analyze effect sizes. The results (N =…

The primary purpose of this study is to determine whether providing structured academic instruction in reading or math to students in grades two to five during their afterschool hours--instead of the less formal academic supports offered in regular after-school programs-- improves their academic performance in the subject. This is the second and…

In an effort to identify instructional methods that might improve mathematics learning at the grade 4 level when used in a variety of educational settings under typical conditions, the REL Mid-Atlantic research team looked for promising, replicable practices that were being used broadly by teachers in U.S. schools, for which research showed…

Explores the role of theory in strengthening causal interpretations in nonexperimental research. Evaluators must conduct theory-driven research, concentrating on "small theory," in that the focus is on the explanation of processes specific to the program being evaluated. Theory-guided treatment research must be programmatic and…