This paper introduces a simple, quotient effect size, termed (for 'quotient'), suitable for reporting on the effectiveness of educational interventions. The quotient effect size for a pre-test-post-test design is defined as the gain score (i.e. post-test minus pre-test) for the intervention group, divided by the gain score for the control group.…

Over the last twenty years, education researchers have increasingly conducted randomised experiments with the goal of informing the decisions of educators and policymakers. Such experiments have generally employed broad, consequential, standardised outcome measures in the hope that this would allow decisionmakers to compare effectiveness of…

We present an aggregation scheme that increases power in randomized controlled trials and quasi-experiments when the intervention possesses a robust and well-articulated theory of change. Intervention studies using longitudinal data often include multiple observations on individuals, some of which may be more likely to manifest a treatment effect…

The What Works Clearinghouse (WWC) is an initiative of the U.S. Department of Education's Institute of Education Sciences (IES), which was established under the Education Sciences Reform Act of 2002. It is an important part of IES's strategy to use rigorous and relevant research, evaluation, and statistics to improve the nation's education system.…

Purpose: We conducted a retroactive analysis of teacher and student data from two randomized group trials and one well-controlled quasi-experimental group trial focused on improving pedagogical content knowledge (PCK) and student performance. Method: Seven teachers and 32 classes were investigated. PCK was measured using four variables: task…

The What Works Clearinghouse (WWC) systematic review process is the basis of many of its products, enabling the WWC to use consistent, objective, and transparent standards and procedures in its reviews, while also ensuring comprehensive coverage of the relevant literature. The WWC systematic review process consists of five steps: (1) Developing…

This study compared the achievement of male and female students who were enrolled in an online univariate statistics course to students enrolled in a traditional face-to-face univariate statistics course. The subjects, 47 graduate students enrolled in univariate statistics classes at a public, comprehensive university, were randomly assigned to…

Randomized experiments provide unbiased estimates of treatment effects, but are costly and time consuming. We demonstrate how a randomized experiment can be leveraged to measure selection bias by conducting a subsequent observational study that is identical in every way except that subjects choose their treatment--a quasi-doubly randomized…

As evidence becomes increasingly important in educational policy, it is essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. A total of 645 studies from 12 recent reviews of evaluations of preschool, reading, mathematics, and science programs were studied. Effect…

Research shows that participation in school-based arts education has declined over the past decade. A problem for the arts' role in education has been a lack of rigorous scholarship that demonstrates educational benefits. A component of this problem has been a lack of available data. In this study, we use original data collected through a…

Background: For a majority of the world's children, despite substantial increases in primary school enrollment, academic learning is neither occurring at expected rates nor supplying the basic foundational skills necessary to succeed in the 21st century. The significant lag in academic achievement tells us that simply making formal education…

As evidence-based reform becomes increasingly important in educational policy, it is becoming essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. The purpose of this study was to examine how methodological features such as types of publication, sample sizes, and…

This is a report of a pilot programme of the SHINE in Secondaries Saturday school transition intervention. The programme aims to improve attainment by focusing on literacy and numeracy and revisiting areas where pupils are struggling through a creative curriculum approach and enrichment opportunities. The Saturday programme is run by teachers from…

This meta-analysis summarizes research on the effects of a comprehensive, interactive web-based software (AXXX) on the development of reading competencies among kindergarteners and elementary students. Findings from seven randomized control trials and quasi-experimental studies undertaken in a variety of contexts across Canada, Australia and Kenya…

With its critical assessments of scientific evidence on the effectiveness of education programs, policies, and practices (referred to as "interventions"), and a range of products summarizing this evidence, the What Works Clearinghouse (WWC) is an important part of the Institute of Education Sciences' strategy to use rigorous and relevant…