In paired experiments, participants are grouped into pairs with similar characteristics, and one observation from each pair is randomly assigned to treatment. The resulting treatment and control groups should be well-balanced; however, there may still be small chance imbalances. Building on work for completely randomized experiments, we propose a…

The gold-standard for evaluating the effect of an educational intervention on student outcomes is running a randomized controlled trial (RCT). However, RCTs may often be small due to logistical considerations, and resulting treatment effect estimates may lack precision. Recent methods improve experimental precision by incorporating information…

Recent methods have sought to improve precision in randomized controlled trials (RCTs) by utilizing data from large observational datasets for covariate adjustment. For example, consider an RCT aimed at evaluating a new algebra curriculum, in which a few dozen schools are randomly assigned to treatment (new curriculum) or control (standard…

An impediment to conducting high-quality quantitative research studies in education is the paucity of valid measures of learning gains. Studies often seek to investigate students' deep, conceptual understanding yet many measures assess only surface, procedural understanding. One reason is that the development of validated measures of conceptual…

To raise math success rates in middle school, many schools and districts have implemented summer math programs designed to improve student preparation for algebra content in grade 8. However, little is known about the effectiveness of these programs. While students who participate typically experience learning gains, there is little rigorous…

Recent federal legislation, such as the "No Child Left Behind Act" of 2001 and the "Education Sciences Reform Act (ESRA)" of 2002, has insisted that educational evaluations use rigorous research designs with quantitative outcome measures. In particular, the Institute of Education Sciences (IES) at the U.S. Department of…

Middle school algebra students (N = 125) randomly assigned within classroom to a Problem-solving control group, a Correct worked examples control group, or an Incorrect worked examples group, completed an experimental classroom study to assess the differential effects of incorrect examples versus the two control groups on students' algebra…

This five-year evaluation examined the effectiveness of a promising middle-school mathematics intervention funded through an Investing in Innovation (i3) development grant. Evaluation objectives were to: (1) study the impact of an intervention aimed at increasing the academic achievement of students in Algebra I--a gate-keeping course--as measured…

The present study investigated whether flipping an algebra classroom led to a stronger focus on conceptual understanding and improved learning of systems of linear equations for 54 seventh- and eighth-grade students using teacher journal data and district-mandated unit exam items. Multivariate analysis of covariance was used to compare scores on…

This study drew on data from a large, randomized trial of Cognitive Tutor Algebra (CTA) in high-poverty settings to investigate how mathematics curricula and classroom achievement related to teacher reports of time spent on inquiry-based and lecture-based mathematics activities. We found that teachers using the CTA curriculum reported more time on…

The consequences of failing core academic courses during the first year of high school are dire. In the Chicago Public Schools (CPS), only about one-fifth of off-track freshmen--students who fail more than one semester of a core academic course and/or fail to earn enough credits to be promoted to 10th grade--graduate high school, compared with…