Background: Over the past decade, schools across the United States increasingly turned to online learning (Gemin, Pape, Vashaw, & Watson, 2015; Queen & Lewis, 2011). While many espouse the promise of online credit recovery (OCR) courses, the abrupt shift to online learning during the COVID-19 pandemic renewed concerns about theses courses'…

In paired experiments, participants are grouped into pairs with similar characteristics, and one observation from each pair is randomly assigned to treatment. The resulting treatment and control groups should be well-balanced; however, there may still be small chance imbalances. Building on work for completely randomized experiments, we propose a…

Randomized evaluations of educational technology produce log data as a bi-product: highly granular data on student and teacher usage. These datasets could shed light on causal mechanisms, effect heterogeneity, or optimal use. However, there are methodological challenges: implementation is not randomized and is only defined for the treatment group,…

Community colleges are essential for United States higher education, but their students have low retention and graduation rates. Community college students assigned to mathematics remediation are particularly unlikely to graduate. Corequisite remediation (college-level coursework with additional support) has shown short-term increased student…

The gold-standard for evaluating the effect of an educational intervention on student outcomes is running a randomized controlled trial (RCT). However, RCTs may often be small due to logistical considerations, and resulting treatment effect estimates may lack precision. Recent methods improve experimental precision by incorporating information…

Recent methods have sought to improve precision in randomized controlled trials (RCTs) by utilizing data from large observational datasets for covariate adjustment. For example, consider an RCT aimed at evaluating a new algebra curriculum, in which a few dozen schools are randomly assigned to treatment (new curriculum) or control (standard…

An impediment to conducting high-quality quantitative research studies in education is the paucity of valid measures of learning gains. Studies often seek to investigate students' deep, conceptual understanding yet many measures assess only surface, procedural understanding. One reason is that the development of validated measures of conceptual…

Dual-credit courses expose high school students to college-level content and provide the opportunity to earn college credits, in part to smooth the transition to college. With the Tennessee Department of Education, we conduct the first randomized controlled trial of the effects of dual-credit math coursework on a range of high school and college…

Many college students never take, or do not pass, required remedial mathematics courses theorized to increase college-level performance. Some colleges and states are therefore instituting policies allowing students to take college-level courses without first taking remedial courses. However, no experiments have compared the effectiveness of these…

The present study examined the effects of tootling, a peer-mediated positive behavior intervention, on students' classwide disruptive and academically engaged behavior in three general education high school classrooms. A withdrawal design was used to assess the effects of the intervention. Students wrote tootles anonymously on paper slips and…

A variety of computerized interactive learning platforms exist. Most include instructional supports in the form of problem sets. Feedback to users ranges from a single word like "Correct!" to offers of hints and partially- to fully-worked examples. Behind-the-scenes design of systems varies as well--from static dictionaries of problems…

Across the United States, more than half of entering freshmen discover they are ineligible for college-level coursework each year, most commonly in math. The readiness gap is widest when considering students at nonselective two-year colleges, and students who are black, Hispanic, or from low-income families. It often spells disaster for students…

Math and science textbook chapters invariably supply students with sets of problems to solve, but this widely used approach is not optimal for learning; instead, more effective learning can be achieved when many problems to solve are replaced with correct and incorrect worked examples for students to study and explain. In the present study, the…

Math and science textbook chapters invariably supply students with sets of problems to solve, but this widely used approach is not optimal for learning; instead, more effective learning can be achieved when many problems to solve are replaced with correct and incorrect worked examples for students to study and explain. In the present study, the…

This study examined the efficacy of a kindergarten mathematics intervention program, ROOTS, focused on developing whole-number understanding in the areas of counting and cardinality and operations and algebraic thinking for students at risk in mathematics. The study utilized a randomized block design with students within classrooms randomly…