Design-based methods have recently been developed as a way to analyze randomized controlled trial (RCT) data for designs with a single treatment and control group. This article builds on this framework to develop design-based estimators for evaluations with multiple research groups. Results are provided for a wide range of designs used in…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies (Freedman, 2008; Lin, 2013; Imbens and Rubin, 2015; Schochet, 2013, 2016; Yang and Tsiatis, 2001). The non-parametric estimators are derived using the building blocks of experimental designs with minimal…

Objectives: To examine the impact of guided mindfulness practice on psychological distress and psychological capital (hope, optimism, resilience, and efficacy) in doctoral candidates. Participants: Recruitment of a convenience sample of doctoral candidates occurred in July 2015 and participants were randomly allocated to the control or…

Outdoor orientation programs have a growing literature demonstrating positive impacts with students transitioning to college (Bell, Gass, Nafizer, & Starbuck, 2014). One of the most valued outcomes for colleges and universities is retention of students until successful graduation. This is an outcome few outdoor orientation researchers have…

Policymakers, experts and advocates have promoted many different types of education reform over the past few decades, but what is the evidence about the efficacy of these programs? EdChoice partnered with Hanover Research to find out what research has been conducted in nine major education reform areas focusing on outcomes related to student…

We evaluated the effects of TutorBright tutoring on the reading and mathematics skills of children in family foster care, examined several potential moderators of the impact of tutoring, and explored possible 'spill-over' effects on the children's executive functioning and behavioural difficulties and on their caregivers' level of involvement in…

Large numbers of qualified students do not apply to and enroll in college. Yet, earning a college degree is one of the primary pathways for economic success and is increasingly required for good jobs and high wages. A number of programs and practices aim to improve college readiness and enrollment, including "Take Stock in Children's®…

Background: A cost-effective method to address reading delays is to use computer-assisted learning, but these techniques are not always effective. Methods: We evaluated a commercially available computer system that uses visual mnemonics, in a randomised controlled trial with 78 English-speaking children (mean age 7 years) who their schools…

This report presents the SPARK literacy model, an innovative approach developed by Boys & Girls Clubs of Greater Milwaukee, for addressing the literacy needs of low-income and minority schools in Milwaukee. It also presents the results of a two-year randomized control trial evaluation of the SPARK literacy program's impact on reading…

In the past decades, various systems have been proposed to provide students with a better learning environment by taking personal factors into account. Learning styles have been one of the widely adopted factors in the previous studies as a reference for adapting learning content or organizing the content. However, very few researchers give an…

This paper examines the "ecological validity" of a randomized controlled trial (RCT) conducted in 42 high schools to measure the impact of a content literacy program. This study of comparable schools implementing the same program in different contexts highlights characteristics that are often not attended to in rigorous effectiveness…

Background: The physical activity level of older adults with intellectual disabilities (ID) is extremely low, and their fitness levels are far beneath accepted norms for older people with normal intelligence and comparable with frail older people. A physical activity programme, including an education programme, was developed for older adults with…

This study examined the efficacy of a kindergarten mathematics intervention program, ROOTS, focused on developing whole-number understanding in the areas of counting and cardinality and operations and algebraic thinking for students at risk in mathematics. The study utilized a randomized block design with students within classrooms randomly…

This multiyear scale-up effectiveness study of Open Court Reading (OCR) involved approximately 4,500 students and more than 1,000 teachers per year in Grades K-5 from 49 elementary schools in seven districts across the country. Using a school-level cluster randomized trial design, we assessed the implementation and effectiveness of Open Court…

Home visitation has the potential to improve parent, child, and maternal outcomes and has become a widely implemented prevention program across the United States. The purpose of this research was to use a randomized controlled trial to assess the short-term effectiveness of the Arizona Healthy Families program across a range of outcomes. Two…