In recent years, countries including the UK and USA have seen advancements in the use of Randomised Controlled Trials in education, progress that has not been mirrored in Ireland. Ireland does not have a strong tradition of using experimental or quasi-experimental evaluation designs for monitoring and evaluation of education policy despite…

Background: There is a paucity of research into interventions that help people with intellectual disabilities learn to read. This feasibility study examines whether an online reading programme, Headsprout, with additional support strategies and supervision (the intervention), can be delivered by support workers/family carers and the feasibility of…

In early 2021-22, the Flexible Phonics reading intervention, a large-scale randomised controlled trial, took place in 118 schools in England and involved nearly 3,000 children. This study aimed to provide valuable insights into the success of largely school-based education trials. The Flexible Phonics trial proved to be not only an important…

Research in the UK suggests that multi-componential interventions focusing on language and pre-literacy skills can improve children's reading and language skills. However, simple translations of such programmes may not produce equivalent effects in diverse communities. The reasons for this are multi-faceted and include factors beyond the rationale…

We present an aggregation scheme that increases power in randomized controlled trials and quasi-experiments when the intervention possesses a robust and well-articulated theory of change. Intervention studies using longitudinal data often include multiple observations on individuals, some of which may be more likely to manifest a treatment effect…

Background: Efficacy trials in education often possess a motivating theory of change: how and why should the desired improvement in outcomes occur as a consequence of the intervention? In scenarios with repeated measurements, certain subgroups may be more or less likely to manifest a treatment effect; the theory of change (TOC) provides guidance…

This paper presents evidence confirming the validity of the RD design in the Reading Recovery study by examining the ability of the RD design to replicate the 1st grade results observed in the original i3 RCT focused on short-term impacts. Over 1,800 schools participated in the RD study over all four cohort years. The RD design used cutoff-based…

Educational stakeholders are keen to know the magnitude and importance of different interventions. However, the way evidence is communicated to support understanding of the effectiveness of an intervention is controversial. Typically studies in education have used the standardised mean difference as a measure of the impact of interventions. This…