Discussions of randomised controlled trials (RCTs) in education that do not show an impact regularly focus on the intervention and how it failed to impact on expected measures, with typologies identifying persistent critical points of failure. This paper uses one such RCT--the Integrating English programme--to exemplify the application of a new…

Data extraction is a crucial, yet labor-intensive and error-prone part of evidence synthesis. To date, efforts to harness machine learning for enhancing efficiency of the data extraction process have fallen short of achieving sufficient accuracy and usability. With the release of large language models (LLMs), new possibilities have emerged to…

When randomized control trials are not possible, quasi-experimental methods often represent the gold standard. One quasi-experimental method is difference-in-difference (DiD), which compares changes in outcomes before and after treatment across groups to estimate a causal effect. DiD researchers often use fairly exhaustive robustness checks to…

A linear model is often used to find the effect of a binary treatment D on a noncontinuous outcome Y with covariates X. Particularly, a binary Y gives the popular "linear probability model (LPM)," but the linear model is untenable if X contains a continuous regressor. This raises the question: what kind of treatment effect does the…

Some patients benefit from a treatment while others may do so less or do not benefit at all. We have previously developed a two-stage network meta-regression prediction model that synthesized randomized trials and evaluates how treatment effects vary across patient characteristics. In this article, we extended this model to combine different…

Randomised controlled trials of cancer treatments typically report progression free survival (PFS) and overall survival (OS) outcomes. Existing methods to synthesise evidence on PFS and OS either rely on the proportional hazards assumption or make parametric assumptions which may not capture the diverse survival curve shapes across studies and…

Multi-site randomized controlled trials (RCTs) provide unbiased estimates of the average impact in the study sample. However, their ability to accurately predict the impact for individual sites outside the study sample, to inform local policy decisions, is largely unknown. To extend prior research on this question, we analyzed six multi-site RCTs…

Plausible competing developmental models show similar or identical structural equation modeling model fit indices, despite making very different causal predictions. One way to help address this problem is incorporating outside information into selecting among models. This study attempted to select among developmental models of children's early…

This paper discusses, compares, and contrasts 4 different models for bringing evidence from randomised controlled trials (RCTs) into practice and into practical reasoning. I look at what questions the models can and cannot answer, what role they accord to RCT evidence, and what their possible attraction for practitioners might be. The models are…

Background: Network meta-analysis (NMA) of survival data with a multidimensional treatment effect has been introduced as an alternative to NMA based on the proportional hazards assumption. However, these flexible models have some limitations, such as the use of an approximate likelihood based on discrete hazards, rather than a likelihood for…

Despite the increase in federal tiered evidence initiatives that require the use of rigorous evaluation designs, such as randomized experiments, there has been limited guidance in the evaluation literature on practical strategies to implement such studies successfully. This paper provides lessons learned in executing experiments in applied…

Time-course model-based network meta-analysis (MBNMA) has been proposed as a framework to combine treatment comparisons from a network of randomized controlled trials reporting outcomes at multiple time-points. This can explain heterogeneity/inconsistency that arises by pooling studies with different follow-up times and allow inclusion of studies…

There has been increased interest in recent years regarding the utility of imported universal prevention and promotion (P&P) programmes in UK schools, many of which have a coaching model attached. However, there have been relatively few studies exploring the cultural transferability and social validity of these models, even though evidence…

This essay expands Perelman and Olbrechts-Tyteca's concept of argumentation by model to bring more attention to the persuasive effects of using the self as a model. To illuminate this technique, I analyze the personal narratives of popular health coaches, who are championing a holistic health movement toward what I refer to as "do-it-yourself…

Network meta-analysis (NMA) combines direct and indirect evidence from trials to calculate and rank treatment estimates. While modelling approaches for continuous and binary outcomes are relatively well developed, less work has been done with time-to-event outcomes. Such outcomes are usually analysed using Cox proportional hazard (PH) models.…