Background: Multilevel randomized controlled trials (MRCTs) have been widely used to evaluate the causal effects of educational interventions. Traditionally, educational researchers and policymakers focused on the average treatment effects (ATE) of the intervention. Recently there has been an increasing interest in evaluating the heterogeneity of…

Combining observational and experimental data for causal inference can improve treatment effect estimation. However, many observational data sets cannot be released due to data privacy considerations, so one researcher may not have access to both experimental and observational data. Nonetheless, a small amount of risk of disclosing sensitive…

RobotReviewer is a tool for automatically assessing the risk of bias in randomized controlled trials, but there is limited evidence of its reliability. We evaluated the agreement between RobotReviewer and humans regarding the risk of bias assessment based on 1955 randomized controlled trials. The risk of bias in these trials was assessed via two…

Evidence-based medicine (EBM) is helpful for laypersons' decision-making. This study aimed to evaluate the effectiveness of e-learning materials on the essential components of EBM for laypersons. We conducted a web-based, open-label, randomized controlled trial with laypersons in Japan aged [greater than or equal to]20 years who used the internet.…

Meta-analyses are systematic summaries of research that use quantitative methods to find the mean effect size (standardized mean difference) for interventions. Critics of meta-analysis point out that such analyses can conflate the results of low- and high-quality studies, make improper comparisons and result in statistical noise. All these…

Implementation intentions are self-regulatory strategies that increase the probability that desired goals will be achieved. While their effectiveness in the short term is well established in the literature, the long-term effects are not. The present study, which was conducted in France during the COVID-19 lockdown, aimed to test whether reminders…

In multisite trials, learning about treatment effect variation across sites is critical for understanding where and for whom a program works. Unadjusted comparisons, however, capture "compositional" differences in the distributions of unit-level features as well as "contextual" differences in site-level features, including…

Many randomized controlled trials have investigated the role of school-based prevention interventions to reduce symptoms of anxiety and depression in young people. Systematic reviews have subsequently demonstrated a small, beneficial effect of these interventions when compared to a combined control group including usual care, no intervention, or…

In multisite trials, learning about treatment effect variation across sites is critical for understanding where and for whom a program works. Unadjusted comparisons, however, capture "compositional" differences in the distributions of unit-level features as well as "contextual" differences in site-level features, including…

During drug development, a biomarker is sometimes identified as separating a patient population into those with more and those with less benefit from evaluated treatments. Consequently, later studies might be targeted, while earlier ones are performed in mixed patient populations. This poses a challenge in evidence synthesis, especially if only…

Randomised trials are often funded by commercial companies and methodological studies support a widely held suspicion that commercial funding may influence trial results and conclusions. However, these studies often have a risk of confounding and reporting bias. The risk of confounding is markedly reduced in meta-epidemiological studies that…

Network meta-analysis is a popular method to synthesize the information obtained in a systematic review of studies (e.g., randomized clinical trials) involving subsets of multiple treatments of interest. The dominant method of analysis employs within-study information on treatment contrasts and integrates this over a network of studies. One…

Perfectionism has adverse impacts on mental health and academic outcomes. We evaluated a 5-lesson classroom intervention for young adolescents delivered by teachers for impact on perfectionism, well-being, self-compassion, academic motivation and negative affect, at post-intervention and 3-month follow-up. Classes (N = 636 students, M[subscript…

Tender Shoots is a randomized controlled trial (RCT) for parents aimed at improving preschool children's oral language skills relevant for later reading. Parents of 72 preschool children (M = 50 months) were randomly assigned to either a Rich Reading and Reminiscing (RRR) condition, a Strengthening Sound Sensitivity (SSS) condition, or an…

Background: Compensatory cleft speech disorders can severely impact speech understandability and speech acceptability. Speech intervention is necessary to eliminate these disorders. There is, however, currently no consensus on the most effective speech therapy approach to eliminate the different subtypes of compensatory cleft speech disorders.…