When randomized control trials are not possible, quasi-experimental methods often represent the gold standard. One quasi-experimental method is difference-in-difference (DiD), which compares changes in outcomes before and after treatment across groups to estimate a causal effect. DiD researchers often use fairly exhaustive robustness checks to…

Cluster randomized trials (CRTs) are commonly used to evaluate the causal effects of educational interventions, where the entire clusters (e.g., schools) are randomly assigned to treatment or control conditions. This study introduces statistical methods for designing and analyzing two-level (e.g., students nested within schools) and three-level…

Individual participant data (IPD) meta-analysis projects obtain, harmonise, and synthesise original data from multiple studies. Many IPD meta-analyses of randomised trials are initiated to identify treatment effect modifiers at the individual level, thus requiring statistical modelling of interactions between treatment effect and participant-level…

Background: Network meta-analysis (NMA) of survival data with a multidimensional treatment effect has been introduced as an alternative to NMA based on the proportional hazards assumption. However, these flexible models have some limitations, such as the use of an approximate likelihood based on discrete hazards, rather than a likelihood for…

Educational stakeholders are keen to know the magnitude and importance of different interventions. However, the way evidence is communicated to support understanding of the effectiveness of an intervention is controversial. Typically studies in education have used the standardised mean difference as a measure of the impact of interventions. This…

A meta-analysis of randomized controlled trials (RCTs) has recently showed that theory-based interventions designed to promote physical activity (PA) significantly increased PA behavior. The objective of the present study was to investigate the moderators of the efficacy of these theory-based interventions. Seventy-seven RCTs evaluating…

Background: The purpose is to determine if altering school breakfast policies and the school breakfast environment will positively impact adolescent beliefs of the barriers and benefits of eating breakfast. Methods: There were 904 adolescents from 16 rural high schools, Minnesota, in the BreakFAST Study who reported eating breakfast fewer than 4…

This study sought to better understand the prevalence of concurrent and specific difficulties in reading fluency and vocabulary among adolescents with low reading comprehension. Latent class analysis (LCA) was used to identify a sample of 180 students in sixth through eighth grades with reading comprehension difficulties. A subsequent LCA…

This study examined the effectiveness of a brief theory-based intervention on muscular strength among adolescents in a physical education setting. The intervention adopted a process-based mental simulation technique. The self-reported frequency of practising for and actual levels of abdominal muscular strength/endurance as one component of…

Due to the complexity of the counseling process, counselors-in-training often experience performance anxiety when entering the counseling profession. Research shows that higher counseling self-efficacy (the belief in oneself to perform counseling skills successfully) helps decrease performance anxiety. Further, a strong supervisory working…

Objective: This study examined the efficacy of Hands-On Parent Empowerment-20 (HOPE-20) program. Methods: Eligible participants were parents residing in Hong Kong with target children aged 2 years attending nursery schools. Cluster randomized control trial was adopted, with 10 schools (110 participants) assigned to intervention group and 8 schools…

This study examined the effects of a newly developed on-site consultancy programme to improve global quality of the child care environment in non-parental child care centres for 0- to 4-year-old children as measured with the ITERS-R/ECERS-R. Using a randomised controlled trial with a pretest, posttest, and follow-up test, we compared 35…

Starting Strong in Kindergarten (Starting Strong) is a school-based indicated prevention targeting behavior problems, student-teacher relationships, and parent-school connectedness for children with or at risk for disruptive behavior problems during the transition to kindergarten. By use of a block-randomized, controlled trial to test program…

I discuss three common practices that obfuscate or invalidate the statistical analysis of randomized controlled interventions in applied linguistics. These are (a) checking whether randomization produced groups that are balanced on a number of possibly relevant covariates, (b) using repeated measures ANOVA to analyze pretest-posttest designs, and…

Objectives: To assess the effects of a 12-week pedometer-based intervention on the physical activity behavior, health-related quality of life (HRQOL), and psychological well-being of first-year university students. Participants: First-year university students (N = 184) were recruited during September 2012 and randomly assigned to an intervention…