Open Educational Resources (OER) can offer educators the necessary flexibility for tailoring educational resources to better fit their educational goals. Although the number of OER repositories is growing fast, few studies have been conducted to empirically test the effectiveness of OER integration in the classroom. Furthermore, very little is…

Estimates of fidelity of implementation are essential to interpret the effects of educational interventions in randomized controlled trials (RCTs). While random assignment protects against many threats to validity, and therefore provides the best approximation to a true counterfactual condition, it does not ensure that the treatment condition…

I discuss three common practices that obfuscate or invalidate the statistical analysis of randomized controlled interventions in applied linguistics. These are (a) checking whether randomization produced groups that are balanced on a number of possibly relevant covariates, (b) using repeated measures ANOVA to analyze pretest-posttest designs, and…

In the 2014 report, "Closing the Achievement Gap Through Modification of Neurocognitive and Neuroendocrine Function: Results from a Cluster Randomized Controlled Trial of an Innovative Approach to the Education of Children in Kindergarten," researchers examined the impacts of "Tools of the Mind" on cognitive and academic…

A cluster-randomized trial (CRT) relies on random assignment of intact clusters to treatment conditions, such as classrooms or schools (Raudenbush & Bryk, 2002). One specific type of CRT, a multi-site CRT (MSCRT), is commonly employed in educational research and evaluation studies (Spybrook & Raudenbush, 2009; Spybrook, 2014; Bloom,…

We describe our experience of using a modified version of the Cochrane risk of bias (RoB) tool for randomised and non-randomised comparative studies. Objectives: (1) To assess time to complete RoB assessment; (2) To assess inter-rater agreement; and (3) To explore the association between RoB and treatment effect size. Methods: Cochrane risk of…

Interest in scaling up prekindergarten programs for children from low income families is dramatically increasing, especially with the announcement by President Obama of support for "universal preschool." Research in early education supports the idea of developmentally appropriate practice as reflected in instructional groupings and…

Generalizability theory (GT) offers a useful framework for estimating the reliability of a measure while accounting for multiple sources of error variance. The purpose of this study was to use GT to examine multiple sources of variance in and the reliability of school-level teacher and high school student behaviors as observed using the tool,…

This article describes the use of "Teacher Impression Journals" during a larger study that examined the efficacy of an intervention program designed to promote kindergarteners' positive attitudes toward peers with disabilities (i.e., the "Special Friends" program). The journals were designed to gather information about…

School-based improvement programs represent a core strategy in improving education because they can leverage pre-existing social and organizational structures to promote coordinated and comprehensive change across multiple facets of schooling. School-based programs are generally designed to be implemented by intact schools/districts, frequently…

Background: Given the dramatic increase in adolescent overweight and obesity, models are needed for implementing weight management treatment through readily accessible venues. We evaluated the acceptability and efficacy of a school-based intervention consisting of school nurse-delivered counseling and an afterschool exercise program in improving…

Purpose: The present article reports on the implementation and results of a randomized intervention trial targeting the literate language skills of prekindergarten children without identified language disorders but with low oral language skills. Method: Children (N = 82; 45 boys and 37 girls) were screened-in and randomized to a business-as-usual…

Young children and adolescents who have a parent with a serious physical illness require information and support to cope with their everyday lives. The purpose of this scoping review was to summarise and disseminate the research findings of interventions that support children in families with a serious physically ill parent. The review also aimed…

In this study, the authors examine the impact of a yearlong supplemental reading course involving daily instruction in the learning strategies curriculum on lower achieving adolescent students' reading achievement and motivation. Using a multiple-cohort randomized treatment-control group design over 4 years, they compared achievement and…

Purpose: We investigated a small-group intervention designed to teach vocabulary and comprehension skills to preschoolers who were at risk for language and reading disabilities. These language skills are important and reliable predictors of later academic achievement. Method: Preschoolers heard prerecorded stories 3 times per week over the course…