In educational contexts, students often self-select into specific interventions (e.g., courses, majors, extracurricular programming). When students self-select into an intervention, systematic group differences may impact the validity of inferences made regarding the effect of the intervention. Propensity score methods are commonly used to reduce…

Field experiments in education frequently assign entire groups such as schools to treatment or control conditions. These experiments incorporate sometimes a longitudinal component where for example students are followed over time to assess differences in the average rate of linear change, or rate of acceleration. In this study, we provide methods…

Background: People with intellectual disabilities are vulnerable to develop psychopathology (in particular anxiety) and related challenging behaviour. Method: A comparative multiple case study with an experimental and a control condition. Results: The application of the guideline showed a trend of decreases of internalizing problems (P = 0.07) and…

In the "individually randomized group treatment" (IRGT) experimental design, individuals are first randomly assigned to a treatment arm or a control arm, but then within each arm, are grouped together (e.g., within classrooms/schools, through shared case managers, in group therapy sessions, through shared doctors, etc.) to receive…

This study applied systematic meta-analytic procedures to summarize findings from experimental and quasi-experimental investigations into the effectiveness of using the tools and techniques of corpus linguistics for second language learning or use, here referred to as data-driven learning (DDL). Analysis of 64 separate studies representing 88…

A common assumption in meta-analysis is that effect sizes are independent. When correlated effect sizes are analyzed using traditional univariate techniques, this assumption is violated. This research assesses the impact of dependence arising from treatment-control studies with multiple endpoints on homogeneity measures "Q" and…

Introduction: Although recent research has focused on the effects of maternal eating disorders (EDs) on children, little is known about the effect of maternal EDs on neurobiological outcomes in newborns and infants. This study is the first to investigate neurobehavioural regulation and cognitive development in newborns and infants of mothers with…

Propensity score applications are often used to evaluate educational program impact. However, various options are available to estimate both propensity scores and construct comparison groups. This study used a student achievement dataset with commonly available covariates to compare different propensity scoring estimation methods (logistic…

This study aimed to determine the effect of mastery learning model supported with reflective thinking activities on the fifth grade medical students' academic achievement. Mixed methods approach was applied in two samples (n = 64 and n = 6). Quantitative part of the study was based on a pre-test-post-test control group design with an experiment…

A key issue in quasi-experimental studies and also with many evaluations which required a treatment effects (i.e. a control or experimental group) design is selection bias (Shadish el at 2002). Selection bias refers to the selection of individuals, groups or data for analysis such that proper randomization is not achieved, thereby ensuring that…

Commentaries regarding appropriate methods for researching professional development have been a frequent topic in recent issues of "Educational Researcher" as well as other venues. In this article, the authors extend this discussion by observing that randomized trials of specific professional development programs have not enhanced our…

Using exogenous characteristics to identify endogenous subgroups, the approach discussed in this method note creates symmetric subsets within treatment and control groups, allowing the analysis to take advantage of an experimental design. In order to maintain treatment--control symmetry, however, prior work has posited that it is necessary to use…

Number relationships, which go far beyond counting skills, refer to the ability to represent a quantity in multiple, flexible ways. It is arguably among the most important mathematics concepts in number and quantity. The current study examined the effectiveness of number relationships instruction in preschool classrooms. Participants included 73…

This article examines changes in the research design, sample size, and precision between the planning phase and implementation phase of group randomized trials (GRTs) funded by the Institute of Education Sciences. Thirty-eight GRTs funded between 2002 and 2006 were examined. Three studies revealed changes in the experimental design. Ten studies…

Educational outcomes across multiple countries show large gaps between children's grade level curricular expectations and the actual learning levels of children. This paper discusses findings from an early grades literacy study and attempts to explore factors that potentially improve the English language learning results of Grades 3 and 4 learners…