When randomized control trials are not possible, quasi-experimental methods often represent the gold standard. One quasi-experimental method is difference-in-difference (DiD), which compares changes in outcomes before and after treatment across groups to estimate a causal effect. DiD researchers often use fairly exhaustive robustness checks to…

The What Works Clearinghouse (WWC) maintains design standards to identify rigorous, internally valid education research. As education researchers advance new methodologies, the WWC must revise its standards to include an assessment of the new designs. Recently, the WWC has revised standards for two emerging study designs: regression discontinuity…

Multilevel modeling (MLM) is frequently used to detect cluster-level group differences in cluster randomized trial and observational studies. Group differences on the outcomes (posttest scores) are detected by controlling for the covariate (pretest scores) as a proxy variable for unobserved factors that predict future attributes. The pretest and…

Little is known empirically about intraclass correlations (ICCs) for multisite cluster randomized trial (MSCRT) designs, particularly in science education. In this study, ICCs suitable for science achievement studies using a three-level (students in schools in districts) MSCRT design that block on district are estimated and examined. Estimates of…

Young children removed from institutions and placed into foster care or adoptive homes have been shown to experience significant gains in IQ relative to children who remain in institutions. Less is known about the long-term impact of severe early deprivation on development in late childhood. Data are presented from a follow-up of children at 12…

Purpose: This paper was part of a larger study which looked into the effect of implementing Cooperative Teams-Games-Tournament (TGT) on understanding of and communication in mathematics. The study had identified the main and interaction effect of using Cooperative TGT for learning mathematics in religious secondary school classrooms. A…

Although evidence of negative associations between early literacy development and children's behavior problems exists, the field still lacks an understanding of the complicated links between these two areas. Children's gender has often not been included in much of the extant research as a potential moderating variable, yet gender differences may…

Use of multivariate analysis (e.g., multivariate analysis of variance) is common when normally distributed outcomes are collected in intervention research. However, when mixed responses--a set of normal and binary outcomes--are collected, standard multivariate analyses are no longer suitable. While mixed responses are often obtained in…

The present study investigated whether flipping an algebra classroom led to a stronger focus on conceptual understanding and improved learning of systems of linear equations for 54 seventh- and eighth-grade students using teacher journal data and district-mandated unit exam items. Multivariate analysis of covariance was used to compare scores on…