Discipline-based education researchers have a natural laboratory--classrooms, programs, colleges, and universities. Studies that administer treatments to multiple sections, in multiple years, or at multiple institutions are particularly compelling for two reasons: first, the sample sizes increase, and second, the implementation of the treatments…

Multilevel models are an increasingly popular method to analyze data that originate from a clustered or hierarchical structure. To effectively utilize multilevel models, one must have an adequately large number of clusters; otherwise, some model parameters will be estimated with bias. The goals for this paper are to (1) raise awareness of the…

Multiple imputation is widely accepted as the method of choice to address item-nonresponse in surveys. However, research on imputation strategies for the hierarchical structures that are typically found in the data in educational contexts is still limited. While a multilevel imputation model should be preferred from a theoretical point of view if…

Generalized linear mixed models are frequently applied to data with clustered categorical outcomes. The effect of clustering on the response is often difficult to practically assess partly because it is reported on a scale on which comparisons with regression parameters are difficult to make. This article proposes confidence intervals for…

Multilevel modeling (MLM) is frequently used to detect cluster-level group differences in cluster randomized trial and observational studies. Group differences on the outcomes (posttest scores) are detected by controlling for the covariate (pretest scores) as a proxy variable for unobserved factors that predict future attributes. The pretest and…

Multilevel models are often used to evaluate hypotheses about relations among constructs when data are nested within clusters (Raudenbush & Bryk, 2002), although alternative approaches are available when analyzing nested data (Binder & Roberts, 2003; Sterba, 2009). The overarching goal of this article is to suggest when it is appropriate…

Experimental evaluations that involve the educational system usually involve a hierarchical structure (students are nested within classrooms that are nested within schools, etc.). Concerns about contamination, where research subjects receive certain features of an intervention intended for subjects in a different experimental group, have often led…

A cluster-randomized trial (CRT) relies on random assignment of intact clusters to treatment conditions, such as classrooms or schools (Raudenbush & Bryk, 2002). One specific type of CRT, a multi-site CRT (MSCRT), is commonly employed in educational research and evaluation studies (Spybrook & Raudenbush, 2009; Spybrook, 2014; Bloom,…

Educational researchers commonly use the rule of thumb of "design effect smaller than 2" as the justification of not accounting for the multilevel or clustered structure in their data. The rule, however, has not yet been systematically studied in previous research. In the present study, we generated data from three different models…

This study examined math growth trajectories by disability category, gender, race, and socioeconomic status using a nationally representative sample of students ages 7 to 17. The students represented 11 federal disability categories. Compared with the national norming sample, students in all 11 disability categories had lower math achievement…

This article examines the effects of one year of exposure to "Learning to Read in a Healing Classroom" (LRHC) on the reading and math skills of second- to fourth-grade children in the low-income and conflict-affected Democratic Republic of the Congo. LRHC consists of two primary components: teacher resource materials that infuse…

This study analyzes nationally-representative quantitative data from the first (2002) and second (2004) waves of the Educational Longitudinal Study to examine the relationship between Latina/o secondary school students' degree of English-language proficiency (ELP), mathematics course-taking measures, and 12th grade mathematics achievement.…

Career academies have been effective in reducing the high school dropout rates and increasing academic course taking and course credit accumulation among students (Kemple & Willner, 2008; Kemple & Snipes, 2000). However, not all students have access to career academy programs as they are not universally implemented across the state of…