Hierarchical data is often observed in education data. Analyzing such data with Multilevel Modeling becomes crucial to understanding the relationship at the individual and group levels. However, one of the most significant problems with this kind of data is small sample sizes and very low Intraclass Correlations. The multivariate Latent Covariate…

Current practice for conducting power analyses in hierarchical trials using survey based ICC and effect size estimates may be misestimating power because ICCs are not being adjusted to account for treatment effect heterogeneity. Results presented in Table 1 show that the necessary adjustments can be quite large or quite small. Furthermore, power…

Researchers designing multisite and cluster randomized trials of educational interventions will usually conduct a power analysis in the planning stage of the study. To conduct the power analysis, researchers often use estimates of intracluster correlation coefficients and effect sizes derived from an analysis of survey data. When there is…

We present types of constructs, individual- and cluster-level, and their confirmatory factor analytic validation models when data are from individuals nested within clusters. When a construct is theoretically individual level, spurious construct-irrelevant dependency in the data may appear to signal cluster-level dependency; in such cases,…

Entry into school represents as much a challenge for children as it does for their parents. The authors examined the ways in which transition practices help children and their families feel prepared for school entry, as measured by the child's emotional adaptation during the first days in class and the family's sense of being prepared for this…

What causes the literacy gap and can schools compensate for it? The authors investigated 3 drivers of the gap: preliteracy knowledge, schooling, and the summer vacation. Longitudinal literacy data over 5 time points were collected on 126 five-year-olds attending higher or lower socioeconomic status (SES) schools during their first 15 months of…

Using youth program models to frame the study of Gay-Straight Alliances (GSAs), we identified individual and structural predictors of greater engagement in these settings with a cross-sectional sample of 295 youth in 33 GSAs from the 2014 Massachusetts GSA Network Survey (69% LGBQ, 68% cisgender female, 68% White, M[subscript age] =16.07).…

Little is known empirically about intraclass correlations (ICCs) for multisite cluster randomized trial (MSCRT) designs, particularly in science education. In this study, ICCs suitable for science achievement studies using a three-level (students in schools in districts) MSCRT design that block on district are estimated and examined. Estimates of…

Research has found that when compared with civilian students, military-connected students in the United States have more negative mental health outcomes, stemming from the stress of military life events (i.e., deployment). To date, studies on military-connected youth have not examined the role of protective factors within the school environment,…

I discuss three common practices that obfuscate or invalidate the statistical analysis of randomized controlled interventions in applied linguistics. These are (a) checking whether randomization produced groups that are balanced on a number of possibly relevant covariates, (b) using repeated measures ANOVA to analyze pretest-posttest designs, and…

There is growing interest in the use of a multi-tiered system of supports framework to address issues related to school climate and bullying. Positive Behavioral Interventions and Supports (PBIS) is one such model that has received considerable attention; however, nearly all of the extant literature has focused on elementary and middle schools,…

School climate has increasingly been recognized as an essential component of school improvement owing to the established associations between a positive school climate and academic outcomes for students. Our study examines associations among a brief measure of school climate assessing elementary student perceptions and the College and Career Ready…

Background: Cluster randomized experiments that assign intact groups such as schools or school districts to treatment conditions are increasingly common in educational research. Such experiments are inherently multilevel designs whose sensitivity (statistical power and precision of estimates) depends on the variance decomposition across levels.…

The purpose of this project is to demonstrate the practical methods developed to utilize a dataset consisting of both multivariate and multilevel effect size data. The context for this project is a large-scale meta-analytic review of the predictors of academic achievement. This project is guided by three primary research questions: (1) How do we…

This study examined the relationship between hours in general education and achievement in reading and mathematics for students with disabilities. The study population included more than 1,300 students between the ages of 6 and 9 years old within 180 school districts. Hierarchical linear modeling (HLM) was utilized with the Pre-Elementary…