Multivariate analysis of variance (MANOVA) is widely used to test the null hypothesis of equal multivariate means across 2 or more groups. MANOVA rests upon an assumption that error terms are independent of one another, which can be violated if individuals are clustered or nested within groups, such as schools. Ignoring such nesting can result in…

The year 2022 is the 20th anniversary of Joseph Schafer and John Graham's paper titled "Missing data: Our view of the state of the art," currently the most highly cited paper in the history of "Psychological Methods." Much has changed since 2002, as missing data methodologies have continually evolved and improved; the range of…

Multiple imputation (MI) can be used to address missing data at Level 2 in multilevel research. In this article, we compare joint modeling (JM) and the fully conditional specification (FCS) of MI as well as different strategies for including auxiliary variables at Level 1 using either their manifest or their latent cluster means. We show with…

Current practice for conducting power analyses in hierarchical trials using survey based ICC and effect size estimates may be misestimating power because ICCs are not being adjusted to account for treatment effect heterogeneity. Results presented in Table 1 show that the necessary adjustments can be quite large or quite small. Furthermore, power…

Researchers designing multisite and cluster randomized trials of educational interventions will usually conduct a power analysis in the planning stage of the study. To conduct the power analysis, researchers often use estimates of intracluster correlation coefficients and effect sizes derived from an analysis of survey data. When there is…

Multilevel models are an increasingly popular method to analyze data that originate from a clustered or hierarchical structure. To effectively utilize multilevel models, one must have an adequately large number of clusters; otherwise, some model parameters will be estimated with bias. The goals for this paper are to (1) raise awareness of the…

In this prospective study, we recruited a sample of Belgian adolescents (N = 886) to investigate to what extent perceived teachers' motivating style relates to quality of motivation in the beginning of the school year and, in turn, changes in study effort and procrastination by the end of the school year. After controlling for initial levels of…

We examine the intrinsic value students placed on schoolwork (i.e. academic intrinsic value) and social relationships (i.e. social intrinsic value). We then look at how these values predict middle and high school achievement. To do this, we came up with four profiles based on cluster analyses of 6,562 South Korean middle school students. The four…

When faced with child-related challenges associated with autism spectrum disorder, positive and negative social exchanges may be critical to parents' psychological well-being. This study examined the types and sources of positive and negative social exchanges reported by mothers and fathers of children with autism spectrum disorder and their…

The stability of educational test results from the Programme for International Student Assessment (PISA) over 15 years was examined, and the influence of demographics and social capital was assessed, as was the impact of educational reforms. The test results were remarkably stable, with correlations up to 0.99 for country-level results over 2…

What causes the literacy gap and can schools compensate for it? The authors investigated 3 drivers of the gap: preliteracy knowledge, schooling, and the summer vacation. Longitudinal literacy data over 5 time points were collected on 126 five-year-olds attending higher or lower socioeconomic status (SES) schools during their first 15 months of…

Using youth program models to frame the study of Gay-Straight Alliances (GSAs), we identified individual and structural predictors of greater engagement in these settings with a cross-sectional sample of 295 youth in 33 GSAs from the 2014 Massachusetts GSA Network Survey (69% LGBQ, 68% cisgender female, 68% White, M[subscript age] =16.07).…

I discuss three common practices that obfuscate or invalidate the statistical analysis of randomized controlled interventions in applied linguistics. These are (a) checking whether randomization produced groups that are balanced on a number of possibly relevant covariates, (b) using repeated measures ANOVA to analyze pretest-posttest designs, and…

There is growing interest in the use of a multi-tiered system of supports framework to address issues related to school climate and bullying. Positive Behavioral Interventions and Supports (PBIS) is one such model that has received considerable attention; however, nearly all of the extant literature has focused on elementary and middle schools,…

This exploratory study investigated potential sources of setting accommodation resulting in differential item functioning (DIF) on math and reading assessments for examinees with varied learning characteristics. The examinees were those who participated in large-scale assessments and were tested in either standardized or accommodated testing…