Several variants of the autoregressive structural equation model were suggested over the past years, including, for example, the random intercept autoregressive panel model, the latent curve model with structured residuals, and the STARTS model. The present work shows how to place these models into a mixed-effects model framework and how to…

Multilevel factor mixture modeling (FMM) is a hybrid of multilevel confirmatory factor analysis (CFA) and multilevel latent class analysis (LCA). It allows researchers to examine population heterogeneity at the within level, between level, or both levels. This tutorial focuses on explicating the model specification of multilevel FMM that considers…

The use of large-scale assessments (LSAs) in education has grown in the past decade though analysis of LSAs using multilevel models (MLMs) using R has been limited. A reason for its limited use may be due to the complexity of incorporating both plausible values and weighted analyses in the multilevel analyses of LSA data. We provide additional…

In this article, we present a two-stage estimation approach applied to multilevel latent class analysis (LCA) with covariates. We separate the estimation of the measurement and structural model. This makes the extension of the structural model computationally efficient. We investigate the robustness against misspecifications of the proposed…

Longitudinal data structures are frequently encountered in a variety of disciplines in the social and behavioral sciences. Growth curve modeling offers a highly extensible framework that allows for the exploration of rich hypotheses. However, owing to the presence of interrelated sources of potential data-model misfit at multiple levels, the…

Cluster randomized control trials often incorporate a longitudinal component where, for example, students are followed over time and student outcomes are measured repeatedly. Besides examining how intervention effects induce changes in outcomes, researchers are sometimes also interested in exploring whether intervention effects on outcomes are…

This study introduces a longitudinal diagnostic classification model, called the LTA+HDCM, which is a fusion of latent transition analysis (LTA; Collins & Flaherty, 2002; Collins & Wugalter, 1992) and the hierarchical diagnostic classification model (HDCM; Templin & Bradshaw, 2014). The primary goals in this study are (1) to evaluate…

Educators commonly use school climate survey scores to inform and evaluate interventions for equitably improving learning and reducing educational disparities. Unfortunately, validity evidence to support these (and other) score uses often falls short. In response, Whitehouse et al. proposed a collaborative, two-part validity testing framework for…

In randomized control trials (RCT), the recent focus has shifted to how an intervention yields positive results on its intended outcome. This aligns with the recent push of implementation science in healthcare (Bauer et al., 2015) but goes beyond this. RCTs have moved to evaluating the theoretical framing of the intervention as well as differing…

Although much attention has been given to rater effects in rater-mediated assessment contexts, little research has examined the overall stability of leniency and severity effects over time. This study examined longitudinal scoring data collected during three consecutive administrations of a large-scale, multi-state summative assessment program.…

Education experiments frequently assign students to treatment or control conditions within schools. Longitudinal components added in these studies (e.g., students followed over time) allow researchers to assess treatment effects in average rates of change (e.g., linear or quadratic). We provide methods for a priori power analysis in three-level…

Hierarchical linear modeling (HLM) has become an increasingly popular multilevel method of analyzing data among nested datasets, in particular, the effect of specialized academic programming within schools. The purpose of this methodological study is to demonstrate the use of HLM to determine the effectiveness of STEM programming in an Ohio middle…

Measuring and understanding the nature of informant/rater effects and differences (Level 1) on a common trait when the target of measurement is at the organizational level (Level 2) involves a number of methodological considerations. Although previous research has discussed single-level latent variable applications of the correlated…

Organizational relationships are complex. Employees do their work as individuals, but also as members of larger teams. They exist within various social networks, both within and spanning organizations. Multilevel theory is at the core of the organizational sciences, and unpacking multilevel relationships is fundamental to the challenges faced…

Valid inferences on teaching drawn from students' test scores require that tests are sensitive to the instruction students received in class. Accordingly, measures of the test items' instructional sensitivity provide empirical support for validity claims about inferences on instruction. In the present study, we first introduce the concepts of…