Given the increased focus of educational research on what works for whom and under what circumstances over the last decade, educational researchers are increasingly turning toward mixture models to identify heterogeneous subgroups among students. Such data are inherently nested, as students are nested within classrooms and schools. Yet there has…

While significant attention has been given to test equating to ensure score comparability, limited research has explored equating methods for rater-mediated assessments, where human raters inherently introduce error. If not properly addressed, these errors can undermine score interchangeability and test validity. This study proposes an equating…

Multidimensionality and hierarchical data structure are common in assessment data. These design features, if not accounted for, can threaten the validity of the results and inferences generated from factor analysis, a method frequently employed to assess test dimensionality. In this article, we describe and demonstrate the application of the…

Professional learning (PL) encompasses the complexity of teacher learning and teacher agency in the process of learning. This paper aims to shed light on this complexity and proffers a conceptual meta-model of PL grounded in pragmatism to inform action in the design and evaluation of PL. It will firstly explore the aim and implications of the…

It is not always clear how to adjust for control data in causal inference, balancing the goals of reducing bias and variance. We show how, in a setting with repeated experiments, Bayesian hierarchical modeling yields an adaptive procedure that uses the data to determine how much adjustment to perform. The result is a novel analysis with increased…

In Bayesian statistics, the most widely used criteria of Bayesian model assessment and comparison are Deviance Information Criterion (DIC) and Watanabe-Akaike Information Criterion (WAIC). A multilevel mediation model is used as an illustrative example to compare different types of DIC and WAIC. More specifically, the study compares the…

Longitudinal data structures are frequently encountered in a variety of disciplines in the social and behavioral sciences. Growth curve modeling offers a highly extensible framework that allows for the exploration of rich hypotheses. However, owing to the presence of interrelated sources of potential data-model misfit at multiple levels, the…

For assessment scales applied to different groups (e.g., students from different states; patients in different countries), multigroup differential item functioning (MG-DIF) needs to be evaluated in order to ensure that respondents with the same trait level but from different groups have equal response probabilities on a particular item. The…

This study examined the impact of omitting covariates interaction effect on parameter estimates in multilevel multiple-indicator multiple-cause models as well as the sensitivity of fit indices to model misspecification when the between-level, within-level, or cross-level interaction effect was left out in the models. The parameter estimates…

This investigation examines the efficacy of multilevel analysis of individual heterogeneity and discriminatory accuracy (MAIHDA) over fixed-effects models when performing intersectional studies. The research questions are as follows: (1) What are typical strata representation rates and outcomes on physics research-based assessments? (2) To what…

Although servant leadership is practiced in higher education (HE), most literature on servant leadership has utilized samples with diverse occupational backgrounds and applied single-level analytic approaches. Recognizing the association between servant leadership and community citizenship behavior, our study investigated the factorial validity of…

Informed by two theoretical models of homework effects, we extended a model of homework on mathematics achievement in a large sample of Chinese eighth graders. Our model incorporated six clusters of homework variables -- student background factors, homework characteristics, teacher variables, parent variables, student motivation, and homework…

Measuring and understanding the nature of informant/rater effects and differences (Level 1) on a common trait when the target of measurement is at the organizational level (Level 2) involves a number of methodological considerations. Although previous research has discussed single-level latent variable applications of the correlated…

Multilevel meta-analysis is an innovative synthesis technique used for the quantitative integration of effect size estimates across participants and across studies. The quantitative summary allows for objective, evidence-based, and informed decisions in research, practice, and policy. Based on previous methodological work, the technique results in…

This note is concerned with examining the relationship between within-group and between-group variances in two-level nested designs. A latent variable modeling approach is outlined that permits point and interval estimation of their ratio and allows their comparison in a multilevel study. The procedure can also be used to test various hypotheses…