There is a longstanding debate on whether the analysis of covariance (ANCOVA) or the change score approach is more appropriate when analyzing non-experimental longitudinal data. In this article, we use a structural modeling perspective to clarify that the ANCOVA approach is based on the assumption that all relevant covariates are measured (i.e.,…

Recruiting participants for studies of early-life longitudinal development is challenging, often resulting in practical upper bounds in sample size and missing data due to attrition. These factors pose risks for the statistical power of such studies depending on the intended analytic model. One mitigation strategy is to increase measurement…

Developmental researchers commonly utilize longitudinal data to decompose reciprocal and dynamic associations between repeatedly measured constructs to better understand the temporal precedence between constructs. Although the cross-lagged panel model (CLPM) is commonly used in developmental research, it has been criticized for its potential to…

Intensive longitudinal data is increasingly used to study state-like processes such as changes in daily stress. Measures aimed at collecting such data require the same level of scrutiny regarding scale reliability as traditional questionnaires. The most prevalent methods used to assess reliability of intensive longitudinal measures are based on…

Cluster randomized control trials often incorporate a longitudinal component where, for example, students are followed over time and student outcomes are measured repeatedly. Besides examining how intervention effects induce changes in outcomes, researchers are sometimes also interested in exploring whether intervention effects on outcomes are…

Multilevel modelling (MLM) is the most frequently used approach for evaluating interventions with clustered data. MLM, however, has some limitations that are associated with numerous obstacles to model estimation and valid inferences. Longitudinal multiple-group (LMG) modelling is a longstanding approach for testing intervention effects using…

Applied educational researchers may be interested in exploring random slope effects in multilevel models, such as when examining individual growth trajectories with longitudinal data. Random slopes are effects for which the slope of an individual-level coefficient varies depending on group membership, however these effects can be difficult to…

Developmental researchers commonly utilize multilevel models (MLMs) to describe and predict individual differences in change over time. In such growth model applications, researchers have been widely encouraged to supplement reporting of statistical significance with measures of effect size, such as R-squareds ("R[superscript 2]") that…

Longitudinal assessment is a type of assessment involving repeated measures over a period to evaluate whether and when an attribute (e.g., ability, skill) changes. Thus, change detection is of central interest in longitudinal assessment. In the assessment setting, change in the desired direction (typically upward) is often referred to as…

School climate surveys are central to school improvement and principal evaluation policies. The quality of school climate has been linked both to student achievement and to teacher retention. Oftentimes, policymakers and practitioners are concerned with monitoring change in school climate quality in each academic year. Such applications assume…

Large-scale assessment survey (LSAS) data are collected via complex sampling designs with special features (e.g., clustering and unequal probability of selection). Multilevel models have been utilized to account for clustering effects whereas the probability weighting approach (PWA) has been used to deal with design informativeness derived from…

Large-scale education data are collected via complex sampling designs that incorporate clustering and unequal probability of selection. Multilevel models are often utilized to account for clustering effects. The probability weighted approach (PWA) has been frequently used to deal with the unequal probability of selection. In this study, we examine…

Background: A common critique of adventure education research methodology is the overreliance on pre-/post-study designs to measure change. Purpose: This paper compares and contrasts two methods of data analysis on the same adventure education data set to show how these distinct approaches provide starkly different results and interpretation.…

Many national and international educational data collection programs offer researchers opportunities to investigate contextual effects related to student performance. In those programs, schools are often used in the first-stage sampling process and students are randomly drawn from selected schools. However, the "incidental" dependence of…

When selecting a multilevel model to fit to a dataset, it is important to choose both a model that best matches characteristics of the data's structure, but also to include the appropriate fixed and random effects parameters. For example, when researchers analyze clustered data (e.g., students nested within schools), the multilevel model can be…