This note is concerned with the study of temporal development in several indices reflecting clustering effects in multilevel designs that are frequently utilized in educational and behavioral research. A latent variable method-based approach is outlined, which can be used to point and interval estimate the growth or decline in important functions…

We note two possibilities for how our science might capitalize on advances in computing that harness and weave "big data" into the rich tapestry of how human development unfolds. First, we propose that the classic theoretical models that have guided developmental research since the 1970s and the hierarchical analytical models used to…

A latent variable modeling-based procedure is discussed that permits to readily point and interval estimate the design effect index in multilevel settings using widely circulated software. The method provides useful information about the relationship of important parameter standard errors when accounting for clustering effects relative to…

Comprehensive evaluation of treatment effects is aided by considerations for moderated effects. In educational research, the combination of natural hierarchical structures and prevalence of group-administered or shared facilitator treatments often produces three-level partially nested data structures. Literature details planning strategies for a…

Mixture modeling is a latent variable (i.e., a variable that cannot be measured directly) approach to quantitatively represent unobserved subpopulations within an overall population. It includes a range of cross-sectional (such as latent class [LCA] or latent profile analysis) and longitudinal (such as latent transition analysis) analyses and is…

Many national and international educational data collection programs offer researchers opportunities to investigate contextual effects related to student performance. In those programs, schools are often used in the first-stage sampling process and students are randomly drawn from selected schools. However, the "incidental" dependence of…

Multilevel modeling (MLM) is a term that encompasses many terms for statistical analyses that include variables at different levels. In education it is generally referred to as hierarchical linear modeling (HLM), linear mixed modeling (LMM), or growth curve modeling, but also includes terms such as: random-coefficient regression modeling,…

Discipline-based education researchers have a natural laboratory--classrooms, programs, colleges, and universities. Studies that administer treatments to multiple sections, in multiple years, or at multiple institutions are particularly compelling for two reasons: first, the sample sizes increase, and second, the implementation of the treatments…

Design-based methods have recently been developed as a way to analyze data from impact evaluations of interventions, programs, and policies. The impact estimators are derived using the building blocks of experimental designs with minimal assumptions, and have good statistical properties. The methods apply to randomized controlled trials (RCTs) and…

Longitudinal data analysis in education is the study growth over time. A longitudinal study is one in which repeated observations of the same variables are recorded for the same individuals over a period of time. This type of research is known by many names (e.g., time series analysis or repeated measures design), each of which can imply subtle…

This manuscript provides an overview of hierarchical linear modeling (HLM), as part of a series of papers covering topics relevant to consumers of educational research. HLM is tremendously flexible, allowing researchers to specify relations across multiple "levels" of the educational system (e.g., students, classrooms, schools, etc.).…