ERIC Number: EJ1472316
Record Type: Journal
Publication Date: 2025
Pages: 33
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-0022-0973
EISSN: EISSN-1940-0683
Available Date: 0000-00-00
ANCOVA versus Change Score for the Analysis of Two-Wave Data
Oliver Lüdtke1; Alexander Robitzsch1
Journal of Experimental Education, v93 n2 p363-395 2025
There is a longstanding debate on whether the analysis of covariance (ANCOVA) or the change score approach is more appropriate when analyzing non-experimental longitudinal data. In this article, we use a structural modeling perspective to clarify that the ANCOVA approach is based on the assumption that all relevant covariates are measured (i.e., covariates are sufficient to remove confounding) and provides biased estimates of the treatment effect in the presence of unmeasured confounding variables. By contrast, the change score approach offers the option of controlling for unobserved confounders but relies on strong assumptions about the effects of these unobserved confounders and does not allow for dynamic causal relationships (i.e., pretest affects treatment variable). Furthermore, we discuss four issues that received less attention in previous research: (1) the inclusion of additional covariates in the ANCOVA and change score approaches, (2) the correction for measurement error in the predictor and treatment variables, (3) multilevel designs when the treatment is a cluster-level variable, and (4) the estimation of treatment effects in the presence of heterogeneity and nonlinearity. Implications for the analysis of non-experimental longitudinal data in educational and psychological research are discussed.
Descriptors: Statistical Analysis, Longitudinal Studies, Error of Measurement, Hierarchical Linear Modeling, Computation, Influences, Pretests Posttests, Scores, Statistical Bias
Routledge. Available from: Taylor & Francis, Ltd. 530 Walnut Street Suite 850, Philadelphia, PA 19106. Tel: 800-354-1420; Tel: 215-625-8900; Fax: 215-207-0050; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Descriptive
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1IPN – Leibniz Institute for Science and Mathematics Education, Kiel, Germany