NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1182488
Record Type: Journal
Publication Date: 2017
Pages: 34
Abstractor: As Provided
ISBN: N/A
ISSN: EISSN-2196-0739
EISSN: N/A
Available Date: N/A
Assuming Measurement Invariance of Background Indicators in International Comparative Educational Achievement Studies: A Challenge for the Interpretation of Achievement Differences
Wendt, Heike; Kasper, Daniel; Trendtel, Matthias
Large-scale Assessments in Education, v5 Article 10 2017
Background: Large-scale cross-national studies designed to measure student achievement use different social, cultural, economic and other background variables to explain observed differences in that achievement. Prior to their inclusion into a prediction model, these variables are commonly scaled into latent background indices. To allow cross-national comparisons of the latent indices, measurement invariance is assumed. However, it is unclear whether the assumption of measurement invariance has some influence on the results of the prediction model, thus challenging the reliability and validity of cross-national comparisons of predicted results. Methods: To establish the effect size attributed to different degrees of measurement invariance, we rescaled the 'home resource for learning index' (HRL) for the 37 countries (n = 166,709) students) that participated in the IEA's combined 'Progress in International Reading Literacy Study' (PIRLS) and 'Trends in International Mathematics and Science Study' (TIMSS) assessments of 2011. We used (a) two different measurement models [one-parameter model (1PL) and two-parameter model (2PL)] with (b) two different degrees of measurement invariance, resulting in four different models. We introduced the different HRL indices as predictors in a generalized linear mixed model (GLMM) with mathematics achievement as the dependent variable. We then compared three outcomes across countries and by scaling model: (1) the differing fit-values of the measurement models, (2) the estimated discrimination parameters, and (3) the estimated regression coefficients. Results: The least restrictive measurement model fitted the data best, and the degree of assumed measurement invariance of the HRL indices influenced the random effects of the GLMM in all but one country. For one-third of the countries, the fixed effects of the GLMM also related to the degree of assumed measurement invariance. Conclusion: The results support the use of country-specific measurement models for scaling the HRL index. In general, equating procedures could be used for cross-national comparisons of the latent indices when country-specific measurement models are fitted. Cross-national comparisons of the coefficients of the GLMM should take into account the applied measurement model for scaling the HRL indices. This process could be achieved by, for example, adjusting the standard errors of the coefficients.
Springer. Available from: Springer Nature. 233 Spring Street, New York, NY 10013. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-348-4505; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Publication Type: Journal Articles; Reports - Research
Education Level: Elementary Secondary Education
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Azerbaijan; Australia; Austria; Taiwan (Taipei); Croatia; Czech Republic; Finland; Georgia Republic; Germany; Honduras; Hungary; Iran; Ireland; Italy; Lithuania; Malta; Morocco; Oman; Poland; Qatar; Romania; Saudi Arabia; Singapore; Slovakia; Slovenia; Spain; Sweden; United Arab Emirates
Identifiers - Assessments and Surveys: Trends in International Mathematics and Science Study; Progress in International Reading Literacy Study
Grant or Contract Numbers: N/A
Author Affiliations: N/A