NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
ERIC Number: ED633993
Record Type: Non-Journal
Publication Date: 2022
Pages: 145
Abstractor: As Provided
ISBN: 979-8-3795-5284-8
ISSN: N/A
EISSN: N/A
Available Date: N/A
Factor Scores in Clustered Data: An Evaluation of Methods to Obtain Level-1 and Level-2 Scores
Strauss, Christian L. L.
ProQuest LLC, Ph.D. Dissertation, The University of North Carolina at Chapel Hill
In many psychological and educational applications, it is imperative to obtain valid and reliable score estimates of multilevel processes. For example, in order to assess the quality and characteristics of high impact learning processes, one must compute accurate scores representative of student- and classroom-level constructs. Currently, there are two general approaches to analyzing multilevel latent variable item response: (1) the aggregated approach or single-level factor analysis with cluster robust standard errors and (2) multilevel factor models (e.g., Stapleton, McNeish, et al., 2016; Stapleton, Yang, et al., 2016); however, there is a gap in methodological literature regarding which method produces optimal level-1 and level-2 factor score estimates. An additional complication arises when sources of measurement invariance exist at level-2. Past research has suggested that incorporating background characteristics into scoring models improves factor score estimates (Curran et al., 2016), but this has not been expanded to a multilevel context. Thus, the present study extensively evaluates factor scores extracted from a variety of measurement models, in the presence of measurement invariance at level-2. Both simulation methodology evaluating correlations between factor scores and true scores and an empirical demonstration with educational data were utilized. No single scoring procedure was consistently superior in producing reliable factor score estimates at both level-1 and level-2 -- rather, findings were contextual. At level-1, scores extracted from multilevel models that disaggregated true level-1 and level-2 scores were generally correlated highest with true scores. At level-2, correlations between true scores and factor scores depended on the underlying level-2 factor structure. With the same number of factors at level-1 and level-2, aggregated and disaggregated approaches performed similarly with 250 level-2 clusters. With only 50 level-2 clusters, aggregated approaches outperformed disaggregated approaches. With fewer factors at level-2 compared to level-1, multilevel measurement models were superior regardless of the number of level-2 clusters. Incorporating measurement non-invariance into measurement models did not substantially improve factor score estimates in the presence of non-invariance at level-2. Simulation results were used to inform a subsequent empirical analysis and demonstration, and were translated into recommendations for research in practice. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page: http://www.proquest.com/en-US/products/dissertations/individuals.shtml.]
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site: http://www.proquest.com/en-US/products/dissertations/individuals.shtml
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A