NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ1472959
Record Type: Journal
Publication Date: 2025-Jun
Pages: 45
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1040-726X
EISSN: EISSN-1573-336X
Available Date: 2025-06-02
A More Comprehensive, More Reliable Multilevel Approach for Assessing and Modeling Teacher Judgment Accuracy Using Latent Variables
Educational Psychology Review, v37 n2 Article 53 2025
We propose a novel approach for modeling judgment accuracy that, for the first time, allows for simultaneously considering the rank, level, and differentiation component, the predominantly applied operationalization of teacher judgment accuracy. These components are conceptualized as latent, unobserved individual abilities. The model is introduced technically and its functionality is illustrated. Next, several model extensions are described that enhance the model's capabilities to address important research questions in teacher judgment accuracy research, such as concerning moderators of judgment accuracy or the effect of judgment accuracy on learning outcomes. We study the newly proposed model in three simulation studies demonstrating that our approach provides more accurate individual-level estimates of judgment accuracy components than the traditional, still widely applied person- and component-wise calculation (simulation study 1), that our approach yields more accurate standard errors of moderation effects of judgment accuracy components resulting in higher true positive rates across various typical sample size scenarios (simulation study 2), and that our approach yields lower parameter bias and higher coverage rates of predictive effects (simulation study 3). The findings underscore the model's potential for improving the assessment and modeling of judgment accuracy although the improvement over the person-score-based two-step approach was rather small in some conditions. We present two real data examples, including a step-by-step tutorial how to apply the newly proposed approach, and conclude by discussing the implications of our results and suggesting directions for future research. Easy-to-use R code is provided to simplify the application of the new judgment accuracy model.
Springer. Available from: Springer Nature. One New York Plaza, Suite 4600, New York, NY 10004. Tel: 800-777-4643; Tel: 212-460-1500; Fax: 212-460-1700; e-mail: customerservice@springernature.com; Web site: https://link.springer.com/
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: 1Kiel University, Institute for Psychology of Learning and Instruction, Kiel, Germany; 2Medical School Hamburg, Hamburg, Germany