Severity and centrality are two main kinds of rater effects posing threats to the validity and fairness of performance assessments. Adopting Jin and Wang's (2018) extended facets modeling approach, we separately estimated the magnitude of rater severity and centrality effects in the web-based TestDaF (Test of German as a Foreign Language) writing…

Item Response Theory (IRT) is a ubiquitous model for understanding humans based on their responses to questions, used in fields as diverse as education, medicine and psychology. Large modern datasets offer opportunities to capture more nuances in human behavior, potentially improving test scoring and better informing public policy. Yet larger…

This study tests the extent to which giving credit for African American English (AAE) responses on a General American English sentence imitation test mitigates dialect effects. Forty-eight AAE-speaking second graders completed the Recalling Sentences subtest of the Clinical Evaluation of Language Fundamentals-Third Edition (1995). A Bayesian…