ERIC Number: EJ954150
Record Type: Journal
Publication Date: 2012
Pages: 17
Abstractor: As Provided
ISBN: N/A
ISSN: ISSN-1530-5058
EISSN: N/A
Available Date: N/A
Applying Rasch Model and Generalizability Theory to Study Modified-Angoff Cut Scores
Arce, Alvaro J.; Wang, Ze
International Journal of Testing, v12 n1 p44-60 2012
The traditional approach to scale modified-Angoff cut scores transfers the raw cuts to an existing raw-to-scale score conversion table. Under the traditional approach, cut scores and conversion table raw scores are not only seen as interchangeable but also as originating from a common scaling process. In this article, we propose an alternative approach to scale cut scores that first explores the interchangeability between raw cuts and raw scores and then verifies that both sets of scores share a common metric. The two approaches are compared with Rasch measurement model and Generalizability theory using real data from a standard setting study. The two approaches show nontrivial differences in their locations of scaled cut scores, but variability of their scaled cut scores remains comparable. The results illustrate the importance of verifying that panelists' judgment of item difficulties and empirical item difficulties are on a common metric prior to the scaling of standard setting cuts. (Contains 5 tables and 2 figures.)
Descriptors: Generalizability Theory, Item Response Theory, Cutting Scores, Scaling, Raw Scores, Standard Setting (Scoring), Test Items, Difficulty Level, Error of Measurement
Routledge. Available from: Taylor & Francis, Ltd. 325 Chestnut Street Suite 800, Philadelphia, PA 19106. Tel: 800-354-1420; Fax: 215-625-2940; Web site: http://www.tandf.co.uk/journals
Publication Type: Journal Articles; Reports - Evaluative
Education Level: Elementary Secondary Education; Grade 3; Grade 5; Grade 7
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A