ERIC Number: ED379342
Record Type: Non-Journal
Publication Date: 1994-Jun
Pages: 56
Abstractor: N/A
ISBN: N/A
ISSN: N/A
EISSN: N/A
Available Date: N/A
Standard Setting on Performance Assessments: A Comparison between the Paper Selection Method and the Contrasting Groups Method.
Reckase, Mark D.
Comparative results are presented for procedures recently appearing in literature related to standard setting on the National Assessment of Educational Progress--the paper selection method and the contrasting group method. For this comparison, a probabilistic model with normal distribution of performance and a six-point scale were assumed. The paper selection method (American College Testing) requires judges to conceptualize students that are just at the borderline between categories. Papers are selected from a set that represents all levels of performance students at the borderline would likely have produced. The standard is set at the mean of the scores assigned to those papers as part of the regular scoring process. The contrasting groups method requires that teachers internalize the construct to be assessed, and then select students above and below the criterion of success. Papers for those students are scored, and a point between the two score distributions is selected as the standard. For the cases that were modeled, the paper-selection procedure provided better estimates of the standard and the percent above the standard than did the contrasting group procedure. Six tables and 13 figures (graphs) present details of the analyses. (Contains 9 references.) (SLD)
Publication Type: Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Assessments and Surveys: National Assessment of Educational Progress
Grant or Contract Numbers: N/A
Author Affiliations: N/A