Angoff-based standard setting is widely used, especially for high-stakes licensure assessments. Nonetheless, some critics have claimed that the judgment task is too cognitively complex for panelists, whereas others have explicitly challenged the consistency in (replicability of) standard-setting outcomes. Evidence of consistency in item judgments…

Examines criteria for choosing between test-centered and examinee-centered methods of standard setting in empirical terms and in terms of whether the method is consistent with the model of achievement underlying test design and interpretation and the assessment methods being used. Contains 35 references. (Author/SLD)

Reviews and evaluates compensatory and conjunctive standard-setting strategies, presenting and discussing the rationales for each approach. Results of a comparison of the two approaches for a state high school certification writing test provide insight into the problem of choosing either strategy. (SLD)

The use of achievement levels and anchor points in press reports of the 1990 National Assessment of Educational Progress mathematics assessment was studied. In a review of 41 articles, widespread oversimplification and frequent misinterpretations were found, sometimes stemming from standards-based reporting. Implications for future standards-based…

Applied the analytical judgment standard setting method to 90 papers from the 1996 Grade 8 National Assessment of Educational Progress science assessment. Compared sorting versus direct classification, long and short versions of the classification scale, and effects of discussion on cutscores. Results from 17 Georgia teachers and 8 Michigan…