The implicit definition of competence and the inferential chain that links the standard-setting process to the decision outcomes of the method are considered for two classes of standard-setting procedures: those involving data-free judgments of items and those involving data-based judgment of items. The major underlying assumptions of competence…

A structured Delphi procedure was used to secure the informed judgments of three types of adult participants (n=170) on appropriate standards for the North Carolina High School Competency Tests in Reading and Mathematics. The feasibility of the method and the amount of agreement between groups are discussed. (Author/PN)

This study explores the use of the modified caution index (MCI) for identifying judges whose patterns of recommendations suggest that their judgments might be based on incomplete information, flawed reasoning, or inattention to their standard-setting tasks. It also examines the effect on test standards and passing rates when the test standards of…