The present study examines the influence of judges' item-related knowledge on setting standards for competency tests. Seventeen judges from different professions took a 122-item teacher-certification test in economics while setting competency standards for the test using the Angoff procedure. Judges tended to set higher standards for items they…

The writing examination package is divided into three volumes: Examination Handbook (present volume), Training Manual, and a Ratings Manual. The volumes are interdependent, and all three must be understood before using the Training Manual to train raters. The Examination Handbook provides a context for the other two volumes. It gives a general…

Criteria for the selection of judges (evaluators) for setting item-based standards involved in tests for which cutting scores must be established are investigated. Focus is on cases in which test standards are based on specialists' judgments concerning the difficulty of test items in tests used to determine who will be awarded a diploma, admitted…