Alternative group judgment approaches to setting minimum competency standards were compared. Replication of results was possible for eight different tests (reading and mathematics, across four grade levels). The Kansas Competency Based Tests in reading and mathematics were administered statewide to students in grades two, four, six, and eight.…

Specific steps for applying the Angoff method are described. In the Angoff method, judges are asked to estimate the probabilities of minimally competent candidates' answering multiple choice test items correctly. Initial information must be obtained for designing the standard-setting process, beginning with the purpose of the examination and any…

The implicit definition of competence and the inferential chain that links the standard-setting process to the decision outcomes of the method are considered for two classes of standard-setting procedures: those involving data-free judgments of items and those involving data-based judgment of items. The major underlying assumptions of competence…

Possible sources of intrajudge inconsistency in standard setting are reviewed, and approaches are presented to improve the accuracy of rating. Procedures for providing judges with feedback through discussion or computerized communication are discussed. Monitoring and maintaining judges' consistency throughout the rating process are essential. (SLD)

The present study examines the influence of judges' item-related knowledge on setting standards for competency tests. Seventeen judges from different professions took a 122-item teacher-certification test in economics while setting competency standards for the test using the Angoff procedure. Judges tended to set higher standards for items they…

An approach is presented to the definition of minimal competence for judges to use in standard setting. Panelists in standard setting must receive training to ensure that differences in rating result from differences in perceptions of item difficulty, not in differences of opinion about the definition of minimal competence. (SLD)

Training judges to generate item ratings in standard setting once the reference group has been defined is discussed. It is proposed that sensitivity to the factors that determine difficulty can be improved through training. Three criteria for determining when training is sufficient are offered. (SLD)

Although arbitrary, whenever multiple judgmental standard-setting procedures are utilized by different groups concurrently, stability across raters can be achieved and decisions can be made in a relatively judicious manner. Greater stability across methods (Ebel, Nedelsky, Angoff) may be effected by slightly modifying the Ebel approach. (Author/PN)

This resource document represents the integration of both practice and theory related to minimum competency testing (MCT), and is largely based on information collected in a nationwide survey of MCT programs. Chapter 1, To Implement or Not to Implement MCT, by Marcy R. Perkins, presents a definition of MCT and a discussion of the perceived…

The status of minimum competency testing programs, as of June 30, 1979, is given through descriptions of 31 state programs and 20 local district programs. For each program, the following information is provided: legislative and policy history; implementation phase; goals; competencies to be tested; standards and standard setting; target groups and…