Standards-based score reports interpret test performance with reference to cut scores defining categories like "below basic," "proficient," or "master." This article first develops a conceptual framework for validity arguments supporting such interpretations, then presents three applications. Two of these serve to introduce new standard-setting…

Reviews the Test of Practical Knowledge, a multiple choice test of "functional competency," noting that the test's task requirements are confounded by such factors as intelligence, achievement, social knowledge, and reading ability. (HOD)

Political and educational consequences of standard setting for criterion-referenced tests are discussed. Suggestions for setting standards are given. (JKS)

Possible sources of intrajudge inconsistency in standard setting are reviewed, and approaches are presented to improve the accuracy of rating. Procedures for providing judges with feedback through discussion or computerized communication are discussed. Monitoring and maintaining judges' consistency throughout the rating process are essential. (SLD)

A detailed analysis of standard setting and criteria for test scores and educational decisions is presented. The author contends that present procedures are in need of re-examination. (JKS)

An approach is presented to the definition of minimal competence for judges to use in standard setting. Panelists in standard setting must receive training to ensure that differences in rating result from differences in perceptions of item difficulty, not in differences of opinion about the definition of minimal competence. (SLD)

Training judges to generate item ratings in standard setting once the reference group has been defined is discussed. It is proposed that sensitivity to the factors that determine difficulty can be improved through training. Three criteria for determining when training is sufficient are offered. (SLD)

Student test scores are increasingly used to judge the competence of the educational enterprise. Exaggeration of scores is the result of directing attention away from the individual student achievement to the average scores of schools, districts, and states. Implications and recommendations are discussed. (BJV)