A standard-setting experiment was conducted in which one group of participants was instructed to refrain from discussing their recommended test standards and another group was requested to report the reasons underlying their recommendations. The procedures used were designed to induce convergence of recommendations, but did not require consensus.…

These five papers describe the methods, results, and implications of a multimethod approach to the establishment of standards for the three subject areas of the Alabama High School Graduation Examination (AHSGE). James E. McLean introduces the problems and methods involved by identifying three general approaches to scoring procedures found in the…

Connecticut's experience with four different standard-setting methods regarding multiple choice proficiency tests is described. The methods include Angoff, Nedelsky, Borderline Group, and Contrasting Groups Methods. All Connecticut ninth graders were administered proficiency tests in reading, language arts, and mathematics. As soon as final test…

Performance standards are useful tools when comparative evaluation or personal selection are not appropriate for decision making. The concept was developed in 1962 when Glaser introduced criterion referenced testing, to emphasize the importance of making test scores informative about learning processes rather than comparing them to other people's…

This article reviews developments in the field of educational measurement over the preceding 20 years, focusing on criterion-referenced measurement, item response theory, standard-setting methods, and equating methods. (TJH)

Discusses the problems associated with "grading on a curve," the approach often used for standard setting on language proficiency tests. Proposes four main steps presented in the setting of a non-arbitrary cut-score. These steps not only establish a proficiency standard checked by external criteria, but also check to see that the test covers the…

A structured Delphi procedure was used to secure the informed judgments of three types of adult participants (n=170) on appropriate standards for the North Carolina High School Competency Tests in Reading and Mathematics. The feasibility of the method and the amount of agreement between groups are discussed. (Author/PN)

The use by 31 reading specialists, compensatory education teachers, and secondary reading teachers of Angoff and Nedelsky methods for setting cutting scores for a high-school graduation test in reading comprehension was studied. The Angoff method provides a wider variety of information and yields estimates closer to actual p values. (TJH)

The borderline group standard-setting method (BGSM), Nedelsky method (NM), and Angoff method (AM) were compared, using reading scores for 1,948 and mathematics scores for 2,191 sixth through ninth graders. The NM and AM were inconsistent with the BGSM. Passing scores were higher where students were more able. (SLD)

A framework is provided for examining the validity of performance standards for high-stakes achievement tests. Assumptions that need to be evaluated are that the passing score corresponds to specified performance standards and that the specified standard is reasonable given the purpose of the decision. (SLD)

Several methods for determining a passing score on an examination from individual raters' estimates of minimal pass levels were compared through simulation. The methods used differed in the weighting estimates for each item received in the aggregation process. Reasons why the simplest procedure is most preferred are discussed. (SLD)

An approach is presented to the definition of minimal competence for judges to use in standard setting. Panelists in standard setting must receive training to ensure that differences in rating result from differences in perceptions of item difficulty, not in differences of opinion about the definition of minimal competence. (SLD)

This National Council on Measurement in Education module describes standard setting for achievement measures used in education, licensure, and certification. The purposes, design, and conduct of standard-setting procedures are reviewed, and ways to calculate a cutting score are demonstrated. A self-test and annotated bibliography are included.…

The contrasting groups method is one of many possible methods for setting passing scores. The most commonly used method is probably that developed by W. H. Angoff (1971), but it has been suggested that the Angoff method may not be appropriate for many standard setting applications in education. The contrasting groups method is explored as an…

The Cherry Creek School district (Englewood, Colorado) is a growing district of 37,000 students in the Denver area. The 1988 Colorado State School Finance Act required district-set proficiencies (standards), and forced agreement on a set of values for student knowledge and skills. State-adopted standards added additional requirements for the…