It is argued that the modification of the Nedelsky procedure proposed by L. J. Gross is a valid approach to setting standards when clinical reasoning is measured using multiple-choice questions. An example from the Medical Council of Canada's Qualifying Examination for approximately 2,400 examinees demonstrates the procedure's value. (SLD)

Issues that program planners should consider in developing performance standards for the Job Training Partnership Act (JTPA) older worker programs (OWPs) are reviewed. Using goal-setting theory and the results of a two-year evaluation of OWPs in Texas, the discussion covers approaches to developing standards for programs other states. (TJH)

Three approaches to setting the evaluation standards for testing pharmacy practice knowledge of pharmaceutical students are discussed and compared: relative standards; absolute standards; and a compromise approach using various sources of evaluation information. The application of the different approaches to a 120-item assessment previously…

In 1991 the Measurement and Evaluation Center of the University of Texas at Austin was asked to develop a test for credit by examination in four lower division courses in Japanese. The test (in Japanese) was constructed from locally developed items provided by instructors of Japanese. The developed test consisted of 80 items distributed among…

Performance assessments in education and credentialing are becoming popular. At the same time, there do not exist any well established and validated methods for setting standards on performance assessments. This paper describes several of the new standard-setting methods that are emerging for use with performance assessments and considers their…

This article explores issues involved in using assessments as a means of defining standards and encouraging efforts to meet them. It compares the European examination system with the present American testing system. It also considers issues that must be faced in defining learning domains in ways that do not encourage narrowly focused training on…

Setting standards on performance measures is discussed in the context of the State Collaborative on Assessment and Student Standards (SCASS) initiative supported by the Council of Chief State School Offices. The usual item-based methods for standard setting, the methods developed by Nedelsky (1954), Angoff (1971), and Ebel (1972), were developed…

The accountability testing programs of many states have begun to make extensive use of constructed-response questions and to report test results in terms of percentages of students at various proficiency or performance levels. This paper describes the step-by-step procedures for two standard-setting methods recently used for the New Hampshire…

Although the standard-setting method of W. H. Angoff (1971) has broad-based support in the research literature, inconsistencies in the resulting standards do occur. Sources of these inconsistencies are examined in a study of judges, competencies (items), rounds (replications), and the interactions among them. A modified Angoff approach was used to…

The American Association of School Administrators, the National Association of Elementary School Principals, the National Association of Secondary School Principals, and the National Council on Measurement in Education are cooperating on a project to develop competency standards for educational administrators in the area of student assessment. A…

This paper describes the processes that one school district, the Visalia Unified School District (California), went through in establishing a standards-based assessment and accountability system using multiple methods. First the district's standards-based assessment and accountability system and the methods used to establish it are described, and…

This notebook contains the revised standards and guidelines for the National Center for Education Statistics (NCES), as well as an updated and consolidated version of NCES legislation. It is intended for NCES staff and contractors as a guide in their data collection, analysis, and dissemination. These standards and guidelines define the limits of…

A standard-setting procedure was developed for the Georgia Teacher Certification Testing Program as tests in 30 teaching fields were revised. A list of important characteristics of a standard-setting procedure was derived, drawing on the work of R. A. Berk (1986). The best method was found to be a highly formalized judgmental, empirical Angoff…

The effects of feedback about the ratings of other judges on subsequent ratings using the Nedelsky method and the ability of judges to retain or eliminate options in a manner consistent with the judgments of minimally competent examinees were studied using data from a basic algebra examination administered to 227 college students in 1987. The…

Teacher competency tests are being used more frequently to assess the knowledge and skills of prospective teachers. Educational policymakers face the dilemma of setting passing standards for these tests which will satisfy the desire for meaningful quality standards for teachers while meeting the necessity for making available a reasonable number…