A critical component of the standard setting process is collecting evidence to evaluate the recommended cut scores and their use for making decisions and classifying students based on test performance. Kane (1994, 2001) proposed a framework by which practitioners can identify and evaluate evidence of the results of the standard setting from (1)…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

Many approaches to standard-setting use item calibration and student score estimation results to structure panelists' tasks. However, this requires collecting standard-setting judgments after the item analysis results are available. The Scoring Guide Alignment approach collects standard-setting judgments during the scoring sessions from teachers…

Presents a procedure for standard setting that involves the cluster analysis of test takers to discover examinee groups that are useful for envisioning marginally competent performance or defining borderline or contrasting groups. Illustrates use of the procedure with a statewide mathematics test, and concludes that cluster analysis is useful in…

Kansas law requires setting passing scores for the reading and mathematics competency test for 2nd, 4th, 6th, 8th, and 11th grade students, administered annually since April of 1980. New objective-referenced tests are prepared each year. Both judgmental (Angoff, Ebel, and Nedelsky) methods and empirical (contrasting groups and borderline) methods…

Before using the National Teacher Examinations (NTE) for teacher certification, states are required to conduct a state-wide validity study. This paper describes approaches used in 35 studies for 18 states to establish (NTE) content validity through curriculum and job relatedness and to establish minimum performance standards. (BS)

This paper describes the meeting of the Reading and Writing Advisory Committee of the New Jersey Basic Skills Council with selected high school English teachers and administrators. This panel established cut scores for statewide interpretation of the New Jersey College Basic Skills Placement Test (NJCBSPT). The NJCBSPT is administered to all…

The Wisconsin Student Assessment System (WSAS) "Knowledge & Concepts" examinations were designed, under legislative mandate, to measure student knowledge in the areas of reading, language arts (including writing), mathematics, science, and social studies. This summary report provides information about the standard setting activities…

The process of development of tests for teacher certification in Tennessee is described. In response to the Tennessee Comprehensive Education Reform Act of 1984 requiring the use of tests for individuals seeking initial teacher licensure, the Department of Education identified 12 areas of teacher endorsement for which no currently validated and…

The assessment instruments of the Maine Educational Assessment emphasize extended constructed-response questions. The results from these assessments are reported in terms of percentages of students at four performance levels. The Student-Based Constructed-Response Method was used to establish performance standards for these levels on the…

The licensure of public school personnel in Tennessee is a function of the State Department of Education (SDE). Additional requirements for this certification function were added by the Comprehensive Education Reform Act (Senate Bill Number 1) of the 1984 Tennessee General Assembly. The Act mandated that the SDE use tests to assess the competence…

The status of minimum competency testing programs, as of June 30, 1979, is given through descriptions of 31 state programs and 20 local district programs. For each program, the following information is provided: legislative and policy history; implementation phase; goals; competencies to be tested; standards and standard setting; target groups and…