Recently, Northwest Evaluation Association (NWEA) completed a study to connect the scale of the Minnesota Comprehensive Assessments (MCA) Testing Program used for Minnesota's mathematics and reading assessments with NWEA's RIT (Rasch Unit) scale. Information from the state assessments was used in a study to establish performance-level scores on…

Presents a procedure for standard setting that involves the cluster analysis of test takers to discover examinee groups that are useful for envisioning marginally competent performance or defining borderline or contrasting groups. Illustrates use of the procedure with a statewide mathematics test, and concludes that cluster analysis is useful in…

A new approach for examining the quality of judgments from standard-setting judges using a Binomial Trials Model (BTM) is presented and illustrated with 26 judges from the Georgia High School Graduation Test. Results suggest that the BTM provides information not available from other methods. (SLD)

In the context of controversy over the use of high stakes testing, the Pennsylvania State Education Association (PSEA) asked for an evaluation of the performance levels and cut score of the Pennsylvania System of School Assessment (PSSA) mathematics and reading tests. While awaiting technical documentation from the Pennsylvania Department of…

These five papers describe the methods, results, and implications of a multimethod approach to the establishment of standards for the three subject areas of the Alabama High School Graduation Examination (AHSGE). James E. McLean introduces the problems and methods involved by identifying three general approaches to scoring procedures found in the…

The Cherry Creek School district (Englewood, Colorado) is a growing district of 37,000 students in the Denver area. The 1988 Colorado State School Finance Act required district-set proficiencies (standards), and forced agreement on a set of values for student knowledge and skills. State-adopted standards added additional requirements for the…

Kansas law requires setting passing scores for the reading and mathematics competency test for 2nd, 4th, 6th, 8th, and 11th grade students, administered annually since April of 1980. New objective-referenced tests are prepared each year. Both judgmental (Angoff, Ebel, and Nedelsky) methods and empirical (contrasting groups and borderline) methods…

Before using the National Teacher Examinations (NTE) for teacher certification, states are required to conduct a state-wide validity study. This paper describes approaches used in 35 studies for 18 states to establish (NTE) content validity through curriculum and job relatedness and to establish minimum performance standards. (BS)

A socially moderated link was established between statewide achievement results and the National Assessment of Educational Progress (NAEP) by using the same achievement level descriptions in an Iowa Test of Basic Skills standard-setting and an NAEP standard setting study. A statistically moderated link was established through an equipercentile…

Standard-setting practices in states using the National Teachers Examination (NTE) were examined. Passing score-setting procedures, recommended study scores, passing scores established by the states, and the implications of the passing scores were studied. States have typically adopted standards lower than cut scores recommended by advisory…

Focusing on the experiences of five southern states using teacher testing policies, this survey provides evidence of shared experiences and lessons learned despite the existence of five different sets of certification requirements. The first section of the report concentrates on the national context for the movement toward teacher testing.…

The primary objective of this research was to examine the effect of scoring items known to be multidimensional using a unidimensional model. Although several simulation studies have examined this, few studies have been conducted using data obtained from actual test administrations. In this study, open-ended mathematics items from a mandated state…

Considerable evidence suggests that policy-makers, educators, the media, and the public do not understand national and state test results. The problems appear to be two-fold: the scales on which scores are reported seem confusing, and the report forms themselves are often too complex for the intended audiences. This paper addresses two topics. The…

The accountability testing programs of many states have begun to make extensive use of constructed-response questions and to report test results in terms of percentages of students at various proficiency or performance levels. This paper describes the step-by-step procedures for two standard-setting methods recently used for the New Hampshire…

A standard-setting procedure was developed for the Georgia Teacher Certification Testing Program as tests in 30 teaching fields were revised. A list of important characteristics of a standard-setting procedure was derived, drawing on the work of R. A. Berk (1986). The best method was found to be a highly formalized judgmental, empirical Angoff…