Standard-setting practices in states using the National Teachers Examination (NTE) were examined. Passing score-setting procedures, recommended study scores, passing scores established by the states, and the implications of the passing scores were studied. States have typically adopted standards lower than cut scores recommended by advisory…

The implications of international assessments in setting world-class performance standards are explored. Possible uses of recent international assessments as benchmarks against which to compare the achievement of U.S. students are illustrated. Characteristics of international assessments that affect their usefulness as benchmarks are discussed.…

Explores the relationship between measurement theory and practice, considering five broad categories of: (1) models, assumptions, and terminology; (2) reliability; (3) validity; (4) scaling; and (5) setting performance standards. It must be recognized that measurement is not an end in itself. (SLD)

Issues related to the establishment of formal standards for student achievement on large-scale assessments are discussed, and two approaches to standard setting that have been used in Saskatchewan (Canada) are described. In spite of the general success of these programs, numerous issues to consider in future evaluations are raised. (SLD)

This article examines major threats to the validity of Adequate Yearly Progress (AYP) in the context of rural schools. Although rural students and their schools made significant academic progress in the past on national and state assessments, the current goal of AYP turns out to be highly unrealistic for them unless states set far lower…

As constructed-response items become an integral part of educational assessments, setting student performance standards on constructed-response items has become an important issue. Two standard-setting methods, one used for setting standards on the National Assessment of Educational Progress (NAEP) in reading in grade 8 and the other used to set…

This paper reports 20 unsolved problems in educational measurement and points toward what seem to be promising avenues of solution. The first group of concerns involves validity, posing the problems of obtaining suitable validity criteria, determining and measuring the predictor variables that best characterize the traits and proficiencies of…

A study was conducted to provide information for setting two separate standards, the accuracy score and the documentation score, for the Praxis III: Classroom Performance Assessment (Praxis III). Praxis III is intended for making instructional and licensing decisions about beginning teachers. This standard-setting study was a person-judgment…

The problem of setting standards has always been an issue in the educational community. This paper offers an outline of one state's procedure for setting a passing score for a competency-based test in mathematics. The Maryland Functional Mathematics Test (MFMT) becomes a graduation prerequisite for the graduating class of 1987. The procedures used…

Evidence of the validity of the National Teacher Examinations' (NTEs') Early Childhood Education Test (ECET) as it is used in the New York City School System is presented. The NTE Core Battery and Specialty Area Tests are used as part of the alternative process for teacher licensure in New York City. The ECET measures knowledge and skills required…

Standards, passing scores, or cut scores have been seen as an element of criterion-referenced tests since their introduction. This paper discusses at least two issues surrounding the establishment of cut scores which appear to need clarification: (1) the theoretical definition of a cut score; and (2) decisions which must be made in selecting a…

A scoring rubric transition study is described. It was designed to evaluate possible drift in scoring the Maryland Writing Test from year to year (when using a modified holistic scoring method), to evaluate strategies for revising swing rubrics from narrative and explanatory writing while maintaining original scoring standards, and to establish…

The validity of combining a correction for guessing with the Nedelsky-based cutscore was investigated. A five option multiple choice Mathematics Achievement Test was used in the study. Items were selected to meet several criteria. These included: the capability of measuring mathematics concepts related to performance in introductory statistics;…

This manual is written for the individual responsible for choosing the passing score on an educational or occupational test. It concentrates on practical advice to help select and apply a method for choosing the passing score. Decisions, standards, and judgments are defined and discussed in terms of considerations in choosing a passing score…

A latent trait method is presented to investigate the possibility that Angoff or Nedelsky judges specify inconsistent probabilities in standard setting techniques for objectives-based instructional programs. It is suggested that judges frequently specify a low probability of success for an easy item but a large probability for a hard item. The…