This study explores the use of the modified caution index (MCI) for identifying judges whose patterns of recommendations suggest that their judgments might be based on incomplete information, flawed reasoning, or inattention to their standard-setting tasks. It also examines the effect on test standards and passing rates when the test standards of…

This is a reprint of a 1986 letter by the former president of the National Council on Measurement in Education (NCME) to New York and California legislators. The author outlines why NCME is opposed to legislative initiatives to extend Golden Rule procedures to tests in those states. (JAZ)

Five indices are discussed that should logically discriminate between situations in which: (1) the linear equating method (LEM) adequately adjusts for difference between score distributions of two approximately parallel test forms; or (2) a method more complex than the linear equating method is needed. (RL)

One of several papers commissioned by the National Institute of Education (NIE), this discussion addresses the utility of test-equating studies for large-scale program evaluation and investigates the use of standardized tests in similar evaluation efforts. The discussion begins with an examination of the question, Should standardized achievement…

Emphasis on school performance and lack of emphasis on societal harm suffered by U.S. children are misguided. Bush administration decries 9 year olds' eighth-place finish among 15 nations in the mean science score while disregarding the U.S.'s nineteenth-place world ranking in infant mortality. America 2000 is a quest for image; educational…

Five statistical indices are developed and described which may be used for determining (1) when linear equating of two approximately parallel tests is adequate, and (2) whan a more complex method such as equipercentile equating must be used. The indices were based on: (1) similarity of cumulative score distributions; (2) shape of the raw-score to…

Issues concerning the selection of judges for standard setting are discussed. Determining the consistency of judges' recommendations, or their congruity with other expert recommendations, would help in selection. Enough judges must be chosen to allow estimation of recommendations by an entire population of judges. (SLD)

Using research findings and statistics to support a policy argument often leads to misinterpretations and exaggerations of public school performance. Two experts illustrate this point by discussing examples of distorted high school drop-out rates, student performance on standardized tests, and international comparisons of U.S. and Japanese…

A liberal interpretation of Section 151 of Public Law 93-380, to implement effective local evaluation of Title I programs, is supported. Weaknesses are cited: (1) nationwide impact data, (2) unsound aggregation of Title I achievement gains, and (3) lack of consideration of alternative evaluation methods. (MH)