Asserts that publishers of achievement tests are, for the most part, not in a position to obtain on their own any decent evidence about the consequences of uses made of their tests. Reasons why this is so are discussed, and what publishers can be expected to do is outlined. (SLD)

Describes the procedures by which Kentucky's state assessment program synthesized results from three standard setting procedures (Contrasting Groups, Bookmark, and Jaeger-Mills) for the 2000 state assessment. Shows the value of using multiple standard-setting approaches to gather information from each. (SLD)

It is argued that publishers of achievement tests, especially those who publish tests intended for use in many parts of the United States, are for the most part not in a position to obtain any decent evidence about the consequences of the uses that are made of their tests. What responsibilities and actions publishers can reasonably be expected to…

Explains achievement test scores, focusing on types, uses, meanings, and relative importance. Describes currently used scales, normal distribution curves, percentile ranks, grade equivalents, and other rating systems. Advises inclusion of more than one kind of standardized test score, since each provides different information. Includes three…

Different procedures for setting cut points on achievement test scales provide the standard-setting participants with different information to support the unique judgment task associated with each procedure. This study examined how participants in standard settings used the different information from three different procedures in Kentucky in 2000.…

Potential benefits of using item response theory in test construction are evaluated using the experience and evidence accumulated during nine years of using a three-parameter model in the development of major achievement batteries. Topics addressed include error of measurement, test equating, item bias, and item difficulty. (TJH)

Discussions of "test curriculum overlap" that focus on the term "mismatch" tend to be based on several untenable premises. This paper addresses the issue of the degree to which standardized tests should reflect the specific content of a given school curriculum with regard to three points: (1) The idea of matching the content of…

Uses of the variety of scores generated by standardized achievement tests are discussed. Desirable characteristics of scales, raw score scales, percent of correct items, percentile ranks, grade equivalents, normal curve equivalents, and scale scores are considered. The various meanings and purposes of each type of score are discussed. It is…

Differential functioning of males and females on achievement test items was studied in a sample of 110,000 students in kindergarten through grade 12. First, item parameters and ability estimates for these parameters were obtained from LOGIST computer program runs for the entire group. Predicted performance for each item for each group was…

Potential benefits of using item response theory in test construction are evaluated, based on the experience and evidence accumulated during 9 years of using a three-parameter model in the construction of major achievement batteries. Specific benefits covered include obtaining sample-free item calibrations and item-free person measurement,…

Biased tests systematically favor some groups over others as a result of factors not part of what the test is said to measure. Bias is basically a problem of differential validity. Validity can be discussed in terms of either the procedures for establishing it or test use. Both ways clarify bias in any test. For content and construct validity, the…

During the past few years the problem of bias in testing has become an increasingly important issue. In most research, bias refers to the fair use of tests and has thus been defined in terms of an outside criterion measure of the performance being predicted by the test. Recently however, there has been growing interest in assessing bias when such…

The passage dependence of an item refers to the degree to which it is necessary to read the associated passage in order to be able to answer that item correctly. This paper studies the value of obtaining data about passage dependence in the construction of reading comprehension achievement tests. Passage dependence indices were examined in several…

A description of two proposals for alleviating the racial and ethnic bias in tests of achievement used in schools is presented. One of them entails adding steps to the construction procedures used in building norm referenced achievement tests; the second entails using criterion-referenced achievement tests rather than standardized tests for…

This paper considers the question of bias in group administered academic achievement tests, bias which is inherent in the instruments themselves. A body of data on the test of performance of three disadvantaged minority groups--northern, urban black; southern, rural black; and, southwestern, Mexican-Americans--as tryout samples in contrast to…