Neil Dorans has made a career of advocating for the examinee. He continues to do so in his NCME career award address, providing a thought-provoking commentary on some current trends in educational measurement that could potentially affect the integrity of test scores. Concerns expressed in the address call attention to a conundrum that faces…

In response to Ebel's article (TM 508 146) the author points out that, in emphasizing what a test is intended to measure, the vital question of what should be measured is set aside. While explicit specifications for a test should be encouraged, questions of worth ought to be prominent in designing and selecting tests. (Author/LC)

This essay argues that reliability should be reconceptualized in a way that reflects the importance of the theoretical expectations of the test specialist and the learning and problem solving of the test takers. It is time to characterize clearly the substantive theoretical framework supporting reliability studies and the technical evaluation of…

Although it is assumed that student cognition contributes to student performance on achievement tests, it may be that current testing models lack the degree of specification necessary to warrant such inferences. With test score interpretations as the referent, the authors in this special issue address the role of student cognition in learning and…

It is argued that consequential validity is a concept worth considering. The solution to defining "validity" is not to narrow the concept, but to allow for the differential prediction provided by tests in different circumstances. Consequences of the uses and interpretations of test scores are central to their evaluation. (SLD)

Six distinguishable aspects of construct validity are discussed as they apply to performance assessment, emphasizing content, substantive, structural, generalizability, external, and consequential aspects. Taken together, these aspects provide a way to address validity questions in score interpretation and use. (SLD)

The computer assisted testing (CAT) program at Florida State University's Assessment Resource Center is described. Three measurement issues (test quality, confidence in mastery decisions, and maintenance of test validity) and two instructional design issues (quality of instructional objectives and extended feedback following testing) important for…

A conceptual analysis of gain scores and a technically sound procedure for using such scores to compare different instructional programs are presented. The procedure proposed makes use of an index called Rescaled and Adjusted Gains within Strata (RAGS), together with a flexible but explicit procedure for score analysis and reporting. (LC)

In response to J. J. Cannell's (1988) discussion of the reported "above average" achievement of the vast majority of public school systems nationwide, the nature of national norms is discussed. The public must be better informed about the interpretation of test results. (SLD)

The developer of the Comprehensive Tests of Basic Skills scaling responds to Hoover's attacks on Thurstone and item response theory scales (TM 510 173). While agreeing that grade equivalent (GE) scores are presently the most appropriate developmental score for reporting elementary grade achievement tests, limitations and inconsistencies in the GE…

Grade equivalent (GE) scores for elementary school achievement tests are defended in response to efforts to ban their use. Equal interval developmental scoring methods for the Sequential Tests of Educational Progress and the Comprehensive Tests of Basic Skills are criticized. (BS)

Cohen and Hyman's response contains several misunderstandings of the original article by Mehrens and Kaminski. One frequently wishes to make inferences to a domain from a test, but teaching a specific performance and testing for that performance does not allow for a domain inference. (SLD)

Issues concerning the selection of judges for standard setting are discussed. Determining the consistency of judges' recommendations, or their congruity with other expert recommendations, would help in selection. Enough judges must be chosen to allow estimation of recommendations by an entire population of judges. (SLD)

The author addresses issues raised by Burket (TM 510 174) about the Iowa Test of Basic Skills scaling procedures. Further reasons for his criticism of Thurstone scale scores and item response theory scale scores for elementary school achievement tests are given. (BS)

The scales of the National Assessment of Educational Progress (NAEP), as constructed, do not yield meaningful criterion-referenced interpretations. Poorly defined NAEP goals and the present knowledge base do not allow the measurement of what examinees can and cannot do. Inappropriate interpretations of NAEP data are discussed, with specific…