The unfulfilled promise of criterion-referenced measurement is that it would permit valid inferences about what a student could and could not do. To come closest to achieving all that criterion-referenced testing originally promised, tests of higher item density, with more items per amount of domain, are required. (SLD)

Issues in the measurement of subject matter proficiency, as defined by recognized subject matter scholars, are explored as they relate to the increasing use of teaching machines, programmed learning, and broadly conceived instructional systems. Criterion-referenced measurement is discussed. (SLD)

Beginning discussions and exploratory work on criterion-referenced measurement are reviewed in this commentary on the author's 1963 address to the American Educational Research Association on issues of measurement and the development of educational technology. Many problems foreseen at that time remain current. (SLD)

The term "criterion-referenced measurement" has been so frequently used that accumulated surplus meaning has sometimes swamped the fundamental concept. Stripping away extraneous interpretations affirms the contemporary relevance of the concept. Substituting the term "construct-referenced" underscores the need for better…

The instructional impact of criterion-referenced testing during the past three decades is reviewed, and a method of devising criterion-referenced tests is suggested that departs from the usual model. Adding verification along the lines of panel review that newly constructed test items do elicit appropriate information is suggested. (SLD)

The rise of criterion-referenced measurement from 1970 to 1984 was an important period in test development. Since 1984 there has been less research published on criterion-referenced measurement, but there is ample evidence that the concept remains important, especially in the authentic measurement and performance assessment movements. (SLD)

Confusion in the terminology used in criterion-referenced measurement specifications and development and standard setting and the attendant role of cut-off scores are shown to need practical clarification through psychometric research on test applications and consequences. (CM)

Test specifications need to take a middle road so that they are not so general that instructional targeting is impossible and not so specific that only unitary assessment targets are fostered. Using illustrative sample items provides a good means of communicating the items eligible to be tested. (SLD)

Cohen and Hyman's response contains several misunderstandings of the original article by Mehrens and Kaminski. One frequently wishes to make inferences to a domain from a test, but teaching a specific performance and testing for that performance does not allow for a domain inference. (SLD)

Some unfinished issues relating to achievement test theory that seemed implicit in the basic idea of criterion-referenced testing are reviewed, recognizing their importance in current studies of authentic assessment and performance-based tests. The future of performance-based evaluation is explored. (SLD)

Current successes and failures in U.S. educational measurement are reviewed, focusing on criterion-referenced testing. Pluses and minuses are listed for the following: (1) the move toward authentic assessment; (2) the dominance of criterion-referenced assessment; and (3) item response theory applications. Each area is a double-edged sword. (SLD)

The scales of the National Assessment of Educational Progress (NAEP), as constructed, do not yield meaningful criterion-referenced interpretations. Poorly defined NAEP goals and the present knowledge base do not allow the measurement of what examinees can and cannot do. Inappropriate interpretations of NAEP data are discussed, with specific…

The process of assigning grades to students is analyzed, and a specific approach to grading is recommended that distinguishes between minimal and developmental objectives. Criterion-referenced and norm-referenced concepts are used in the approach, which is best suited for secondary school or college. (SLD)