This paper follows a line of logical argumentation to claim that what Samuel Messick conceptualized about construct validation has probably been misunderstood by some educational policy makers, practicing educators, and classroom teachers. It argues that, while Messick's unified theory of test validation aimed at (a) warning educational…

Rajaratnam, Cronbach and Gleser's generalizability formula for stratified-parallel tests and Raju's coefficient beta are generalized to estimate the reliability of a composite of criterion-referenced tests, where the parts have different cutting scores. (Author/GK)

Intended to help educators select diagnostic and criterion referenced reading tests for their specific purposes, this book contains reviews of nine individual and three group tests. The reviewed tests were selected for their "importance" from a list of 34 and were reviewed by experts according to their descriptions of content, test development,…

Language assessment is reviewed as a technology which could become more effective for classroom use through school-based development and greater use of alternatives to standardized testing. (Author)

Educators can develop fair and accurate standards-based grading/reporting by switching to criterion-referenced grading practices; using differentiated criteria (denoting product, process, and progress); clarifying the purpose of each reporting tool; and developing a reporting form that identifies standards, facilitates interpretation, and…

Notes problems in using reading tests intended for children when testing adults; attempts to clarify some of these problems by making explicit the assumptions implicit in the practice of using children's reading tests with adults. (GT)

A series of studies on conceptual and design problems in competency-based measurements are explained. The concept of validity within the context of criterion-referenced measurement is reviewed. The authors believe validation should be viewed as a process rather than an end product. It is the process of marshalling evidence to support…

General guidelines exist for reporting and interpreting test scores, but there are short comings in the available technology, especially when applied to criterion-referenced tests. Concerns that have been expressed in the educational measurement literature address the uses of test scores, the manner of reporting scores, limited testing knowledge…

Confusion in the terminology used in criterion-referenced measurement specifications and development and standard setting and the attendant role of cut-off scores are shown to need practical clarification through psychometric research on test applications and consequences. (CM)

Standards-based reform is about setting standards and measuring attainment in criterion-referenced ways. Assessments should measure and monitor students' current achievement and progress over time. As Massachusetts testing deficiencies illustrate, assessments must stress longitudinal over cross-sectional designs, valued performances, developmental…

Test specifications need to take a middle road so that they are not so general that instructional targeting is impossible and not so specific that only unitary assessment targets are fostered. Using illustrative sample items provides a good means of communicating the items eligible to be tested. (SLD)

Research evidence relating to the utility of the RMC evaluation models of compensatory education employing non-normed tests is examined. The history and evolution of five early models into the current norm-referenced model utilizing a non-normed test (Model A2), non-normed versions of a comparison model (Model B2), and the regression model (Model…

Some unfinished issues relating to achievement test theory that seemed implicit in the basic idea of criterion-referenced testing are reviewed, recognizing their importance in current studies of authentic assessment and performance-based tests. The future of performance-based evaluation is explored. (SLD)

From 1974 through 1978, three methods of assessing Scottish high school students' (O level) English achievement were studied: (1) Ordinary (O level) examinations; (2) assessment of writing skills (folio assessment); and (3) criterion referenced tests developed by the Scottish Council for Research in Education (SCRE) to measure the objectives of…

The validity of criterion-referenced interpretations of the proficiency scales of the National Assessment of Educational Progress (NAEP) is discussed. A major goal of the NAEP scales is to describe student achievement in specific content areas from grade 3 (age 9 years) through grade 11 (age 17 years). The numerical values for NAEP scales are…