Almost every state has in place a state assessment and accountability system. These systems vary greatly in their characteristics but share a common global purpose of improving teaching and learning. Some of the variations in the state systems are discussed and illustrated with examples from selected states. Issues that are critical to the value…

It is argued that consequential validity is a concept worth considering. The solution to defining "validity" is not to narrow the concept, but to allow for the differential prediction provided by tests in different circumstances. Consequences of the uses and interpretations of test scores are central to their evaluation. (SLD)

This document presents standards for educational accountability systems that represent models of practice derived from three perspectives: research knowledge, practical experience, and ethical considerations. These standards should be conceived of as targets for state and local systems and as criteria to judge proposed models of accountability…

During the past 6 years, under a contract from the National Center for Education Statistics, a Technical Review Panel has overseen and conducted a series of research studies addressing a range of validity questions relevant to the various uses and interpretations of the National Assessment of Educational Progress (NAEP). Study topics included: (1)…

The focus is on partitioning the evaluation of the consequences of assessment programs among the sponsors, developers, users, and reviewers of tests. Five parties that share responsibility are discussed: (1) the state legislature, (2) the state board of education, (3) the school district, (4) the test publisher, and (5) the measurement profession.…

The most fundamental technical quality issue raised by proposals for a national examination system is that of validity. Types of evidence needed to judge the validity of test use and the interpretation of results are discussed, and examination content, fairness, impact, generalizability, and comparability are explored. (SLD)

Current national efforts to expand the role of educational assessment and radically change the nature of assessment are discussed. Rationales for expectations that a new national examination system would serve as a lever of educational reform are analyzed. Challenges posed for educational measurement by the proposed heavy reliance on complex,…

Increasing emphasis on assessment and concern about assessment techniques have stirred interest in alternative assessment forms, for which evidence is needed about consequences, transfer of performance on specific assessment tests, and assessment fairness. Criteria concerning consequences, fairness, transfer-generalizability, cognitive complexity,…

The three RMC models endorsed by the U.S. Office of Education for the evaluation of Elementary and Secondary Education Act Title I programs are based on narrowly conceived approaches to evaluation--the measurement of cognitive achievement gains. Each model requires the comparison of observed student performance with an estimate of what level of…