In 2018, 26 states administered a college admissions test to all public school juniors. Nearly half of those states proposed to use those scores as their academic achievement indicators for federal accountability under the Every Student Succeeds Act (ESSA); many others are planning to use those scores for other accountability purposes.…

In his thoughtful focus article, Haertel (this issue) pushes testing experts to broaden the scope of their validation efforts and to invite scholars from other disciplines to join them. He credits existing validation frameworks for helping the measurement community to identify incomplete or nonexistent validity arguments. However, he notes his…

As Paul Newton so ably demonstrates, the concept of validity is both important and problematic. Over the last several decades, a consensus definition of validity has emerged; the current edition of "Standards for Educational and Psychological Testing" notes, "Validity refers to the degree to which evidence and theory support the interpretations of…

The 1999 "Standards for Educational and Psychological Testing" defines validity as the degree to which evidence and theory support the interpretations of test scores entailed by proposed uses of tests. Although quite explicit, there are ways in which this definition lacks precision, consistency, and clarity. The history of validity has taught us…

Paul E. Newton's "Clarifying the Consensus Definition of Validity" addresses the single most important, yet stubbornly protean, value in educational and psychological assessment. "Standards for Educational and Psychological Testing" (American Educational Research Association, American Psychological Association, & National Council on Measurement in…

Validation research for educational achievement tests is often limited to an examination of intended test score interpretations. This article calls for an expansion of validation research in three dimensions. First, validation must attend to actual test use and its consequences, not just score meaning. Second, validation must attend to unintended…

The reporting of scores on educational tests is at times misunderstood, misinterpreted, and potentially confusing to examinees and other stakeholders who may need to interpret test scores. In reporting test results to examinees, there is a need for clarity in the message communicated. As pressure rises for students to demonstrate performance at a…

Classical test theory is founded on the proposition that measurement error, a random latent variable, is a component of the observed score random variable. This article traces the history of the development of classical test theory, beginning in the early 20th century. (SLD)

Criticizes an article by Messick (1989) that emphasizes consequential validity (the potential and actual social consequences of test score interpretation and use) as a component of construct validity. Shows the profitability of separating the construct-indicator link from the indicator-score link, and the greater importance of the former.…

It is argued that consequential validity is a concept worth considering. The solution to defining "validity" is not to narrow the concept, but to allow for the differential prediction provided by tests in different circumstances. Consequences of the uses and interpretations of test scores are central to their evaluation. (SLD)

This theme issue focuses on the use and consequences of high stakes tests. The lead article, "High-Stakes Testing: Too Much? Too Soon?" by Sherry Freeland Walker, introduces the topic and related issues, outlining the pros and cons of high stakes testing by the states. The problem, some experts say, is that states have tried to do too much too…

Delaware students must meet world-class standards if they are to be competitive and successful in a global economy. To prepare our students for their future, schools must support rigorous standards and each of teachers must set high expectations. Students must also commit themselves to the achievement of excellence. Any system that hopes to…

This paper reports the results of a survey conducted in the spring of l981 that was designed to collect and summarize guidelines on appropriate test use from the various organizations, agencies, and associations involved in standardized educational testing. The primary objective of the study was to learn how these various groups define the issues…

This field memo is the third in a series of updates from the Deputy Commissioner of the Office of Elementary, Middle, Secondary and Continuing Education to all teachers and administrators of public and nonpublic schools on standards and assessments in New York. This document explains how the New York State Education Department determines if test…

Describes a method for making standardized test results more useful for teachers, administrators, school board members, and parents by providing information on the test content actually mastered by the student and on the student's individual development over time, as well as providing traditional numerical and norm-referenced scores. (PGD)