In his focus article, Koretz (this issue) argues that accountability has become the primary function of large-scale testing in the United States. He then points out that tests being used for accountability purposes are flawed and that the high-stakes nature of these tests creates a context that encourages score inflation. Koretz is concerned about…

The use of large-scale assessments for making high stakes inferences about students and the schools in which they are situated is premised on the assumption that tests are sensitive to good instruction. An increase in the quality of classroom instruction should cause, on the average, an increase in test scores. In work with a number of colleagues…

At the core of the argument-based approach to test validation as it has been presented by Kane (1992, 2004, 2006) is a relatively simple premise: test validity is demonstrated by linking the score that is observed from a test instrument to the use of that score for some subsequent inference. Details, however, are not so simple: How does one craft…

In this paper, the authors complete the summative stage of the validity argument approach, then use their experiences to reflect on the validity argument as a method. They begin by evaluating the inferences and assumptions of the interpretive argument for the MKT measures. Then they examine both the form and the structure of the interpretive…

Validation efforts typically focus around what, exactly, is measured by an instrument(s), and whether what is measured corresponds to the theoretical domain(s) originally specified. The authors' goal for this article is to build instruments focused around measuring the mathematical knowledge used in teaching: not only the content that teachers…

The last century was marked by dazzling changes in many areas, such as technology and communications. Predictions into the second century of testing are seemingly difficult in such a context. Yet, looking back to the turn of the last century, Kirkpatrick (1900), in his American Psychological Association presidential address, presented fundamental…

This paper provides a summary of the authors' attempts to uncover links between their measures, classroom mathematics instruction, and student learning. This paper also provides evidence regarding one central critique of their measures: that multiple-choice assessments cannot validly represent the knowledge, skills, and judgment involved in actual…