In Shepard's (1997) discussion on the importance of test use and consequences in a validity argument for educational assessments, she reflected on Cronbach and Meehl's (1955) perspective on the role of test developers in providing consequential evidence. In the following year, a special issue in "Educational Measurement: Issues and Practice"…

In validating uses of testing, it is helpful to distinguish those that rely directly on the information provided by scores or score distributions ("direct" uses and consequences) versus those that instead capitalize on the motivational effects of testing, or use testing and test reporting to shape public opinion ("indirect" uses and consequences).…

At the outset of his thoughtful and thought-provoking article, Haertel (this issue) clearly identifies the issue with which he will be dealing: The disjunct, or gap, in current approaches to evaluating the merits of a given test, between the intended uses of that test and the validity of its score-based interpretations. The author thinks that…

Kane's paper "Validating the Interpretations and Uses of Test Scores" is the most complete and clearest discussion yet available of the argument-based approach to validation. At its most basic level, validation as formulated by Kane is fundamentally a simply-stated two-step enterprise: (1) specify the claims inherent in a particular interpretation…

In 2012, Edward Haertel received the NCME Career Contributions Award. The focus article for this issue emerged from his address on the topic "How Is Testing Supposed to Improve Schooling?" His focus article provides a discussion of the relationships between testing and schooling in which he issues a call to action to the measurement community to…

The author is deeply gratified by the commentators' thoughtful responses and finds almost nothing to disagree with in any of them. Each offers additional insights prompting further reflection. In drawing out just a few common themes, this brief rejoinder omits many important ideas from the individual contributions. As stated in his title, the…

This response to the comments contains three main sections, each addressing a subset of the comments. In the first section, I will respond to the comments by Brennan, Haertel, and Moss. All of these comments suggest ways in which my presentation could be extended or improved; I generally agree with their suggestions, so my response to their…

As researchers at a testing organization concerned with the appropriate uses and validity evidence for our assessments, we provide an applied perspective related to the issues raised in the focus article. Newton's proposal for elaborating the consensus definition of validity is offered with the intention to reduce the risks of inadequate…

In "How Is Testing Supposed to Improve Schooling?" Edward Haertel has proposed a framework for thinking about the mechanisms by which testing might improve the various educational processes undertaken in schools. The framework seems to the author to be quite general (he uses the word "general" here in its mathematical sense of including all cases)…

Considering consequences in the evaluation of validity is not new although it is still debated by Paul E. Newton and others. The argument-based approach to validity entails an interpretative argument that explicitly identifies the proposed interpretations and uses of test scores and a validity argument that provides a structure for evaluating the…

When schools are compared, there are variables that need to be considered because the playing field is not level. This paper discusses concepts and generalizations that must be understood to interpret test results and school report cards properly. There are many limitations in using test results to compare schools, particularly since students may…

Discusses the effects of a grammar test on student admission to the department of communication at the University of Central Florida. (HOD)

Describes the plan used in Consolidated High School District 230, in Palos Hills (Illinois), for fostering an informed and interested school community by providing standardized test results to the school board, central and building administrators, parents, teachers, counselors, elementary educators, and the local press. (PGD)

Three kinds of classificatory decisions that might be made using criterion-referenced tests (CRTs) are described, and methods to appraise the validity of each are subsequently discussed. Decisions that entail predictive, descriptive, and evaluative classifications comprised the three kinds of decisions described. Predictive classifications entail…

Achieving a fair and objective evaluation of teacher performance is not easy. Student test results have been used to assess teacher performance, but this approach has many weaknesses, especially because students differ from school to school and standardized tests are open to questions about their fairness. Criterion-referenced tests have been…