In many school districts, the pressure to raise test scores has created overnight celebrity status for formative assessment. Its powers to raise student achievement have been touted, however, without attending to the research on which these claims were based. Sociocultural learning theory provides theoretical grounding for understanding how…

Schulz (2006) provides a different perspective on standard setting than that provided in Reckase (2006). He also suggests a modification to the bookmark procedure and some alternative models for errors in panelists' judgments than those provided by Reckase. This article provides a response to some of the points made by Schulz and reports some…

Whether the measurement profession should consider developing and adopting a code of professional conduct is explored after a brief review of existing references to standards of conduct and a review of other professional codes. Issues include the need for a code of ethics, its usefulness, and its enforcement. (SLD)

This essay argues that reliability should be reconceptualized in a way that reflects the importance of the theoretical expectations of the test specialist and the learning and problem solving of the test takers. It is time to characterize clearly the substantive theoretical framework supporting reliability studies and the technical evaluation of…

It is argued that consequences are a logical part of the evaluation of test use, which has been an accepted part of test validity for several decades. The examination of effects following from test use is essential in evaluating test validity and not merely the domain of policymakers and politicians. (SLD)

It is argued that consequential validity is a concept worth considering. The solution to defining "validity" is not to narrow the concept, but to allow for the differential prediction provided by tests in different circumstances. Consequences of the uses and interpretations of test scores are central to their evaluation. (SLD)

Test developers have an obligation to create the most appropriate assessment instruments possible as L. J. Kilian argues, but whether they do or not, educators still are responsible for providing test preparation that is professionally ethical and educationally defensible. (SLD)

This paper seeks to identify ways of making measurement more relevant to classroom teachers, and making classroom realities more apparent to measurement specialists. Measurement elements of teacher education textbooks and courses, nontraditional assessment topics, informal classroom measurement techniques, terminological issues, and three types of…

Issues concerning the selection of judges for standard setting are discussed. Determining the consistency of judges' recommendations, or their congruity with other expert recommendations, would help in selection. Enough judges must be chosen to allow estimation of recommendations by an entire population of judges. (SLD)

In 1987, a survey report by J. Cannell was published criticizing state reports based on national standardized testing of elementary school students that indicated that all 50 states were above the national average. This phenomenon--known as the "Lake Wobegon Effect"--is analyzed. Technical problems with the study are considered. (TJH)

The documented decline in test scores of the 1960s and 1970s and the unclear picture since then result from educational and noneducational factors. Aspects of the misuse of test scores are (1) simplistic interpretation of performance trends; (2) unsupported evaluations of schooling; and (3) a reductionist view of education. (SLD)