Despite the ease of accessing a wide range of measures, little attention is given to validity arguments when considering whether to use the measure for a new purpose or in a different context. Making a validity argument has historically focused on the intended interpretation and use. There has been a press to consider both the intended and actual…

Alternate assessments based on alternate achievement standards (AA-AAS) have historically lacked broad validity evidence and an overall evaluation of the extent to which evidence supports intended uses of results. An expanding body of validation literature, the funding of two AA-AAS consortia, and advances in computer-based assessment have…

State summative educational assessment is about to begin in earnest. Rightfully, many are raising questions about the quality, meaning, and appropriate use of the assessment results. This document was written to support state educational agencies (SEAs) and their assessment providers in devising effective and efficient analysis plans. This…

The authors describe challenges of following professional standards for educational achievement testing due to the complexity of gathering appropriate evidence to support demanding test interpretation and use. Validity evidence has been found to be low for some individual testing standards, leading to the possibility of faulty or impoverished test…

Despite the call for an argument-based approach to validity over 25 years ago, few examples exist in the published literature. One possible explanation for this outcome is that the complexity of the argument-based approach makes implementation difficult. To counter this claim, we propose that the Assessment Triangle can serve as the overarching…

The redesigned "TOEIC Bridge"® tests were designed to evaluate test takers' English listening, reading, speaking, and writing skills in the context of everyday adult life. In this paper, we summarize the initial validity argument that supports the use of test scores for the purpose of selection, placement, and evaluation of a test…

In the service of educational accountability, student achievement tests are being used to measure constructs quite unlike those envisioned by test developers. Scores are compared to cut points to create classifications like "proficient"; scores are combined over time to measure growth; student scores are aggregated to measure the…

This article briefly reviews the history of intellectual assessment of children and youth in the United States of America, as well as current practices and future directions. Although administration of intelligence tests in the schools has been a longstanding practice in the United States, their use has also elicited sharp controversy over time.…

This paper illustrates that the psychometric properties of scores and scales that are used with mixed-format educational tests can impact the use and interpretation of the scores that are reported to examinees. Psychometric properties that include reliability and conditional standard errors of measurement are considered in this paper. The focus is…

Just like all the high-stakes tests that determine students' futures nowadays, The Chorizo Test is a standardized test rooted in the culture of the test makers. It was originally created to be used with students in teacher training programs to sensitize them to the pitfalls inherent in standardized pencil-and-paper tests, such as linguistic bias…

Lissitz and Samuelsen (2007) have proposed an operational definition of "validity" that shifts many of the questions traditionally considered under validity to a separate category associated with the utility of test use. Operational definitions support inferences about how well people perform some kind of task or how they respond to some kind of…

Discusses the heavy demand on teachers and students for making sense of writing test scores. Illustrates the interpretive demands of going beyond writing test scores to make sense of the scores. Suggests that these demands point to the need for professional development in this area. (RS)

This fastback provides information about what tests can and cannot do, how they are constructed, and how they are used and misused. It offers suggestions about how best to interpret test results. The chapters are: (1) "A Test on Testing"; (2) "Basic Considerations"; (3) "Standardized Tests"; (4) "Performance Tests"; (5) "Interpreting Test Scores";…

The importance of educational accountability and assessment literacy is recognized as a long-term challenge to the educational system. The complexities in becoming an assessment literate and provide an opportunity to the educators to display their effective learning is discussed.

Classroom measurement devices, when tailored to fit a teacher's particular instructional objectives, are essential for optimal teaching and learning. Teachers use test data to assess students' progress but often fail to analyze tests for validity. This article shows how locally and correctly developed assessment tools may serve a variety of…