Considering consequences in the evaluation of validity is not new although it is still debated by Paul E. Newton and others. The argument-based approach to validity entails an interpretative argument that explicitly identifies the proposed interpretations and uses of test scores and a validity argument that provides a structure for evaluating the…

Multiple uses of the same assessment may present challenges for both the design and use of an assessment. Little advice, however, has been given to assessment developers as to how to understand the phenomena of multiple assessment use and meet the challenges these present. Particularly problematic is the case in which an assessment is used for…

Presents conclusions of an independent measurement expert that the Texas Assessment of Academic Skills (TAAS) was constructed according to acceptable professional standards and tests curricular material considered by the Texas Board of Education important for graduates to have mastered. Also supports the validity and reliability of the TAAS and…

Discusses issues of validity in high-stakes testing, beginning with some purposes of a testing program and proceeding to some underlying assumptions about testing. Suggests four possible studies to address assumptions often ignored by asking various groups of people about testing. (SLD)

Almost every state has in place a state assessment and accountability system. These systems vary greatly in their characteristics but share a common global purpose of improving teaching and learning. Some of the variations in the state systems are discussed and illustrated with examples from selected states. Issues that are critical to the value…

Discusses the plaintiffs' arguments, the state's responses, and the specific findings in the context of major themes of "GI Forum v. Texas Education Agency," which found that the Texas graduation test was valid and reliable and met applicable professional standards, including motive and opportunity to learn. (SLD)

Draws seven conclusions for professionals who administer state assessment programs from the "GI Forum V. Texas Education Agency" ruling. These conclusions are grouped into observations about test development and observations about test use. Discusses some implications for test use in other states. (SLD)

Discusses the implications of the "GI Forum v. Texas Education Agency" (2000) decision supporting the use of the Texas Assessment of Academic Skills for other state assessment programs. Notes that the legal success of the state test in Texas was not due merely to good fortune, but to the test's adherence to legally defensible principles.…

When the drive to develop and administer tests comes from a public call for accountability in a profession, from the government's response to this call, or from politicians attempting to identify a hot issue, it may be said that the test must first have political validity in order to be implemented. Only after this political validity has been…

L. Cronbach has made the point that for validity arguments to be convincing to diverse audiences, they need to be based on assumptions that are credible to these audiences. The interpretations and uses of high stakes test scores rely on a number of policy assumptions about what should be taught in schools, and more specifically, about the content…

The purpose of this document is to provide practical guidance and support for the design, development, and implementation of large-scale assessment systems that are grounded in research and best practice. Information is included about existing large-scale testing efforts, including national testing programs, state testing programs, and…

This report responds to a request for information about the quality of the tests the City University of New York (CUNY) uses to decide who must take remedial courses and a profile of CUNY freshmen. Roughly 65% of CUNY bachelor's degree students and nearly 90% of associate degree students are required to take remedial courses in reading, writing,…

This policy brief addresses the inclusion of English language learners (ELLs) in large-scale assessments and ELL assessment accommodations. The inclusion of ELL students creates specific accountability policy challenges. States differ in the students they include and their inclusion policies and accommodation practices, and, at present, inclusion…

This field memo is the third in a series of updates from the Deputy Commissioner of the Office of Elementary, Middle, Secondary and Continuing Education to all teachers and administrators of public and nonpublic schools on standards and assessments in New York. This document explains how the New York State Education Department determines if test…

A recently developed model of validation (T. J. Crooks, M. T. Kane, and A. S. Cohen, 1996) is briefly outlined. It conceptualizes assessment as divided into a chain of eight linked stages: (1) administration; (2) scoring; (3) aggregation; (4) generalization; (5) extrapolation; (6) evaluation; (7) decision; and (8) impact. The model is then used to…