In this article we address the mounting criticism and rejection of standardized tests used in the selection of students for college or university education. Admission tests are being increasingly demonized in many parts of the world and many colleges and universities are dropping tests for selection purposes, claiming the tests are detrimental to…

A goal for any linking or equating of two or more tests is that the linking function be invariant to the population used in conducting the linking or equating. Violations of population invariance in linking and equating jeopardize the fairness and validity of test scores, and pose particular problems for test-based accountability programs that…

A particular trait of the educational system under socialist reign was accountability at the input side--appropriate facilities, centrally decided curriculum, approved text-books, and uniformly trained teachers--but no control on the output. It was simply assumed that it met the agreed standards, which was, in turn, proven by the statistics…

Annual student achievement data derived from state assessment programs have led to widespread enthusiasm for statistical models suitable for longitudinal analysis. The current policy environment's adherence to high stakes accountability vis-a-vis No Child Left Behind (NCLB)'s universal proficiency mandate has fostered an impoverished view of what…

Standards-based reform, as codified by the No Child Left Behind Act, relies on the ability of assessments to accurately reflect the learning that takes place in U.S. classrooms. However, this property of assessments--their instructional sensitivity--is rarely, if ever, investigated by test developers, states, or researchers. In this paper, the…

Explores the basis of negative sentiments toward high-stakes student testing and current critiques of the practice from within the education profession. Provides evidence for 10 unintended, unrecognized, or unarticulated positive consequences. Also examines the relationship between high-stakes testing and accountability systems. (Author/SLD)

Standards-based education has now reached a stage where it is possible to evaluate its overall effectiveness. Several earlier papers in the special issue of "Educational Measurement: Issues and Practice" on "Test Scores and State Accountability" (Volume 24, Number 4) examined specific state policies and their effects on schools…

With 3 years and counting since its inception, the scope and impact of "No Child Left Behind" is now being felt in classrooms across the nation. Although some successes have been identified, concerns about the implementation and expectations of the legislation are emerging. As a result of the legislation's emphasis on the development of…

When STARS reform efforts were launched in 2000, teacher training in assessment was seen as crucial to the success of the program. The STARS reform efforts focus on both supporting the implementation of quality classroom assessment practices and implementing a district-based accountability system. The training programs described in this article…

The "Standards for Educational and Psychological Testing" have evolved in the breadth and depth of coverage of issues in educational testing and measurement since their first publication in 1954. There were a number of substantive changes in the 1999 revision that addressed validity, fairness, accommodations, and compliance with the…

We found moderate correlations among four policy attributes (consistency, specificity, authority, and power), which suggest that in many states, at least in design, standards-based reform is working as advocates imagined--aligned content standards and assessments established, backed up by detailed guidelines and frameworks, incentivized by rewards…

Current nationwide efforts to improve education call for new information for policymakers in testing and evaluation. Recent state and national evaluation activities, including the Department of Education's project to establish statistical indicators for education, are discussed. Guidelines are given for developing reasonable and appropriate…

Provides a general framework for examining the consequences of assessment programs, especially statewide programs that intend to improve student learning by holding schools accountable. The framework is intended for use with programs using performance-based tasks but can be used with programs using traditional item formats as well. (SLD)

Outlines a framework for considering the validity of standards-based score interpretations and then considers the potential roles of different stakeholder groups and other participants in that process. Suggests study of a new standard-setting method, the "briefing book," which would describe alternative cut scores. (SLD)

Discusses some problems, pitfalls, and paradoxes that challenge measurement theory and practice, especially for K-12 achievement testing. Considers a number of technical issues, especially some related to reliability. Also discusses a number of practical or political issues related to validation and accountability. (SLD)