Daniel Koretz is the Henry Lee Shattuck Professor of Education at the Harvard Graduate School of Education. His research focuses on educational assessment and policy, particularly the effects of high-stakes testing on educational practice and the validity of score gains. He is the author of "Measuring Up: What Educational Testing Really Tells…

Ultimately, measures in research, testing, assessment and evaluation are used, or have implications, for ranking, intervention, feedback, decision-making or policy purposes. Explicit recognition of this fact brings the often-ignored and sometimes maligned concept of consequences to the fore. Given that measures have personal and social…

Haertel's argument is that one must "expand the scope of test validation to include indirect testing effects" because these effects are often the "rationale for the entire testing program." The author strongly agrees that this is essential. However, he maintains that Haertel's argument does not go far enough and that there are two additional…

Considering consequences in the evaluation of validity is not new although it is still debated by Paul E. Newton and others. The argument-based approach to validity entails an interpretative argument that explicitly identifies the proposed interpretations and uses of test scores and a validity argument that provides a structure for evaluating the…

The idea that America was being harmed because its schools were not keeping up with those in other advanced nations emerged after Sputnik in 1957, took a firm hold on education policy when "A Nation at Risk" appeared in 1983, and continues today. Policy makers justify this concern by pointing to evidence showing that, for individuals…

It is argued that publishers of achievement tests, especially those who publish tests intended for use in many parts of the United States, are for the most part not in a position to obtain any decent evidence about the consequences of the uses that are made of their tests. What responsibilities and actions publishers can reasonably be expected to…

Issues in designing valid tests for the National Assessment of Educational Progress (NAEP) are discussed. Test scores are often provided without any information on the nature of the tasks represented. Because test domains are defined by individual item writers, the generalizability between tests and items is suspect. While typical content…

The purpose of licensing and certification tests is to protect the public. This purpose determines test content, difficulty of the items, test format, use of test scores in decision making, and ways of setting standards. Currently being explored are methods to ensure continued competence, and legal considerations related to antidiscrimination…

Due to the recent Federal redefinition of "basic skills," large scale assessments of speaking and listening proficiencies will proliferate. In planning assessment procedures, educators must be sensitive not only to psychometric validity, but also to pedagogical validity: the effects of testing on curricular content and instructional strategies.…

Analyzes Hughes and Nelson's study of placement testing at Riverside Community College and offers an alternative method of evaluating placement systems using logistic regression. Reanalyzes data from an ASSET placement test validity study using logistic regression. (DMM)

The problem of finding a meaningful way of demonstrating the benefit or satisfaction to be gained by using predictive assessment techniques to select or place individuals in work situations is explored. The urgent need of developing nations for appropriate occupational and educational selection procedures is presented and explained. A discussion…

L. Cronbach has made the point that for validity arguments to be convincing to diverse audiences, they need to be based on assumptions that are credible to these audiences. The interpretations and uses of high stakes test scores rely on a number of policy assumptions about what should be taught in schools, and more specifically, about the content…

Claims that arguments about the invalidity, purposelessness, and misleading nature of ELLA (English Language and Literacy Assessment ) implemented in New South Wales, Australia, remain intact despite attempts to counter the arguments. Presents a detailed critique of arguments presented in an article in the previous of this journal supporting ELLA.…

Barbara Jordan served as the hearing officer for three-day adversary evaluation hearings about the pros and cons of minimum competency testing (MCT). This report is the complete transcript of the second day of proceedings. The pro team, lead by James Popham, began by presenting representatives of four states (Florida, California, Texas, and…

Administering a large scale licensing examination program presents both technical and non-technical challenges. Five major areas are discussed in this paper: (1) ensuring test validity in relation to occupational entry standards; (2) developing test items from valid examination specifications; (3) establishing legally defensible passing scores;…