Daniel Koretz is the Henry Lee Shattuck Professor of Education at the Harvard Graduate School of Education. His research focuses on educational assessment and policy, particularly the effects of high-stakes testing on educational practice and the validity of score gains. He is the author of "Measuring Up: What Educational Testing Really Tells…

Ultimately, measures in research, testing, assessment and evaluation are used, or have implications, for ranking, intervention, feedback, decision-making or policy purposes. Explicit recognition of this fact brings the often-ignored and sometimes maligned concept of consequences to the fore. Given that measures have personal and social…

Haertel's argument is that one must "expand the scope of test validation to include indirect testing effects" because these effects are often the "rationale for the entire testing program." The author strongly agrees that this is essential. However, he maintains that Haertel's argument does not go far enough and that there are two additional…

Considering consequences in the evaluation of validity is not new although it is still debated by Paul E. Newton and others. The argument-based approach to validity entails an interpretative argument that explicitly identifies the proposed interpretations and uses of test scores and a validity argument that provides a structure for evaluating the…

The idea that America was being harmed because its schools were not keeping up with those in other advanced nations emerged after Sputnik in 1957, took a firm hold on education policy when "A Nation at Risk" appeared in 1983, and continues today. Policy makers justify this concern by pointing to evidence showing that, for individuals…

It is argued that publishers of achievement tests, especially those who publish tests intended for use in many parts of the United States, are for the most part not in a position to obtain any decent evidence about the consequences of the uses that are made of their tests. What responsibilities and actions publishers can reasonably be expected to…

The purpose of licensing and certification tests is to protect the public. This purpose determines test content, difficulty of the items, test format, use of test scores in decision making, and ways of setting standards. Currently being explored are methods to ensure continued competence, and legal considerations related to antidiscrimination…

Due to the recent Federal redefinition of "basic skills," large scale assessments of speaking and listening proficiencies will proliferate. In planning assessment procedures, educators must be sensitive not only to psychometric validity, but also to pedagogical validity: the effects of testing on curricular content and instructional strategies.…

Analyzes Hughes and Nelson's study of placement testing at Riverside Community College and offers an alternative method of evaluating placement systems using logistic regression. Reanalyzes data from an ASSET placement test validity study using logistic regression. (DMM)

Claims that arguments about the invalidity, purposelessness, and misleading nature of ELLA (English Language and Literacy Assessment ) implemented in New South Wales, Australia, remain intact despite attempts to counter the arguments. Presents a detailed critique of arguments presented in an article in the previous of this journal supporting ELLA.…

Barbara Jordan served as the hearing officer for three-day adversary evaluation hearings about the pros and cons of minimum competency testing (MCT). This report is the complete transcript of the second day of proceedings. The pro team, lead by James Popham, began by presenting representatives of four states (Florida, California, Texas, and…

Administering a large scale licensing examination program presents both technical and non-technical challenges. Five major areas are discussed in this paper: (1) ensuring test validity in relation to occupational entry standards; (2) developing test items from valid examination specifications; (3) establishing legally defensible passing scores;…

In England and Wales, a National Curriculum initiated in 1988 was designed to ensure that all schools provided a curriculum which represented different areas of knowledge. The past 20 years has increasingly seen more emphasis on the link between the financial amounts spent on education and subsequent return on this money. The impact of the…

The usefulness of traditional concepts of validity and reliability, developed for large-scale assessments, for the classroom context is explored. Alternate frameworks that situate these constructs in teachers' work in classrooms are presented, and their use in an assessment course for preservice teachers is described. (SLD)

Specific recommendations are made concerning the circumstances under which the benefits of out-of-level testing outweigh the problems associated with it. Topics explored are: various methods for deciding when a set of test scores is invalid and the utility of these methods for local evaluators, the accuracy of vertical scaling, and the usefulness…