Daniel Koretz is the Henry Lee Shattuck Professor of Education at the Harvard Graduate School of Education. His research focuses on educational assessment and policy, particularly the effects of high-stakes testing on educational practice and the validity of score gains. He is the author of "Measuring Up: What Educational Testing Really Tells…

Ultimately, measures in research, testing, assessment and evaluation are used, or have implications, for ranking, intervention, feedback, decision-making or policy purposes. Explicit recognition of this fact brings the often-ignored and sometimes maligned concept of consequences to the fore. Given that measures have personal and social…

Psychometricians continue to introduce new approaches to setting cut scores for educational assessments in an attempt to improve on current methods. In this paper we describe the Item-Descriptor (ID) Matching method, a method based on IRT item mapping. In ID Matching, test content area experts match items (i.e., their judgments about the knowledge…

This paper provides a brief history of attempts to monitor testing in the United States. It describes proposals for monitoring from the first attempts in the 1920s to similar proposals in the 1990s. The discussion focuses on: (1) Giles Ruche's proposal for a consumer research bureau on tests; (2) Oscar K. Burros' reviews of tests and efforts to…

Describes the five-year effort of the Allentown, Pennsylvania School District to develop districtwide final examinations to test the mastery of course objective in its secondary schools. (FL)

Details the development of item pools, or collections of test exercises, including specifying the domain of content; collecting/writing items; pilot testing; and publishing. Implications of item pools for guidance workers are presented. (BP)

In view of social processes, politics and the logistics of conducting evaluations, several implicit assumptions of the field challenged by findings on innovation implementation are reviewed. These studies have major implications for evaluation practice, evaluator roles, the use of evaluation results, and the federal role in evaluation. (Author/CM)

Compared to 2004 issues concerning the No Child Left Behind Act (NCLB), this year's issues in play are even more complex. First, much more media attention has been paid to testing, in particular to the No Child Left Behind Act and its required Adequate Yearly Progress on state tests. Second, objections to various aspects of testing have increased…

A comprehensive student basic skills assessment program was developed at St. Louis Community College (SLCC) at Florissant Valley to appraise student readiness to take courses, gather information for counseling and advising, diagnose student problems, and evaluate program efficiency and effectiveness. The steps taken in developing the program were:…

L. Cronbach has made the point that for validity arguments to be convincing to diverse audiences, they need to be based on assumptions that are credible to these audiences. The interpretations and uses of high stakes test scores rely on a number of policy assumptions about what should be taught in schools, and more specifically, about the content…

The teacher education profession must develop a program to assess essential elements of professional knowledge comprising a teacher education curricula so that institutions can prepare teachers who can demonstrate that they have gained an acceptable mastery of cognitive and affective learning. (Author/CB)

Mandated testing is not working as advertised. Too much classroom time and energy is being spent on tests that do little to measure or instill in our students the skills and knowledge needed for their later life. Corruption and political manipulation of the testing process and test results further add to questions about the use of such testing.…

Some insights into the development of an eleventh grade test of "adult functional competency" are provided. The evolution of the test from its first mention to its translation into a test item pool is traced. An attempt is made to identify some of the instructional, measurement, and legal implications inherent in various decisions which…

In England and Wales, a National Curriculum initiated in 1988 was designed to ensure that all schools provided a curriculum which represented different areas of knowledge. The past 20 years has increasingly seen more emphasis on the link between the financial amounts spent on education and subsequent return on this money. The impact of the…

Argues that standardized testing encourages a standardized pedagogy in a nonstandard, diverse student population and is characterized by logical fallacies and procedural problems. Concludes that conventional tests create barriers to learning and educational policies with important consequences for children. Encourages early childhood teachers to…