This article discusses critical methodological design decisions for collecting, interpreting, and synthesizing empirical evidence during the design, deployment, and operational quality-control phases for automated scoring systems. The discussion is inspired by work on operational large-scale systems for automated essay scoring but many of the…

The goal of the No Child Left Behind Act (NCLB) is to have 100 percent of America's public school students "proficient" by the year 2014. As Rosenberg points out, however, there are multiple interpretations of proficiency, including: (1) Different methods of setting performance standards yield different meanings of proficient; (2)…

The use of reporting final examinations in the Netherlands is described. Each October a public report is published by Cito, supplying information about the achieved level of education and describing observed psychometric qualities of the measurement instrument. General information needs are provided by the National Bureau of Statistics. (LMO)

I discuss the contributions of Harvey Siegel, Francis Schrag and Randall Curren to this volume. Their articles cast in bold relief the relation of High Stakes Testing to the goals of education, the nature of mind and the demands of justice. I argue that the connections are deep, but that the considerations these authors raise do not show that High…