This article discusses critical methodological design decisions for collecting, interpreting, and synthesizing empirical evidence during the design, deployment, and operational quality-control phases for automated scoring systems. The discussion is inspired by work on operational large-scale systems for automated essay scoring but many of the…

Describes a novel approach to comprehensive questions in world history examinations. Recommends using current events as illustrative reference points for complex subjects such as nationalism, liberalism, and international trade. Students receive information packets on the events for several weeks and must relate the subjects to these events. (MJP)