This article discusses critical methodological design decisions for collecting, interpreting, and synthesizing empirical evidence during the design, deployment, and operational quality-control phases for automated scoring systems. The discussion is inspired by work on operational large-scale systems for automated essay scoring but many of the…

Essay writing is a common type of constructed-response task used frequently in standardized writing assessments. However, the impromptu timed nature of the essay writing tests has drawn increasing criticism for the lack of authenticity for real-world writing in classroom and workplace settings. The goal of this paper is to contribute evidence to a…

The meaning of the term energy varies widely in scientific and colloquial discourse. Teasing apart the different connotations of the term can be especially challenging for non-science majors. In this study, undergraduate students taking an interdisciplinary, general science course (n?=?49) were asked to explain the role of energy in five contexts:…