This article discusses critical methodological design decisions for collecting, interpreting, and synthesizing empirical evidence during the design, deployment, and operational quality-control phases for automated scoring systems. The discussion is inspired by work on operational large-scale systems for automated essay scoring but many of the…

For some districts, the current obsession with data grows out of the need to comply with No Child Left Behind and additional accountability-related mandates. For others, it dates way back before the phrase "data-driven decision making" rolled so frequently off the tongues of educators. In either case, there is no denying that an integral…

Project Impact, a support system for the administrative and instructional staff in the Onondaga-Madison BOCES schools, was designed to support a diagnostic-prescriptive approach in the classroom by providing the information the teacher needs in order to make instructional decisions. It consists of a series of computer programs with a large storage…

During the past few years, several Harvard paper surveys were converted to Web surveys. These were high-profile surveys endorsed by the Provost and the Dean of the College, and covered major portions of the university population (all undergraduates, all graduate students, tenured and non-tenured faculty). When planning for these surveys started in…

The IADIS CELDA 2012 Conference intention was to address the main issues concerned with evolving learning processes and supporting pedagogies and applications in the digital age. There had been advances in both cognitive psychology and computing that have affected the educational arena. The convergence of these two disciplines is increasing at a…