Machine learning (ML) has been increasingly employed in science assessment to facilitate automatic scoring efforts, although with varying degrees of success (i.e., magnitudes of machine-human score agreements [MHAs]). Little work has empirically examined the factors that impact MHA disparities in this growing field, thus constraining the…

Machine learning (ML) is an emergent computerised technology that relies on algorithms built by 'learning' from training data rather than 'instruction', which holds great potential to revolutionise science assessment. This study systematically reviewed 49 articles regarding ML-based science assessment through a triangle framework with technical,…

This paper illustrates how the combination of teacher and computer guidance can strengthen collaborative revision and identifies opportunities for teacher guidance in a computer-supported collaborative learning environment. We took advantage of natural language processing tools embedded in an online, collaborative environment to automatically…

This paper describes HASbot, an automated text scoring and real-time feedback system designed to support student revision of scientific arguments. Students submit open-ended text responses to explain how their data support claims and how the limitations of their data affect the uncertainty of their explanations. HASbot automatically scores these…

Describes a "gradebook program" capable of recording, editing, recoding, weighting, and scaling multiple choice test scores. (SK)

The MDT multi-digit technique, a development in testing technology, is described; and its application to science classrooms is discussed. Some actual materials for use in a cell biology class are included. The primary characteristic of an MDT multi-digit test is a long list of possible responses, with each term marked with a three-digit number…

The Problem Solving in Technology-Rich Environments (TRE) study was designed to demonstrate and explore innovative use of computers for developing, administering, scoring, and analyzing the results of National Assessment of Educational Progress (NAEP) assessments. Two scenarios (Search and Simulation) were created for measuring problem solving…

Discusses the potential role of technology in evaluating learning outcomes in large-scale, widespread science assessments. Describes current state-of-the-art techniques in this area and looks at the past and future uses of technology in large-scale science assessments. (LZ)