This study evaluated the construct validity of six scoring traits of an automated writing evaluation (AWE) system called "MI Write." Persuasive essays (N = 100) written by students in grades 7 and 8 were randomized at the sentence-level using a script written with Python's NLTK module. Each persuasive essay was randomized 30 times (n =…

The COVID-19 pandemic has evidenced a need for tools and methodologies to support students' autonomous learning and the formative assessment practices in distance education contexts, especially for students from challenging backgrounds. This paper proposes a conceptualization of Interactive Feedback (IF) for Mathematics, which is a step-by-step…

In this study, we investigated the challenges and opportunities in developing a computer-delivered English language arts (ELA) task intended to improve the accessibility of the task for middle school English learners (ELs). Data from cognitive labs with 8 ELs with varying language proficiency levels provided rich insight to student-- task…

The goal of this study was to examine how students process formative feedback that included corrective and elaborative information in online question-answering tasks. Skilled and less-skilled comprehenders in grade 8 read texts and answered comprehension questions. Prior to responding, students were asked to select the textual information relevant…

After the passage of "No Child Left Behind," and especially after Obama-era Race to the Top initiatives, rising accountability for improved achievement and widespread dissatisfaction with the instructional value of statewide test reports led many school districts to purchase computer-adaptive "interim" testing systems. A common…

Computer-based assessments can provide students with feedback to guide their learning as well as inform teachers who extract information to prepare their teaching. Five secondary school teachers were monitored during one school year to answer the following research questions: (1) What kind of student data do teachers use for their teaching…

Introduction: Students usually answer comprehension questions from texts as part of their academic activities. Elaborated Feedback (EF) has been found to be relatively effective to improve comprehension and learning from texts. However, there is little research on how computer-based feedback influences the question-answering process. This study…

This paper describes HASbot, an automated text scoring and real-time feedback system designed to support student revision of scientific arguments. Students submit open-ended text responses to explain how their data support claims and how the limitations of their data affect the uncertainty of their explanations. HASbot automatically scores these…

Over the last two decades, there has been renewed interest in formative assessment, in large part due to the increasing pressures and prevalence of "high stakes" summative assessments. As states try to meet the requirements of the No Child Left Behind law, teachers and administrators are realizing that formative assessment offers an…

In this chapter, we provide an overview of the design, data-collection, and data-analysis efforts for a digital learning and assessment environment for scientific inquiry / science practices called "Inq-ITS" ("I"nquiry "I"ntelligent "T"utoring "S"ystem; www.inqits.org). We first present a brief…

This article describes a case study in which Our Lady of Hungary Catholic School (OLH) principal Kevin Goralczyk and the parish's pastor, Reverend Kevin Bauman, faced educators' universal challenge: Knowing what students need to learn but wondering how to evaluate if they were really successfully taking in the information rather than simply…

CBAL, an acronym for Cognitively Based Assessment of, for, and as Learning, is a research initiative intended to create a model for an innovative K-12 assessment system that provides summative information for policy makers, as well as formative information for classroom instructional purposes. This paper summarizes empirical results from 16 CBAL…

In 2010-11, Wake County Public School System (WCPSS), North Carolina Department of Public Instruction (NCDPI), and SMART Technologies began a two-year collaboration to promote the use of formative assessment in mathematics classrooms at three Wake County public schools: Millbrook Elementary, East Millbrook Middle, and Millbrook High school. The…

The purpose of these case studies was to examine the ways technology and professional development supported the use of the SimScientists assessment systems. Qualitative research methodology was used to provide narrative descriptions of six classes implementing simulation-based assessments for either the topic of Ecosystems or Atoms and Molecules.…

This paper reports the results of a descriptive study on the use of a technology-enhanced formative assessment system called Accelerated Math (AM) for ELLs and their native-English-speaking (NES) peers. It was comprised of analyses of an extant database of 18,549 students, including 2,057 ELLs, from grades 1 through 8 across 30 U.S. states. These…