The Big Data for Education Spoke of the NSF Northeast Big Data Innovation Hub and ETS co-sponsored an educational data mining competition in which contestants were asked to predict efficient time use on the NAEP 8th grade mathematics computer-based assessment, based on the log file of a student's actions on a prior portion of the assessment. In…

The National Assessment of Educational Progress (NAEP), often referred to as The Nation's Report Card, offers a window into the state of U.S. K-12 education system. Since 2017, NAEP has transitioned to digital assessments, opening new research opportunities that were previously impossible. Process data tracks students' interactions with the…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

This research study investigates the impact of the rapid transition from paper-based to online administration of the State of Texas Assessments of Academic Readiness (STAAR) exams on student performance in a South Texas school district. The transition, mandated by House Bill 3261, presented Texas public schools with a tight timeline for adapting…

When student achievement is assessed, we seek to elicit a student's maximum performance -- a goal requiring the assumption that the student is fully engaged. Otherwise, to the extent that disengagement occurs, test performance is likely to suffer. Effectively managing test-taking disengagement requires an understanding of the testing conditions…

Purpose: This study aims to examine the impact of the informational value of feedback choices (confirmatory versus critical feedback) on students' performance, their choice to revise and the time they spend designing posters and reading feedback in a computer-based assessment game, Posterlet. Design/methodology/approach: An empirical correlational…

This study investigates the relationship between text-to-speech (TTS) usage and item-by-item performance in the 2017 eighth-grade National Assessment of Educational Progress (NAEP) math assessment, focusing on students with disabilities (SWDs), English language learners (ELLs), and their general education (GE) peers. Results indicate that all…

The COVID-19 pandemic has evidenced a need for tools and methodologies to support students' autonomous learning and the formative assessment practices in distance education contexts, especially for students from challenging backgrounds. This paper proposes a conceptualization of Interactive Feedback (IF) for Mathematics, which is a step-by-step…

After the passage of "No Child Left Behind," and especially after Obama-era Race to the Top initiatives, rising accountability for improved achievement and widespread dissatisfaction with the instructional value of statewide test reports led many school districts to purchase computer-adaptive "interim" testing systems. A common…

We examined semiotic exchangeability in pop-up glossary translations and illustrations used as supports for second language learners (SLLs) in computer-administered mathematics tests. In a sample of 516 mathematics items, Grades 3-8 and 11, from a large-scale assessment program in the US, test developers identified terms that could be translated…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on mathematics achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) mathematics assessment. This study compared mathematics achievement growth of students who used…

The quality of students' writing skills continues to concern educators. Because writing is essential to success in both college and career, poor writing can have lifelong consequences. Writing is now primarily done digitally, but students receive limited explicit instruction in digital writing. This lack of instruction means that students fail to…

Introduction: Students usually answer comprehension questions from texts as part of their academic activities. Elaborated Feedback (EF) has been found to be relatively effective to improve comprehension and learning from texts. However, there is little research on how computer-based feedback influences the question-answering process. This study…

The purpose of this evaluation was to examine the impact of i-Ready Personalized Instruction that met Curriculum Associates' recommended usage levels on ELA achievement, as measured by the Massachusetts Comprehensive Assessment System (MCAS) ELA assessment. This study compared the ELA achievement growth in the 2020-21 school year of students who…

This paper examines the impact of the informational value of feedback choices on students' performance, their choice to revise, and the time they spend designing posters and reading feedback in an assessment game. Choices to seek confirmatory or critical feedback and to revise posters in a poster design task were collected from a hundred and six…