Large-scale assessments play a key role in education: educators and stakeholders need to know what students know and can do, so that they can be prepared for education policies and interventions in teaching and learning. However, a score from the assessment may not be enough--educators need to know why students got low scores, how students engaged…

This investigation scrutinizes the relative effectiveness of individual versus bundled accommodations -- specifically, breaks and extended time (ET) -- on the performance, behaviors, and attitudes of eighth-grade students with disabilities during the 2017 National Assessment of Educational Progress (NAEP) digital math test. Through a detailed…

Over the last 20 years, many methods have been proposed to use process data (e.g., response time) to detect changes in engagement during the test-taking process. However, many of these methods were developed and evaluated in highly similar testing contexts: 30 or more single-select multiple-choice items presented in a linear, fixed sequence in…

This study was an investigation of the use of manipulative materials in the mathematics classroom. The researcher guided students to create paper triangles, which were then used as a manipulative to calculate the sum of the interior angles of a triangle. On pre- and post-measures of quantitative data, although the data indicated a positive…

In this study, we explore the application of process mining techniques on assessment log data to explore problem-solving strategies in Algebra. By analyzing sequences of student activities, we demonstrate the significant potential of process mining in identifying problem-solving strategies that lead to successful and unsuccessful outcomes. Our…

The purpose of this National Assessment of Educational Progress (NAEP) Achievement Levels Validity Argument Report is to synthesize evidence currently available to address the validity of the interpretations and uses of the NAEP Achievement Levels. Validity is the extent to which theory and evidence supports or refutes proposed and enacted test…

After 25 years with small to moderate gains in performance in mathematics, scores on the National Assessment of Educational Progress (NAEP) main assessment declined between 2013 and 2015 in Grades 4 and 8. Previous research has suggested the decline may be linked to the implementation of the "Common Core" state standards. In this…

For autistic students receiving special education services, little is known about their relative strengths, weaknesses, and enjoyment across different math content areas; their overall math interest and persistence are also not well-studied. Using the 2017 eighth-grade National Assessment of Education Progress data, this study finds, relative to…

The National Assessment of Educational Progress (NAEP), often referred to as The Nation's Report Card, offers a window into the state of U.S. K-12 education system. Since 2017, NAEP has transitioned to digital assessments, opening new research opportunities that were previously impossible. Process data tracks students' interactions with the…

This paper introduces an approach that uses latent class analysis to identify cut scores (LCA-CS) and categorize respondents based on context scales derived from largescale assessments like PIRLS, TIMSS, and NAEP. Context scales use Likert scale items to measure latent constructs of interest and classify respondents into meaningful ordered…

This study analyzed performance, process, and survey data of eighth graders with learning disabilities (LDs) who took the 2017 National Assessment of Educational Progress (NAEP) digital math test. Compared with students with LDs who did not receive extended time accommodations (ETAs), students with LDs who received and used ETA scored…

Extended testing time is a common accommodation given to students with disabilities. However, little is known about whether students who are eligible for the accommodation actually use it, and with what effect. The present study used process data available from the digitally delivered 2017 National Assessment of Educational Progress (NAEP)…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

The National Assessment of Educational Progress (NAEP) is the largest continuing and nationally representative assessment of what students in public and private schools know and can do in various subjects. First administered in 1969, NAEP collects and reports information on student trends and performance and compares the achievement of students in…

According to data from the National Assessment of Educational Progress, or NAEP, the U.S. educational system has consistently failed Black and Brown children across both reading and mathematics. Educational research has further uncovered the ways that reading and mathematics assessment and curriculum are often biased and culturally and…