This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of ChatGPT and GPT-4 on NAEP science assessments and compare their performance to students by cognitive demands of the items. Fifty-four…

The purpose of this study was to determine K-8 preservice teacher (PST) candidates' statistical thinking when selecting the best center representation for the given data. Forty-four PSTs enrolled in a Statistics and Probability for K-8 Teachers course in a university located in the southeastern region of the United States were asked to complete a…

Purpose: Writing is an essential skill that secondary students need to establish for success in their further education, careers, and lives. However, most secondary students in the United States do not achieve the level of writing proficiency expected to ensure academic and future success. One approach that is emerging more in the research…

The present paper investigates and examines the conditional dependencies between cognitive responses (RA; Response Accuracy) and process data, in particular, response times (RT) in large-scale educational assessments. Using two prominent large-scale assessments, NAEP and PISA, we examined the RA-RT conditional dependencies within each item in the…

This article reviews how National Assessment of Educational Progress (NAEP) has come to collect and analyze data about cognitive and behavioral processes (process data) in the transition to digital assessment technologies over the past two decades. An ordered five-level structure is proposed for describing the uses of process data. The levels in…

In March 2020, the National Center for Special Education Research (NCSER) virtually convened a group of experts to discuss gaps in research on eighth grade mathematics for students with disabilities (SWD) that could be addressed with the NAEP process data and data science techniques for this research. Invited experts also provided recommendations…

The development of math reasoning and 3-d mental rotation skills are intertwined. However, it is currently not understood how these cognitive processes develop and interact longitudinally at the within-person level -- either within or across genders. In this study, 553 students (52% girls) were assessed from fifth to seventh grades on 3-d mental…

As the ongoing national indicator of what American students know and can do, the National Assessment of Educational Progress (NAEP) in Reading regularly collects achievement information on representative samples of students in grades 4, 8, and 12. Through "The Nation's Report Card," the NAEP Reading Assessment reports how well students…

The National Assessment of Educational Progress (NAEP) in Reading regularly collects achievement information on representative samples of students in grades 4, 8, and 12. Through The Nation's Report Card, the NAEP Reading Assessment reports how well students perform in reading various texts and responding to those texts by answering…

The reading framework for the 2017 NAEP describes the types of texts and questions that should be included in the assessment, as well as how the questions should be designed and scored. The assessment measures students' reading comprehension and ability to apply vocabulary knowledge by having them read passages in English and answer questions…

Learning standards across the United States have increasingly called for history students to engage in aspects of "historical thinking," a term used to describe the complex disciplinary processes that historians use to make sense of the past. Although students are expected to learn these complex processes, little is known about how to…

The cumulative body of eye movement research provides significant insight into how readers process text. The heart of this work spans roughly 40 years reflecting the maturity of both the topics under study and experimental approaches used to investigate reading. Recent technological advancements offer increased flexibility to the field, providing…

The reading framework for the 2015 National Assessment of Educational Progress (NAEP) presents the assessment's conceptual base and discusses its content. The framework describes the types of texts and questions that should be included in the assessment, as well as how the questions should be designed and scored. This report provides highlights of…

The main purposes of this study were to test the effects of teaching at-risk 4th graders to provide explanations for their mathematics work and examine whether those effects occur by compensating for limitations in cognitive processes. We randomly assigned 212 children to 3 conditions: a control group and 2 variants of a multi-component fraction…

As the ongoing national indicator of what American students know and can do, the National Assessment of Educational Progress (NAEP) in Reading regularly collects achievement information on representative samples of students in grades 4, 8, and 12. Through The Nation's Report Card, the NAEP Reading Assessment reports how well students perform in…