This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of ChatGPT and GPT-4 on NAEP science assessments and compare their performance to students by cognitive demands of the items. Fifty-four…

The purpose of this study was to determine K-8 preservice teacher (PST) candidates' statistical thinking when selecting the best center representation for the given data. Forty-four PSTs enrolled in a Statistics and Probability for K-8 Teachers course in a university located in the southeastern region of the United States were asked to complete a…

The present paper investigates and examines the conditional dependencies between cognitive responses (RA; Response Accuracy) and process data, in particular, response times (RT) in large-scale educational assessments. Using two prominent large-scale assessments, NAEP and PISA, we examined the RA-RT conditional dependencies within each item in the…

The development of math reasoning and 3-d mental rotation skills are intertwined. However, it is currently not understood how these cognitive processes develop and interact longitudinally at the within-person level -- either within or across genders. In this study, 553 students (52% girls) were assessed from fifth to seventh grades on 3-d mental…

The main purposes of this study were to test the effects of teaching at-risk 4th graders to provide explanations for their mathematics work and examine whether those effects occur by compensating for limitations in cognitive processes. We randomly assigned 212 children to 3 conditions: a control group and 2 variants of a multi-component fraction…

In 2010, the William and Flora Hewlett Foundation's Education Program has established the Deeper Learning Initiative, which focuses on students' development of deeper learning skills (i.e., the mastery of core academic content, critical-thinking, problem-solving, collaboration, communication, and "learn-how-to-learn" skills). Two test…

The purposes of this study were to investigate the effects of an intervention designed to improve at-risk 4th graders' understanding of fractions and to examine the processes by which effects occurred. The intervention focused more on the measurement interpretation of fractions; the control condition focused more on the part-whole interpretation…

The authors present an analysis of portfolio entries submitted by candidates seeking certification by the National Board for Professional Teaching Standards in the area of Early Adolescence/Mathematics. Analyses of mathematical features revealed that the tasks used in instruction included a range of mathematics topics but were not consistently…

Cognitive interviews were conducted with 12 teachers and 66 of their students to learn how to improve National Assessment of Educational Progress (NAEP) questionnaire items asking about instructional practices and teacher development experiences. Items were purposively selected from those used in the 1996 and 1998 NAEP student and teacher…

Procedural documentation is presented for administering, scoring and analyzing data gathered to examine the construct validity of a set of superitems developed to assess student levels of mathematical reasoning ability. Each superitem includes a mathematical situation and a structured set of questions about that situation. The questions were based…

This project examined science education research relating to relative effects of different science programs, teaching systems, instructional methodologies, teacher preparation programs, and relationships between various student outcomes and student/teacher relationships. More than 80 studies were examined providing information on sex-related…

The cognitive processes students use in doing the 1996 science assessment of the National Assessment of Educational Progress (NAEP) were studied using two booklets from the 1993 NAEP science field test. Blocks of items from these booklets, a hands-on task block and either a conceptual/problem solving block or a theme block, were administered to 16…