In March 2020, the National Center for Special Education Research (NCSER) virtually convened a group of experts to discuss gaps in research on eighth grade mathematics for students with disabilities (SWD) that could be addressed with the NAEP process data and data science techniques for this research. Invited experts also provided recommendations…

Data reasoning is an essential component of scientific reasoning, as a component of evidence evaluation. In this paper, we outline a model of scientific data reasoning that describes how data sensemaking underlies data reasoning. Data sensemaking, a relatively automatic process rooted in perceptual mechanisms that summarize large quantities of…

Although tests and assessments--such as those used to maintain a physician's Board certification--are often viewed merely as tools for decision-making about one's performance level, strong evidence now indicates that the experience of being tested is a powerful learning experience in its own right: The act of retrieving targeted information from…

Although Diagnostic Classification Models (DCMs) were introduced to education system decades ago, it seems that these models were not employed for the original aims upon which they had been designed. Using DCMs has been mostly common in analyzing large-scale non-diagnostic tests and these models have been rarely used in developing Cognitive…

Increased online learning is helping many appreciate that online grading, formative assessment, and summative testing can cause instructor burnout and leave little time for more productive instructor interactions. We reimagined grading, assessment, and testing in an extended program of design-based research using situative theory to refine online…

This article reviews how National Assessment of Educational Progress (NAEP) has come to collect and analyze data about cognitive and behavioral processes (process data) in the transition to digital assessment technologies over the past two decades. An ordered five-level structure is proposed for describing the uses of process data. The levels in…

Generative learning strategies are intended to improve students' learning by prompting them to actively make sense of the material to be learned. But are they effective for all students? This review provides an overview of six popular generative learning strategies: concept mapping, explaining, predicting, questioning, testing, and drawing. Its…

Online testing is a popular practice for tertiary educators, largely owing to efficiency in automation, scalability, and capability to add depth and breadth to subject offerings. As with all assessments, designs need to consider whether student cheating may be inadvertently made easier and more difficult to detect. Cheating can jeopardise the…

U.S. Supreme Court justices and other federal judges are, effectively, appointed for life, with no built-in check on their cognitive functioning as they approach old age. There is about a century of research on aging and intelligence that shows the vulnerability of processing speed, fluid reasoning, visual-spatial processing, and working memory to…

Examinees' thinking processes have become an increasingly important concern in testing. The responses processes aspect is a major component of validity, and contemporary tests increasingly involve specifications about the cognitive complexity of examinees' response processes. Yet, empirical research findings on examinees' cognitive processes are…

This paper outlines the key issues of remotely invigilated online exams (RIOEs) and presents ways to avoid and resolve the issues for educators who are considering implementing them. The purpose of this paper is to share the lessons learned during the process of implementing and evaluating RIOEs and highlight the key considerations required to…

We introduce RESOLV, a theoretical model to account for readers' construction and management of goals during text comprehension and use. RESOLV focuses on readers' experience of their physical, social, and communicative context prior to actually engaging with texts. RESOLV assumes that readers construct two types of mental models prior to reading:…

Post-learning sleep is beneficial for human memory. However, it may be that not all memories benefit equally from sleep. Here, we manipulated a spatial learning task using monetary reward and performance feedback, asking whether enhancing the salience of the task would augment overnight memory consolidation and alter its incorporation into…

This paper addresses the way in which students' cognitive creativity and the construction of meaning could be fostered by means of assessment in a Problem-based learning programme. We propose that a dual assessment structure within such a programme through examinations and coursework assignments could ensure the acquisition of a foundational…

Science is a complex process, and we must not teach our students overly simplified versions of "the" scientific method. We propose that students can uncover the complex realities of scientific thinking by exploring the similarities and differences between solving the familiar crossword puzzles and scientific "puzzles."…