A critical issue in using fine-grained gameplay data to measure learning processes is the development of indicators and the algorithms used to derive such indicators. Successful development--that is, developing traceable, interpretable, and sensitive-to-learning indicators--requires understanding the underlying theory, how the theory is…

Recent research seeks to develop more comprehensive learner models for adaptive learning software. For example, models of reading comprehension built using data from students' use of adaptive instructional software for mathematics have recently been developed. These models aim to deliver experiences that consider factors related to learning beyond…

The American Association for the Advancement of Science (AAAS) cites evolution as a core concept of biology, yet studies have found that biology students often exhibit low acceptance of evolution. As such, much of evolution education research aims to identify the causes of evolution rejection and develop instructional strategies to increase…

Response Process Validity (RPV) reflects the degree to which items are interpreted as intended by item developers. In this study, teacher responses to constructed response (CR) items to assess pedagogical content knowledge (PCK) of middle school mathematics teachers were evaluated to determine what types of teacher responses signaled weak RPV. We…

This study investigates the associations of spontaneous "dynamic gesture" and "transformational speech" with the production of "deductive proofs" in participants' reasoning about geometric conjectures (N=77). Although statistical analysis showed no significant association, the result suggests that purposefully…

The ability to maintain attentive state over a period of time (i.e., Selective Sustained Attention) is important for higher-order cognition but challenging to assess in preschool-age children. The TrackIt task was developed to address this challenge and has been argued to be sensitive to age-related differences in selective sustained attention in…

In the last twenty-five years, the discussion surrounding validity evidence has shifted both in language and scope, from the work of Messick and Kane to the updated Standards for Educational and Psychological Testing. However, these discussions haven't necessarily focused on best practices for different types of instruments or assessments, taking…

Access to body-based resources has been shown to augment cognitive processes, but not all movements equally aid reasoning. Interactive technologies, like dynamic geometry systems (DGS), potentially amplify the link between movement and geometric representation, thereby deepening students' understanding of geometric properties. This study…

Gestures are associated with powerful forms of mathematical understanding. However, determining the causative role of gestures has been more elusive. In the present study, we inhibit students' gestures by restraining their hands, and examine how this impacts their problem-solving when presented with geometric conjectures to prove. We find no…

When designing an instructional tool and using it in pedagogical activities, it is essential that designers and users understand what pedagogical affordances and constraints the tool provides to support its successful integration into targeted pedagogical activities. Toward this end, we developed "Pedagogical Affordance Analysis (PAA)."…

Proof, though central to mathematical practice, is rarely explored through the lens of embodiment because of the centrality of abstraction and generalization. We use the case of a high school geometry student to investigate two research questions: (1) How do embodied processes facilitate mathematical learning? (2) How can generalized mathematical…

Recent methods have sought to improve precision in randomized controlled trials (RCTs) by utilizing data from large observational datasets for covariate adjustment. For example, consider an RCT aimed at evaluating a new algebra curriculum, in which a few dozen schools are randomly assigned to treatment (new curriculum) or control (standard…

We developed assessment tasks aligned to the Next Generation Science Standards (NGSS) that require students to use argumentation and explanation practices along with disciplinary core ideas and crosscutting concepts to make sense of energy-related phenomena. Scoring rubrics were created to evaluate students' ability to make accurate claims, cite…

Language entails many nested time scales, ranging from the relatively slow scale of cultural evolution to the rapid scale of individual cognition. The nested, multiscale nature of language implies that even simple acts of text production, such as typing a sentence, entail complex interactions involving multiple concurrent processes. As such, text…

This paper demonstrates how to apply Machine Learning (ML) techniques to analyze student interaction data collected in an online mathematics game. We examined: (1) how different ML algorithms influenced the precision of middle-school students' (N = 359) performance prediction; and (2) what types of in-game features were associated with student…