Learning logs collected by digital educational systems, increasingly deployed in educational settings, include clickstream logs recorded through page transitions in teaching materials and digital marker logs recorded by drawing a marker. A challenge with these learning logs is their low temporal and spatial resolutions. This paper proposes a…

The rise of precision education has encouraged teachers to use intelligent diagnostic systems to understand students' learning processes and provide immediate guidance to prevent students from giving up when facing learning difficulties. However, current research on precision education rarely employs multimodal learning analytics approaches to…

This is an editorial for a special issue "Innovations in Exploring Sequential Process Data" in the journal Zeitschrift für Psychologie. Process data refer to log files generated by human-computer interactive items. They document the entire process, including keystrokes, mouse clicks as well as the associated time stamps, performed by a…

Background: Both learning and problem solving are major goals of complex problem solving in engineering education. The order of knowledge construction and problem solving in learning through problem solving, however, has not been explained in current literature. Objectives: To understand their relationships, this study compared the effects of…

Collaboration is one of the important 21st-century skills. It can take place in remote or co-located settings. Co-located collaboration (CC) is a very complex process that involves subtle human interactions that can be described with indicators like eye gaze, speaking time, pitch, and social skills from different modalities. With the advent of…

This paper describes a method to collect data of which section of pages learners were browsing in digital textbooks without eye-tracking technologies. In previous researches on digital textbook systems, it was difficult to collect such data without using eye-tackers. However, eye-trackers cost a massive budget. Our proposed system automatically…

Learning analytics (LA) dashboards are becoming increasingly available in various learning settings. However, teachers may face challenges in understanding and interpreting the data visualisations presented on those dashboards. In response to this, some LA researchers are incorporating visual cueing techniques, like data storytelling (DS), into LA…

A distinctive feature of game-based learning environments is their capacity to create learning experiences that are both effective and engaging. Recent advances in sensor technologies (e.g., facial expression analysis and gaze tracking) and natural language processing have introduced the opportunity to leverage multimodal data streams for learning…

Pedagogical agents have been designed to support the significant challenges that learners face when self-regulating in advanced learning environments. Evidence suggests differences in learners' prior skills and abilities, in conjunction with excessive didactic support, can cause overreliance on these external aids, which in turn prevents deeper…

With the advent of new data collection techniques, there has been a growing interest in studying co-located groups of students using Multimodal Learning Analytics to automatically identify collaborative learning states. In this paper, we analyze a multimodal dataset (N=84) made of eye-tracking, physiological and motion sensing data. We leverage…

Background: Problem-solving is a multidimensional and dynamic process that requires and interlinks cognitive, metacognitive, and affective dimensions of learning. However, current approaches practiced in computing education research (CER) are not sufficient to capture information beyond the basic programming process data (i.e., IDE-log data).…

A distinctive feature of game-based learning environments is their capacity to create learning experiences that are both effective and engaging. Recent advances in sensor-based technologies such as facial expression analysis and gaze tracking have introduced the opportunity to leverage multimodal data streams for learning analytics. Learning…

CAL (Computer Assisted Learning) programs are widespread today in schools and families due to the effectiveness of CAL programs in improving students' learning and task performance. The flourishing of CAL programs in education has brought large amounts of students' learning data including log data, performance data, mouse movement data, eye…

The goal of this paper is to bring new insights to the study of social learning processes by designing measures of collaboration using high-frequency sensor data. More specifically, we are interested in understanding the interplay between moments of collaboration and cooperation, which is an understudied area of research. We collected a multimodal…

The analysis of multiple data streams is a long-standing practice within educational research. Both multimodal data analysis and temporal analysis have been applied successfully, but in the area of collaborative learning, very few studies have investigated specific advantages of multiple modalities versus a single modality, especially combined…