Although eye tracking has been used extensively to assess cognitions for static stimuli, recent research suggests that the link between gaze and cognition may be more tenuous for dynamic stimuli such as videos. Part of the difficulty in convincingly linking gaze with cognition is that in dynamic stimuli, gaze position is strongly influenced by…

Background: There are only few guidelines on how instructional videos should be designed to optimize learning. Recently, the effects of social cues on attention allocation and learning in instructional videos have been investigated. Due to inconsistent results, it has been suggested that the visual complexity of a video influences the effect of…

Video materials require learners to manage concurrent verbal and pictorial processing. To facilitate second language (L2) learners' video comprehension, the amount of presented information should thus be compatible with human beings' finite cognitive capacity. In light of this, the current study explored whether a reduction in multimodal…

Multimedia learning scenarios in which a picture is the main focus often use combinations of verbal and visual cueing. Based on models of picture processing and multimedia learning, the present study examined the effect of verbal and visual cueing on two basic aspects of pictorial learning: retention and localization of pictorial elements. Videos…

Based on previous research on multimedia learning and text comprehension, an eye-tracking study was conducted to examine the influence of audio text coherence on visual attention and memory in a multimedia learning situation with a focus on picture comprehension. Audio text coherence was manipulated by the type of LDI structure, that is, whether…

This study investigated the involvement of the Social Agency Theory within a multimedia learning environment to improve English language proficiency. The primary aim of this study is to find the effects of designing language learning instructional videos following the embodiment principle on language learners' motivation, cognitive load and…

Emotions and cognitive processes are intertwined terms and can frame how we behave and learn. The main aim of this research was to investigate the effect of emotion on attention during L2 subtitle processing and to scrutinize emotional intensity as a factor on delayed L2 vocabulary recall tasks. In this experimental study, quantitative method was…

The purpose of this study was to identify the feasibility of using the pupil dilation and heart rate variability (HRV), to diagnose learners' changing cognitive load in a video learning setting. The pupil dilation and HRV of 23 participants were recorded during their learning progress, and the learning materials, including differences in task…

Agents are important for structuring memory in adulthood. However, it is unclear whether this "social memory bias" stems from a reliance on agents in verbal narratives, or whether it reflects more fundamental preverbal memory processes. By testing 9-month-old infants in a non-verbal eye-tracking paradigm, we were able to effectively…

The purpose of this study was to understand how the use of multiple representations (MR), during a sequence of lessons on the saponification reaction, can help students develop their cognitive structures. We examined (i) the effect of the teaching sequence with MR on the development of the students' cognitive structures and (ii) how, according to…

It is surprising that there are inconsistent findings of transitive inference (TI) in young infants given that non-linguistic species succeed on TI tests. To conclusively test for TI in infants, we developed a task within the social domain, with which infants are known to show sophistication. We familiarized 10- to 13-month-olds (M = 11.53 months)…

People spontaneously gesture when they speak (co-speech gestures) and when they solve problems silently (co-thought gestures). In this study, we first explored the relationship between these 2 types of gestures and found that individuals who produced co-thought gestures more frequently also produced co-speech gestures more frequently (Experiments…

In this reply to Salverda (2016), we address a critique of the claims made in our recent study of real-time processing of American Sign Language (ASL) signs using a novel visual world eye-tracking paradigm (Lieberman, Borovsky, Hatrak, & Mayberry, 2015). Salverda asserts that our data do not support our conclusion that native signers and…

From early in development, segmenting events unfolding in the world in meaningful ways renders input more manageable and facilitates interpretation and prediction. Yet, little is known about how children process action structure in events composed of multiple coarse-grained actions. More importantly, little is known about the time course of action…

Animation can be used for various purposes such as for procedural and motor skill learning (i.e., dance, sports, and motor rehabilitation). In the context of visual design, this study explores the possible influence of realism (levels of visual detail) in animation at the cognitive stage of motor skill acquisition. Students (N = 64) with low-prior…