Background: There are only few guidelines on how instructional videos should be designed to optimize learning. Recently, the effects of social cues on attention allocation and learning in instructional videos have been investigated. Due to inconsistent results, it has been suggested that the visual complexity of a video influences the effect of…

The process of spoken word recognition is influenced by both bottom-up sensory information and top-down cognitive information. These cues are used to process the phonological and semantic representations of speech. Several studies have used EEG/ERPs to study the neural mechanisms of children's spoken word recognition, but less is known about the…

Pre-recorded lectures have become a prevalent approach in online education due to the proliferation of MOOC platforms and the COVID-19 pandemic. However, due to the lack of real-time interactions between instructors and learners, learners have encountered various difficulties in understanding the lectures and actively engaging with the learning…

We investigated how two cues to contrast--beat gesture and contrastive pitch accenting--affect comprehenders' cognitive load during processing of spoken referring expressions. In two visual-world experiments, we orthogonally manipulated the presence of these cues and their felicity, or fit, with the local (sentence-level) referential context in…

Music performance requires high levels of motor control. Professional musicians use body movements not only to accomplish and help technical efficiency, but to shape expressive interpretation. Here, we recorded motion and audio data of twenty participants performing four musical fragments varying in the degree of technical difficulty to analyze…

During face-to-face communication, people use visual cues about what their partners are attending to as they process language. An eyetracking experiment explored how addressees use speakers' eye gaze and head orientation while interpreting references to objects in a spatial task. Thirty-six naive director/matcher pairs seated face-to-face were…

The present study attempted to replicate the previous results of Hu et al. (Learning and Instruction 35:85-93 2015) and further examined the boundary condition of tracing gesture whether its cognitive effect is merely comparable with other attention-guiding means, i.e., textual attention cueing, in two different learning tasks in nature. In two…

Many perceived cues to deception have been reported in the literature, but little attention has been paid to how they are combined when making deception judgments. The present research used a data-driven approach to investigate how cues are integrated when evaluating veracity. Two hundred fifteen participants performed a deception detection task…

The theory of natural pedagogy has proposed that infants can use ostensive signals, including eye contact, infant-directed speech, and contingency to learn from others. However, the role of bodily gestures, such as hand-waving, in social learning has been largely ignored. To address this gap in the literature, this study sought to determine…

It is generally acknowledged that engagement plays a critical role in learning. Unfortunately, the study of engagement has been stymied by a lack of valid and efficient measures. We introduce the advanced, analytic, and automated (AAA) approach to measure engagement at fine-grained temporal resolutions. The AAA measurement approach is grounded in…

Semantic and lexical decision tasks were used to investigate the mechanisms underlying code-blend facilitation: the finding that hearing bimodal bilinguals comprehend signs in American Sign Language (ASL) and spoken English words more quickly when they are presented together simultaneously than when each is presented alone. More robust…

Confusion is an emotion that is likely to occur while learning complex information. This emotion can be beneficial to learners in that it can foster engagement, leading to deeper understanding. However, if learners fail to resolve confusion, its effect can be detrimental to learning. Such detrimental learning experiences are particularly…

Younger and older adults differ in performance on a range of social-cognitive skills, with older adults having difficulties in decoding nonverbal cues to emotion and intentions. Such skills are likely to be important when deciding whether someone is being sarcastic. In the current study we investigated in a life span sample whether there are…

This dissertation investigated the effects of technological mediation on second language (L2) learning, focusing, as a case study, on gains in listening perception of the subtle but important feature of pitch placement in Japanese. Pitch accent can be difficult to perceive for non-native speakers whose first language (L1) does not rely on pitch or…

Previous research indicates that lesson study can support preservice teachers' abilities to professionally notice. This qualitative case study examined specific lexical and indexical conversational components of lesson study analysis meetings that afford or constrain elementary preservice teachers' incidences of professionally noticing students'…