The interest in crossmodal correspondences, including those involving sounds and involving tastes, has experienced rapid growth in recent years. However, the mechanisms underlying these correspondences are not well understood. In the present study (N = 302), we used an associative learning paradigm, based on previous literature using simple sounds…

Ubiquitous acoustic sensors and actuators, i.e., microphones and loudspeakers, are among the most common components in consumer electronic devices. Traditionally, these components have been primarily used for sound-related tasks, including voice-user interfaces, sound playback, and sound event detection. However, with the growing demand for…

Listening to music activates representations of movement and social agents. Why? We test whether causal reasoning plays a role, and find that from childhood, people can intuitively reason about how musical sounds were generated, inferring the events and agents that caused the sounds. In Experiment 1 (N = 120, pre-registered), 6-year-old children…

Cross-dimensional interference between spatial and temporal processing provides valuable insights into the neuronal representation of space and time. Previous research has frequently found asymmetric interference patterns, with temporal judgments being more affected by spatial information than vice versa. However, this asymmetry has been…

Background: Students who are blind are integrated into public schools in many countries, yet are often excluded from full participation in science since most learning materials are visual. To create a compensatory route, an existing model-based inquiry-learning environment was adapted by means of sonification (addition of non-speech sounds that…

The use of new digital formats in language learning and testing improves both the learning and acquisition skills development process of language tests. The process of listening comprehension is considered one of the most complex in the field of Computer Aided Learning Language (CALL) because it relates to multimodal learning channels and brain…

Presentation of two kinds of materials in working memory (visual and acoustic), with the requirement to attend to one or both modalities, poses an interesting case for working memory development because competing predictions can be formulated. In two experiments, we assessed such predictions with children 7-13 years old and adults. With…

In an ideal world, classrooms are not designed for and educators are not trained to teach the average student because the average student does not exist. Each student has unique measures, unique strengths, and weaknesses. Universal Design for Learning (UDL) allows teachers to easily accommodate every student; it blurs the lines of special…

Purpose: This study/paper aims to explore civic participation within multimodal expression. With the rise of content produced and circulated within participatory cultures online, there has been much attention raised regarding questions of audience and attention to this content. For example, does production of media content constitute having a…

This paper examines the potential of posthumanism to enable a reconceptualisation of young children's literacies from the starting point of movement and sound in the more-than-human world. We propose movement as a communicative practice that always occurs as a more complex entanglement of relations within more-than-human worlds. Through our…

Much of the evidence provided in support of the argument that mathematical knowing is embodied/enacted is based on the analysis of gestures and bodily configurations, and, to a lesser extent, on certain vocal features (e.g., prosody). However, there are dimensions involved in the emergence of mathematical knowing and the production of mathematical…

This article argues that theoretical understandings of multimodality have enormous potential for assessment purposes in secondary school contexts. Informed by the work of three researchers in three North American high schools, the article offers vignettes of the effective assessment of communicative competence in English classrooms that draws on…

Paper based on experiment 1 which was presented at the Thirteenth Annual Meeting of the Psychonomic Society, St. Louis, Mo., 1972. (RS)

This paper emphasizes research-based reasons for adding audio to multimedia presentations. The first section summarizes suggestions from a review of research on the effectiveness of audio media when accompanied by other forms of media; types of research studies (e.g., evaluation, intra-medium, and aptitude treatment interaction studies) are also…