My multi-article dissertation explores the utility of immersive media like Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR) in design learning and education, particularly as we recover from the social, technological, and cultural disruptions caused by the COVID-19 global pandemic. Chapter 2 clarifies how the multiple modalities…

A challenge for the virtual reality (VR) industry is facing is that VR is not immersive enough to make people feel a genuine sense of presence: the low frame rate leads to dizziness and the lack of human body visualization limits the human-computer interaction. In this dissertation, I present our research on enhancing visual and gestural fidelity…

The presence of Animated Pedagogical Agents (APAs) in education is increasing day-by-day. They are being used in online courses as well as research studies. Therefore, there is a need to study ways in which lectures can quickly be created using APAs. Gestures are an inseparable part of an APA's communication with users. Gestures generated…

Developing technology to help people teach and learn is an important topic in Human Computer Interaction (HCI). In this thesis we present three studies on this topic. In the first study, we demonstrate new games for learning mathematics and discuss the evidence for key design decisions from user studies. In the second study, we develop a real-time…

Embodied conversational agents (ECAs) have been used as virtual conversational partners in interpersonal skills training applications such as medical interviews, military decision making, and cultural training. Ideally, in interpersonal skills training users will perceive and treat the ECAs the same as they would real people. The perception and…

In this dissertation, I explore unsupervised techniques for the task of automatic short answer grading. I compare a number of knowledge-based and corpus-based measures of text similarity, evaluate the effect of domain and size on the corpus-based measures, and also introduce a novel technique to improve the performance of the system by integrating…

In many evolving systems, inputs can be derived from both human observations and physical sensors. Additionally, many computation and analysis tasks can be performed by either human beings or artificial intelligence (AI) applications. For example, weather prediction, emergency event response, assistive technology for various human sensory and…

This dissertation studies how people describe emotions with language and how computers can simulate this descriptive behavior. Although many non-human animals can express their current emotions as social signals, only humans can communicate about emotions symbolically. This symbolic communication of emotion allows us to talk about emotions that we…