This research consists of an eye-tracking study examining the efficacy of eye gaze indexing (EGIX) in manipulating viewer eye gaze and enhancing second language (L2) fingerspelling comprehension in American Sign Language (ASL) through a controlled laboratory experiment. The study consisted of two groups and two conditions, EGIX+/EGIX- to test the…

Researchers have investigated the promise of unimodal and bimodal input in enhancing vocabulary learning from meaning-focused activities. Compared to unimodal input, the simultaneous presentation of written and aural input in bimodal input has been argued to direct L2 learners' attention to words and enhance the form-meaning links for new…

This dissertation provides evidence that reading is best explained as rational gathering of visual information to identify words efficiently. Although empirical evidence from human reading research suggests a close link between eye movements and cognitive process, it is not clear how readers decide when and where to move their eyes as a function…

The tantalizing prospects of learning benefits from multimodal conditions on second language (L2) learning in general, and L2 vocabulary development in particular, have important implications. Indeed, opening a language learning app on any device provides the immediate experience of simultaneous input modalities, and a wide range of input types.…

Emojis are nonverbal elements used in text-based communication that may function like gestures in spoken communication (Feldman et al., 2017; McCulloch & Gawne, 2018). Like words, emojis can convey semantic information and support message comprehension (Lo, 2008; Riordan, 2017b). Nevertheless, the cognitive and perceptual processes involved in…

For Chinese students, studying in a country with different cultural components and language structures is challenging. Compared to English, the Chinese prefers shorter and simple sentence structure and allows for two sentences to be stated side by side. Different sentence structures in Chinese may influence native-Chinese readers' understanding of…

New forms of visualizations are transforming how people interact with data. This dissertation explored how undergraduates learn with infographics. The following questions guided this research: (i) What do we know about the factors influencing the processing of data visualizations? (ii) How do task-level and learner-level characteristics impact the…

Individuals with aphasia (IWA) often exhibit challenges in single word reading as well as in reading comprehension. Recently, eye-tracking technology has become instrumental in delving deeper into reading behaviors. Specifically, it has illuminated the differences in word reading and comprehension abilities among aphasic English speakers. However,…

The purpose of the current study was to better understand performance variability in sentence comprehension in people with aphasia, compared to a control group of adults. People with aphasia often have difficulty understanding sentences that are complex in structure and meaning. Comprehension difficulty is variable, which may confound the clinical…

Skilled hearing readers activate phonological, orthographic, and semantic representations in order to recognize and comprehend words. However, deaf readers may achieve reading comprehension by different means. More specifically, enhanced visual attention, reduced access to phonology, and bimodal bilingualism may influence how deaf readers…

With the growing trend of using multimedia platforms such as YouTube to facilitate storytelling, understanding how and when to integrate text with visuals would benefit both the creators of these platforms and the young readers viewing them. The current study examined the effect of orthography on vocabulary acquisition and narrative comprehension…

This thesis explores how predictions about upcoming language inputs are computed during real-time language comprehension. Previous research has demonstrated humans' ability to use rich contextual information to compute linguistic prediction during real-time language comprehension, and it has been widely assumed that contextual information can…

Because many words of a language have more than one meaning, readers regularly need to disambiguate words during sentence comprehension. Using priming, eye-tracking, and event-related brain potentials, this thesis tested whether readers differently disambiguate words with semantically related meanings like "wire" and "cone,"…

Understanding how short-term memory shapes sentence comprehension processes is a long-standing topic in psycholinguistics. This thesis pursues new insights on two facets of short-term memory's role in sentence comprehension: (a) The first four experiments search for, and obtain, concrete evidence that locality effects, or increased integration…

Moving one's eyes while reading is one of the most complex everyday tasks humans face. To perform efficiently, readers must make decisions about when and where to move their eyes every 200-300ms. Over the past decades, it has been demonstrated that these fine-grained decisions are influenced by a range of linguistic properties of the text, and…