This dissertation is about a particular style of research. The philosophy of this style is that in order to scientifically understand deep learning, it is fruitful to investigate what happens when neural networks are trained on simple, mathematically well-defined tasks. Even though the training data is simple, the training algorithm can end up…

The past thirty years have shown a rise in models of language acquisition in which the state of the learner is characterized as a probability distribution over a set of non-stochastic grammars. In recent years, increasingly powerful models have been constructed as earlier models have failed to generalize well to increasingly complex and realistic…

In this thesis, we incorporate information theory into statistical signal processing and machine learning in order to achieve robust learning in presence of outliers (or generally in environments with non-Gaussian structure). In other words, by incorporating information theory especially when structure of environment is non-Gaussian, the…

We are currently in a century of data where massive amount of data are collected and processed every day, and machine learning plays a critical role in automatically processing the data and mining useful information from it for making decisions. Despite the wide and successful applications of machine learning in different fields, the robustness of…

To meet the national and international call for creative and innovative engineers, many engineering departments and classrooms are striving to create more authentic learning spaces where students are actively engaging with design and innovation activities. For example, one model for teaching innovation is Innovation-Based Learning (IBL) where…

This dissertation investigates the soft typology of phonological patterns. By studying the types of patterns observed in the world's languages, we can do more than determine what is attested and what is unattested, or what is possible and what is impossible, but discover a wide range of more gradient phenomena. Phonological patterns range from…

Language is one of the hallmarks of intelligence, demanding explanation in a theory of human cognition. However, language presents unique practical challenges for quantitative empirical research, making many linguistic theories difficult to test at naturalistic scales. Artificial neural network language models (LMs) provide a new tool for studying…

This dissertation describes an experiment to investigate how learners with different levels of background in computer science learn core concepts of computer science, in particular, algorithms. We designed a study to focus on cognitive task analysis for eliciting the empirical mental elements of learning two graph algorithms. Cognitive workload…

The purpose of this action research was to implement a digital game development project and describe its effects on the performance and attitudes of eighth-grade students in a required computer science course at South Carolina School District Alpha. The following research questions were explored: (1) How does the game development project impact…

This dissertation presents various machine learning applications for predicting different cognitive states of students while they are using a vocabulary tutoring system, DSCoVAR. We conduct four studies, each of which includes a comprehensive analysis of behavioral and linguistic data and provides data-driven evidence for designing personalized…

Syntactic structures are unobserved theoretical constructs which are useful in explaining a wide range of linguistic and psychological phenomena. Language acquisition studies how such latent structures are acquired by human learners through many hypothesized learning mechanisms and apparatuses, which can be genetically endowed or of general…