Advances in Natural Language Processing (NLP) over the past decade have largely been driven by the scale of data and computation used to train large neural network-based models. However, these techniques are inapplicable to the vast majority of the world's languages, which lack the vast digitized text datasets available for English and a few other…

The dream of intelligent assistants to enhance programmer productivity has now become a concrete reality, with rapid advances in artificial intelligence. Large language models (LLMs) have demonstrated impressive capabilities in various domains based on the vast amount of data used to train them. However, tasks which require structured reasoning or…

Second language learners constitute a significant and expanding portion of the global population and there is a growing demand for tools that facilitate language learning and instruction across various levels and in different countries. The development of large language models (LLMs) has brought about a significant impact on the domains of natural…

It is standardly believed that some occurrences of expressions designate singularly, while other occurrences of expressions designate plurally. For instance, the singular expression the student may be used on an occasion to talk about one particular student, while the plural expression the students may be used on an occasion to talk about several…

Automated assessment using Natural Language Processing (NLP) has the potential to make English speaking assessments more reliable, authentic, and accessible. Yet without careful examination, NLP may exacerbate social prejudices based on gender or native language (L1). Current NLP-based assessments are prone to such biases, yet research and…

Naturalistic language learning is contextually grounded. When people learn their first (L1) and often their second (L2) language, they do so in various contexts. In this dissertation I examine the effect of various contexts on language development. Part 1 describes the effects of textual, linguistic context in reading. I employed an eye-tracking…

The past thirty years have shown a rise in models of language acquisition in which the state of the learner is characterized as a probability distribution over a set of non-stochastic grammars. In recent years, increasingly powerful models have been constructed as earlier models have failed to generalize well to increasingly complex and realistic…

Natural language is highly complex and can be challenging for some learners, yet the contribution of complexity to individual differences in language learning remains poorly understood. This poor understanding appears due to both a lack of consensus among researchers regarding what complexity is, and to on-line language research often employing…

To build an Artificial Intelligence system that can assist us in daily lives, the ability to understand the world around us through visual input is essential. Prior studies train visual perception models by defining concept vocabularies and annotate data against the fixed vocabulary. It is hard to define a comprehensive set of everything, and thus…

Dialogue systems, commonly called as Chatbots, have gained escalating popularity in recent times due to their wide-spread applications in carrying out chit-chat conversations with users and accomplishing tasks as personal assistants. These systems are typically trained from manually-labeled data and/or written with handcrafted rules and often, use…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

Dialogue act (DA) classification plays an important role in understanding, interpreting and modeling dialogue. Dialogue acts (DAs) represent the intended meaning of an utterance, which is associated with the illocutionary force (or the speaker's intention), such as greetings, questions, requests, statements, and agreements. In natural language…

The rise of Artificial Intelligence technology has raised concerns about the potential compromise of privacy due to the handling of personal data. Private AI prevents cybercrimes and falsehoods and protects human freedom and trust. While Federated Learning offers a solution by model training across decentralized devices or servers, thereby…

Humans have the remarkable ability to solve different tasks by simply reading textual instructions that define the tasks and looking at a few examples. Natural Language Processing (NLP) models built with the conventional machine learning paradigm, however, often struggle to generalize across tasks (e.g., a question-answering system cannot solve…

Data-driven learning uncontroversially plays a role in human language acquisition--how large a role is a matter of much debate. The success of artificial neural networks in NLP in recent years calls for a re-evaluation of our understanding of the possibilities for learning grammar from data alone. This dissertation argues the case for using…