Human language is an incredibly rich yet incredibly constrained system. Learning and generalizing these systematic constraints from small, sparse, and underspecified data presents a fundamental inference problem. Therapidity and ease by which humans learn these constraints has made this a foundational study in cognitive science, linguistics, and…

The past thirty years have shown a rise in models of language acquisition in which the state of the learner is characterized as a probability distribution over a set of non-stochastic grammars. In recent years, increasingly powerful models have been constructed as earlier models have failed to generalize well to increasingly complex and realistic…

Advances in Natural Language Processing (NLP) over the past decade have largely been driven by the scale of data and computation used to train large neural network-based models. However, these techniques are inapplicable to the vast majority of the world's languages, which lack the vast digitized text datasets available for English and a few other…

This study explores using transfer learning in machine learning for natural language processing (NLP) to create generic automated essay scoring (AES) models, providing instant online scoring for statewide writing assessments in K-12 education. The goal is to develop an instant online scorer that is generalizable to any prompt, addressing the…

It is standardly believed that some occurrences of expressions designate singularly, while other occurrences of expressions designate plurally. For instance, the singular expression the student may be used on an occasion to talk about one particular student, while the plural expression the students may be used on an occasion to talk about several…

Data-driven learning uncontroversially plays a role in human language acquisition--how large a role is a matter of much debate. The success of artificial neural networks in NLP in recent years calls for a re-evaluation of our understanding of the possibilities for learning grammar from data alone. This dissertation argues the case for using…

Dialogue act (DA) classification plays an important role in understanding, interpreting and modeling dialogue. Dialogue acts (DAs) represent the intended meaning of an utterance, which is associated with the illocutionary force (or the speaker's intention), such as greetings, questions, requests, statements, and agreements. In natural language…

Automated assessment using Natural Language Processing (NLP) has the potential to make English speaking assessments more reliable, authentic, and accessible. Yet without careful examination, NLP may exacerbate social prejudices based on gender or native language (L1). Current NLP-based assessments are prone to such biases, yet research and…

Second language learners constitute a significant and expanding portion of the global population and there is a growing demand for tools that facilitate language learning and instruction across various levels and in different countries. The development of large language models (LLMs) has brought about a significant impact on the domains of natural…

Dialogue systems, commonly called as Chatbots, have gained escalating popularity in recent times due to their wide-spread applications in carrying out chit-chat conversations with users and accomplishing tasks as personal assistants. These systems are typically trained from manually-labeled data and/or written with handcrafted rules and often, use…

"Natural language understanding" (NLU) of text is a fundamental challenge in AI, and it has received significant attention throughout the history of NLP research. This primary goal has been studied under different tasks, such as Question Answering (QA) and Textual Entailment (TE). In this thesis, we investigate the NLU problem through…

Through colonialism, external forces can alter and shift social structures and practices. It causes trans-generational, often normalized, invisible, and profound marginalization of the collective identities of local and indigenous populations. Decolonization is the resisting and undoing of colonial impacts. It's the process of reforming a…

While information theory is typically considered in the context of modern computing and engineering, its core mathematical principles provide a potentially useful lens through which to consider human language. Like the artificial communication systems such principles were invented to describe, natural languages involve a sender and receiver, a…

Quantifier scope disambiguation (QSD) is one of the most challenging problems in deep natural language understanding (NLU) systems. The most popular approach for dealing with QSD is to simply leave the semantic representation (scope-) underspecified and to incrementally add constraints to filter out unwanted readings. Scope underspecification has…

Our language changes very rapidly, accompanying political, social and cultural trends, as well as the evolution of science and technology. The Internet, especially the social media, has accelerated this process of change. This poses a severe challenge for both human beings and natural language processing (NLP) systems, which usually only model a…