Ambridge calls for exemplar-based accounts of language acquisition. Do modern neural networks such as transformers or word2vec -- which have been extremely successful in modern natural language processing (NLP) applications -- count? Although these models often have ample parametric complexity to store exemplars from their training data, they also…

In 'Against Stored Abstractions,' Ambridge uses neural and computational evidence to make his case against abstract representations. He argues that storing only exemplars is more parsimonious -- why bother with abstraction when exemplar models with on-the-fly calculation can do everything abstracting models can and more -- and implies that his…

Humans can attribute beliefs to others. However, it is unknown to what extent this ability results from an innate biological endowment or from experience accrued through child development, particularly exposure to language describing others' mental states. We test the viability of the language exposure hypothesis by assessing whether models…

Decades of psycholinguistics research have shown that human sentence processing is highly incremental and predictive. This has provided evidence for expectation-based theories of sentence processing, which posit that the processing difficulty of linguistic material is modulated by its probability in context. However, these theories do not make…

Exemplar-based learning requires: (1) a segmentation procedure for identifying the units of past experiences that a present experience can be compared to, and (2) a similarity function for comparing these past experiences to the present experience. This article argues that for a learner to learn a language these two mechanisms will require…

Data-driven learning uncontroversially plays a role in human language acquisition--how large a role is a matter of much debate. The success of artificial neural networks in NLP in recent years calls for a re-evaluation of our understanding of the possibilities for learning grammar from data alone. This dissertation argues the case for using…

This dissertation investigates how bilinguals use their two grammars to comprehend written intra-sentential codeswitches. I focus on adjective/noun constructions in Spanish and English where I manipulate the congruence of grammatical word order in the two languages across the codeswitch boundary. This allows me to test three codeswitching…

Language is one of the hallmarks of intelligence, demanding explanation in a theory of human cognition. However, language presents unique practical challenges for quantitative empirical research, making many linguistic theories difficult to test at naturalistic scales. Artificial neural network language models (LMs) provide a new tool for studying…

The work of connectionist researchers is examined in order to understand better the implications for modeling second language learning processes. Connectionism is a biologically-oriented framework for understanding complex behavior, and provides a modeling tool (computer simulation) that behaves and learns without rules being explicitly wired into…

Consisting of two separate papers, "Representational Issues in Systemic Functional Grammar," by Christian Matthiessen and "Systemic Grammar and Functional Unification Grammar," by Robert Kasper, this document deals with systemic aspects of natural language processing and linguistic theory and with computational applications of…

Taking the lexicogrammatical resources (i.e. the vocabulary and syntax) of English as a starting point, this report explores the demands those resources put on the design of the part of a text generation system that supports the process of lexicogrammatical expression. The first section of the report notes that a reason for using the lexicogrammar…

Four conference papers on discourse are included. In "How Context Contributes to the Interpretation of Temporal Expressions," Carlota S. Smith provides a summary analysis of the temporal interpretation of English sentences. Many sentences are shown to be semantically incomplete; it is argued that information from neighboring sentences is…

It is proposed that research on neurological organization, cognitive psychology, and artificial intelligence can contribute to understanding the relationship between second language learning processes and academic achievement. Relevant research in these areas and in the field of neurolinguistics is reviewed, with several themes or topics…