In this Methods Showcase Article, we outline a workflow for running behavioral experiments online, with a focus on experiments that rely on presentation of complex stimuli and measurement of reaction times, which includes many psycholinguistic experiments. The workflow that we describe here relies on three tools: OpenSesame/OSWeb (open source)…

We present a review of second language researchers' use of cluster analysis, an advanced statistical method still uncommon but increasingly used to identify groups or patterns in a dataset and to examine group differences. After describing key methodological considerations in conducting cluster analysis, we present a methodological synthesis of 65…

Multisite research (MSR) offers the key advantages of greater statistical power and external validity via larger and more diverse participant pools. In second language acquisition (SLA) research, recent developments in meta-analysis have created a robust foundation for MSR. Although logistical and financial obstacles can complicate expansion…

This article presents a theoretical review of and methodological guidelines for the study of two key notions in second language acquisition research, complexity and difficulty. The term "complexity" has gained considerable currency over the past decades and has taken on a wide range of meanings. We argue for a more restricted…

Research on anxiety and motivation in second language (L2) learning is proliferating. However, these two individual differences are commonly measured by self-report questionnaires, the psychometric properties of which have been questioned. Building on previous works on study quality, this methodological synthesis systematically describes and…

In this Methods Showcase Article, we highlight a qualitative research methodology called "netnography," an adaptation of ethnography and ethnographic methods applied to researching digital/online communities. We briefly discuss how netnography has evolved from its origins in the fields of consumer research and marketing to its more…

Researchers often make claims regarding the importance of predictor variables in multiple regression analysis by comparing standardized regression coefficients (standardized beta coefficients). This practice has been criticized as a misuse of multiple regression analysis. As a remedy, I highlight the use of dominance analysis and random forests, a…

Open research practices are relevant to all stages of research, from conceptualization through dissemination. Here, we discuss key facets of open research, highlighting its rationales, infrastructures, behaviors, and challenges. Part I conceptualizes open research and its rationales. Part II identifies challenges such as the speed and cost of open…

Does complexity make multilingualism special? Since there is no unequivocal notion of complexity on which researchers agree, several characteristics that have been considered crucial for complexity are brought to bear on multilingualism. While multilingualism is fairly complex in some senses, for instance, because it requires that many variables…

We conducted a multisite replication study with aspects of preregistration in order to explore the feasibility of such an approach in second language (L2) research. To this end, we addressed open questions in a line of research that has examined whether having learners attend to form while reading or listening to a L2 passage interferes with…

Hu and Nation's (2000) study, which stipulated that second language (L2) readers need to be familiar with 98% of lexical items for adequate text comprehension, has become highly influential in L2 vocabulary research and pedagogy. However, the 98% critical threshold figure is based on findings from a research project in which a regression analysis…

Second language acquisition (SLA) research offers valuable insight on how languages are learned and how they coexist and influence each other. Sign language learners offer unique perspectives on SLA, allowing researchers to test theories that are otherwise constrained by access to only one modality. Current literature on sign language learning…

Despite its critical role for the development of the field, little is known about replication in second language (L2) research. To better understand replication practice, we first provide a narrative review of challenges related to replication, drawing on recent developments in psychology. This discussion frames and motivates a systematic review,…

This paper introduces the Lang-Track-App, a smartphone application and backend system to aid second language acquisition researchers in implementing the experience sampling method (ESM). Surveying research participants with the Lang-Track-App multiple times per day can yield exceptionally rich data that can be analyzed in multiple ways. This…

Stern (1983) reminds us of the ethical reasons for doing second language (L2) research. That is, given the considerable human and financial investments that go into language education, the practical activities of teaching "should not exclusively rely on tradition, opinion, or trial-and-error but should be able to draw on rational enquiry,…