This guide offers a comprehensive handbook to scientific research methodology and experimental design, specifically for novice MA and PhD researchers in Education and Language Learning (TESOL/TEFL). It establishes scientific research as a systematic, objective inquiry focused on identifying cause-and-effect relationships through empirical data.…

Statistical tests carry with them a number of assumptions that must be checked. Failing to do so and to report the results of such preliminary analyses introduce a potential threat to the internal validity of a study and to our ability as consumers to put faith in study findings. This article systematically examines the reporting of checks on…

First, we trace the history of second language acquisition (SLA) from early stages in the mid-twentieth century to today. We next consider the status of the field in today's research world with a particular focus on all aspects of methodology and, finally, we take a look at the future and discuss issues related to scientific rigor in light of Open…

This article explores the theoretical foundations of qualitative research in online language learning. It will look at the distinction between offline and online language learning and discuss whether different ways of knowledge generation are appropriate for those different learning environments. Quantitative and qualitative methodologies will be…

Adequate reporting of quantitative research about language learning involves careful consideration of the logic, rationale, and actions underlying both study designs and the ways in which data are analyzed. These guidelines, commissioned and vetted by the board of directors of "Language Learning," outline the basic expectations for…

Traditions of statistical significance testing in second language (L2) quantitative research are strongly entrenched in how researchers design studies, select analyses, and interpret results. However, statistical significance tests using "p" values are commonly misinterpreted by researchers, reviewers, readers, and others, leading to…

Ensuring internal validity in quantitative research requires, among other conditions, reliable instrumentation. Unfortunately, however, second language (L2) researchers often fail to report and even more often fail to interpret reliability estimates beyond generic benchmarks for acceptability. As a means to guide interpretations of such estimates,…

Second language acquisition researchers often face particular challenges when attempting to generalize study findings to the wider learner population. For example, language learners constitute a heterogeneous group, and it is not always clear how a study's findings may generalize to other individuals who may differ in terms of language background…

Good practice in primary research has evolved over many decades of research in applied linguistics to counter human fallibility and biases. Surprisingly, perhaps, synthesising such research in an entire field has only recently started to develop its own methodologies and recommendations. This paper outlines some of the issues involved, especially…

Parametric analyses such as t tests and ANOVAs are the norm--if not the default--statistical tests found in quantitative applied linguistics research (Gass 2009). Applied statisticians and one applied linguist (Larson-Hall 2010, 2012; Larson-Hall and Herrington 2010), however, have argued that this approach may not be appropriate for small samples…

This paper presents a set of guidelines for reporting on five types of quantitative data issues: (1) Descriptive statistics, (2) Effect sizes and confidence intervals, (3) Instrument reliability, (4) Visual displays of data, and (5) Raw data. Our recommendations are derived mainly from various professional sources related to L2 research but…

The interaction between heritage language (HL) and ethnic identity has gained increasing scholarly attention over the past decades. Numerous quantitative studies have investigated and vindicated this interaction within certain contexts. Nevertheless, quantitative evidence on this interaction across contexts is absent to date. The current…

Research synthesis and meta-analysis provide a pathway to bring together findings in a given domain with greater systematicity, objectivity, and transparency than traditional reviews. The same techniques and corresponding benefits can be and have been applied to examine methodological practices in second language (L2) research (e.g., Plonsky,…

This study aimed to analyze curriculum evaluation studies conducted in foreign language education between the years 2005 and 2016 in terms of the levels the studies were conducted in, sample groups, sample size, research methods and curriculum evaluation models via descriptive content analysis. Searching various data bases, 87 studies, which are…

In empirical applied linguistics research it is essential that the key variables are operationalized in a valid and reliable way, and that the scores are treated appropriately, allowing for a proper testing of the hypotheses under investigation. The current article addresses several theoretical and practical issues regarding the use of measurement…