This guide offers a comprehensive handbook to scientific research methodology and experimental design, specifically for novice MA and PhD researchers in Education and Language Learning (TESOL/TEFL). It establishes scientific research as a systematic, objective inquiry focused on identifying cause-and-effect relationships through empirical data.…

This study introduces the first Arabic Vocabulary Levels Test (Arabic-VLT), created for foreign learners of Arabic. We present compelling evidence to substantiate its validity and reliability. The Arabic-VLT was developed according to five levels, beginning with the most frequently used words (Level 1) to the least frequently used ones (Level 5),…

This book addresses the validity of think-aloud protocols (TAPs) in L2 writing research through a mixed methods study and proposes effective approaches for their valid implementation. The book uncovers the reactive effects that TAPs have on L2 writing performance and processes, and examines how individual factors moderate this reactivity. It…

In this article, we consolidate and present in one place what is known about quality indicators for setting standards so that stakeholders may be able to recognize the signs of standard-setting quality. We use the context of setting standards to associate English language test scores with language proficiency descriptions such as those presented…

This article outlines a researcher's struggles with conducting "ethical" research when her case study reveals racializations faced by a minority teacher in a Canadian ESL program. How might becoming privy to research participants' experiences of inequity in ESL education complicate the notion of research ethics when "doing the right…

In second language acquisition (SLA) research, two types of second language (L2) knowledge, explicit and implicit, have been discussed for almost three decades. Although many SLA researchers agree that L2 instruction should give priority to implicit knowledge, researchers have not agreed on what type of test (e.g., oral narrative test and timed…

Changes to research methodology motivated by the adoption of a complexity theory perspective on language development are considered. The dynamic, nonlinear, and open nature of complex systems, together with their tendency toward self-organization and interaction across levels and timescales, requires changes in traditional views of the functions…

Two methods of researching second language learning are described, analyzed, and compared: student diaries giving a first-person account of the second language learning experience; and participant observation, in which the observer is in the language learning situation recording in descriptive terms all possible data about the situation.…

Since the numbers of foreign students aspiring to college and graduate degrees in the United States is increasing, there is a need for a reliable and valid English proficiency test which, ideally, would be neither costly nor time consuming. The purpose of this study was twofold. First, the extent to which three tests, the Michigan Test of English…

This report describes the development, construction, and validation of the Preliminary Chinese Proficiency Test (Pre-CPT), a standardized, nationally-normed test of listening and reading comprehension for beginning-level native English-speaking learners of Chinese as a second language. The Pre-CPT was designed as a lower-level version of the…

Forty studies using one or more components of Lozanov's method of suggestive-accelerative learning and teaching were identified from a search of all issues of the "Journal of Suggestive-Accelerative Learning and Teaching." Fourteen studies contained sufficient statistics to compute effect sizes. The studies were coded according to substantive and…

A dilemma arises in the attempt to establish procedures for valid assessment of academic learning. Measures of learning with high pedagogical validity often have poor psychometric properties. Conversely, tests that are well-constructed by psychometric standards may succeed in sorting and ordering students or schools, but have little pedagogical…

In this article, we have examined how historical events shape the research process, even when research is carefully planned and rigorously executed. Through an examination of our experiences conducting international data collection during a three-year SSHRC funded period in which the War on Terrorism and the War in Iraq began, we suggest that…