This guide offers a comprehensive handbook to scientific research methodology and experimental design, specifically for novice MA and PhD researchers in Education and Language Learning (TESOL/TEFL). It establishes scientific research as a systematic, objective inquiry focused on identifying cause-and-effect relationships through empirical data.…

Pragmatics has been a key component of language competence frameworks. While the majority of second/foreign language (L2) pragmatics tests have targeted productive skills, the assessment of receptive pragmatic skills remains a developing field. This study explores validation evidence for a test of receptive L2 pragmatic ability called the American…

Graduate admission has become a critical process in tertiary education, whereby selecting valid admissions instruments is key. This study assessed the validity of Graduate Record Examination (GRE) General Test scores for admission to Master's programmes at a technical university in Europe. We investigated the indicative value of GRE scores for the…

This article reports on the updating and validation of a questionnaire for vocabulary learning strategies. An English as a second language (ESL) version of the "Vocabulary Learning Questionnaire" (VLQ), first published in Gu and Johnson (1996), was created based on its latest version. Two response formats were piloted, that is, a paper…

English language programmes provide established pathways for international students seeking university admission in countries such as Australia and the United Kingdom. In order to refer international applicants to appropriate levels and durations of English language support prior to matriculation into their main course of study, pathway providers…

This report presents a review of the statistical practices of 30 journals representative of the second language field. A review of 150 articles showed a number of prevalent statistical violations including incomplete reporting of reliability, validity, non-significant results, effect sizes, and assumption checks as well as making inferences from…

Elicited imitation (EI) has been widely used to examine second language (L2) proficiency and development and was an especially popular method in the 1970s and early 1980s. However, as the field embraced more communicative approaches to both instruction and assessment, the use of EI diminished, and the construct-related validity of EI scores as a…

Frustrations with traditional testing led a group of teachers at the English for adults program at Universidad EAFIT (Colombia) to design tests aligned with the institutional teaching philosophy and classroom practices. This article reports on a study of an item-by-item evaluation of a series of English exams for validity and reliability in an…

Researchers have been keen to develop instruments for the assessment of teachers' self-perceived technological pedagogical content knowledge (TPACK); however, few studies have been conducted to validate such assessment tools through students' perspectives in the context of English as a foreign language (EFL). The purpose of this study was thus to…

Creativity, although it had existed since the existence of humanity, nowadays it is gaining more and more importance. In this process, creativity have been addressed in a variety of ways such as the studies of development on creativity and determination of the level of creativity. For this reason some scales or tests have been developed. Developed…

K-12 English language proficiency tests that assess multiple content domains (e.g., listening, speaking, reading, writing) often have subsections based on these content domains; scores assigned to these subsections are commonly known as subscores. Testing programs face increasing customer demands for the reporting of subscores in addition to the…

A fundamental challenge to understanding effects of foreign language anxiety on the foreign language learning lies in implementing reliable and valid measures. Considering importance of measurement bias and widespread usage of the foreign language classroom anxiety scale (FLCAS) in education, the aim of the current study was to detect differential…

Pseudowords (words that are not real but resemble real words in a language) have been used increasingly as a technique to reduce contamination due to construct-irrelevant variance in assessments of verbal fluid reasoning (Gf). However, despite pseudowords being researched heavily in other psychology sub-disciplines, they have received little…

The present study aimed at constructing a formative assessment inventory for assessing EFL instructors' conception and literacy about the issue under study. Therefore, 302 male and female Iranian EFL teachers took part in the study in a random way to fill out the researcher made questionnaire. The first draft of the scale consisted of two main…

This study had two aims. The first was to explain the process of using the Rasch measurement model to validate tests in an easy-to-understand way for those unfamiliar with the Rasch measurement model. The second was to validate two final exams with several shared items. The exams were given to two groups of students with slightly differing English…