Teaching pragmatics is crucial in the teaching of English as a foreign language (EFL) since it is one of the primary indications of successfully and appropriately communicating in a target language. To our knowledge, there are not many studies on teaching pragmatics and no thoroughly designed measurement tools to investigate the perspectives of…

The notion of validity encapsulates the echo of the physical within the technical. The technical force of a language course, test or plan needs to be evaluated for its effects. On the norm side, this yields a design principle that asks whether the design is adequate, and can be validated. That kind of technical validation is perhaps most prominent…

Studies have shown that raising L2 learners' metaphor awareness contributes to the acquisition of figurative language, which fosters students' development of language skills. However, the instruments measuring metaphor awareness, in the majority of relevant research, did not seem to have undergone proper methodological procedures for checking…

To determine the effects of explicit instruction (EI) and potential moderators in second/foreign language (L2) teaching, this study meta-analyzed 28 primary reports (a total of 67 unique samples, N = 3754). The main results show that EI was significantly effective in facilitating L2 development, with effect sizes ranging from moderate to large…

Recent literature in the field of L2 vocabulary assessment has advocated for the development of written receptive vocabulary tests such as Vocabulary Levels Tests (VLTs) that use: (a) meaning-recall item formats, (b) a minimum of 40 item counts per 1,000-frequency band to improve level estimates, and (c) lemmas (not word-families) as the lexical…

Chulalongkorn University Language Institute (CULI) test was developed as a local standardised test of English for professional and international communication. To ensure that the CULI test fulfils its intended purposes, this study employed Kane's argument-based validation and Rasch measurement approaches to construct the validity argument for the…

Focusing efficiently on potential weaknesses in the validity argument of writing assessments--such as writing subjectivity, content coverage, criteria vagueness, and raters' incompetence--has been shown to positively enhance teachers' overall writing assessment competence (AC). In this study, we propose a computational bootstrapping model of…

Since the original and adapted versions of the scales that aim to measure foreign language enjoyment may not be appropriate for learners with low English proficiency levels, it seems necessary to develop scales in their native languages. This study aims to create a valid and reliable scale of foreign language learning enjoyment that can be applied…

The article introduces triangulation to converge evidence from corpus and experimental data, by means of two case studies in second language (L2) learners of Greek. The first case study investigates the acquisition of gender agreement, while the second probes the development of relative clauses. In both studies, findings from the corpus are tested…

Although lexical diversity is often used as a measure of productive proficiency (e.g., as an aspect of lexical complexity) in SLA studies involving oral tasks, relatively little research has been conducted to support the reliability and/or validity of these indices in spoken contexts. Furthermore, SLA researchers commonly use indices of lexical…

This article describes a new questionnaire, the "Diagnostic Inventory for Self-Regulated Language Learning" (DISLL), for assessing self-regulated learning strategies of students of English as an additional language. We discuss self-regulated learning models, evaluate existing questionnaires for assessing language learners' self-regulated…

Through design and development research (DDR), we aimed to create a validated automatic question generation (AQG) system using large language models (LLMs) like ChatGPT, enhanced by prompting engineering techniques. While AQG has become increasingly integral to online learning for its efficiency in generating questions, issues such as inconsistent…

Smartphones and the literacy to harness the educational affordances of photographs currently rest on the bedrock of second language (L2) education. Building on social semiotic theory, this study developed and validated a visual literacy scale for smartphone photography (VLS4SP). Despite the importance of visuals and smartphones, no valid scale is…

Motivated by the "emotional turn" in applied linguistics and the recent introduction of positive psychology in L2 studies, the present study aimed to validate and shorten the Achievement Emotions Questionnaire (AEQ) for measuring positive emotions in foreign language learning and classroom settings. To this end, data were collected from…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…