In this digital age, digital multimodal composing (DMC) has permeated the L2 classroom as a technology-enhanced L2 writing task. Despite the learning potential of DMC for L2 students, instruments that measure L2 students' DMC competence are rare. As such, the present study sought to develop and validate an L2 student DMC competence scale in the…

Studies have shown that raising L2 learners' metaphor awareness contributes to the acquisition of figurative language, which fosters students' development of language skills. However, the instruments measuring metaphor awareness, in the majority of relevant research, did not seem to have undergone proper methodological procedures for checking…

The Pearson Test of English Academic (PTE-A), a widely used high-stakes language proficiency test for university admissions and migration purposes, underwent a notable change from a three-hour to a two-hour version in November 2021. The implementation of the new version has prompted inquiries into the washback effects on various stakeholders.…

With the increasing interest in Positive Psychology within the realm of L2 learning, the role of positive emotions, particularly Foreign Language Enjoyment (FLE) has garnered attention in Second Language Acquisition research (Dewaele & MacIntyre, 2014). Despite the growing interest in FLE in Turkey, the widely used Foreign Language Enjoyment…

Several high-stakes English proficiency tests including but not limited to IELTS, PTE Academic, and TOEFL iBT recommend a 2-year time limit on validity for score usage. Although this timeframe provides a useful rule-of-thumb for the recency of testing, it can have far-reaching consequences. In response to stakeholder queries around IELTS validity…

The growing diversity among test takers in second or foreign language (L2) assessments makes the importance of fairness front and center. This systematic review aimed to examine how fairness in L2 assessments was evaluated through differential item functioning (DIF) analysis. A total of 83 articles from 27 journals were included in a systematic…

Language assessment is a central aspect not only of language education in the general population, but also amongst heterogeneous, low-incidence populations. One such population are immigrant deaf and hard-of-hearing learners (IDML) who are bimodal-multilingual and whose languages development often includes the spoken, written, and/or signed…

Chulalongkorn University Language Institute (CULI) test was developed as a local standardised test of English for professional and international communication. To ensure that the CULI test fulfils its intended purposes, this study employed Kane's argument-based validation and Rasch measurement approaches to construct the validity argument for the…

This guide offers a comprehensive handbook to scientific research methodology and experimental design, specifically for novice MA and PhD researchers in Education and Language Learning (TESOL/TEFL). It establishes scientific research as a systematic, objective inquiry focused on identifying cause-and-effect relationships through empirical data.…

Focusing efficiently on potential weaknesses in the validity argument of writing assessments--such as writing subjectivity, content coverage, criteria vagueness, and raters' incompetence--has been shown to positively enhance teachers' overall writing assessment competence (AC). In this study, we propose a computational bootstrapping model of…

This study explores the validity of the Culturally Responsive Instruction Observation Protocol (CRIOP) an instrument that measures the implementation of culturally responsive instruction (CRI) in K-8 classrooms with multilingual students. The validity study uses a Rasch measurement approach. With strong findings from analyses, including…

In this paper, we investigated the impact of an online classroom-based reading assessment on implementing practices in reading instruction among 30 EFL learners in an intermediate reading course at a public university in East Java, Indonesia. Our study aimed to develop an online classroom-based reading assessment and evaluate its efficacy in…

This study examined the semantic features of the simulated mini-lectures in the listening sections of the International English Language Testing System (IELTS) and the Test of English as a Foreign Language (TOEFL) based on automatized semantic analysis to explore the content validity of the two tests. Two study corpora were utilized, the IELTS…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

Researchers have been investigating motivation to learn second (L2) and foreign (FL) languages for decades, starting with the socio-educational model, moving on to the multi-dimensional model of motivational variables, and currently incorporating the complex dynamic system theory (CDST). The study examined changes in Dörnyei's L2 Motivational…