Teaching pragmatics is crucial in the teaching of English as a foreign language (EFL) since it is one of the primary indications of successfully and appropriately communicating in a target language. To our knowledge, there are not many studies on teaching pragmatics and no thoroughly designed measurement tools to investigate the perspectives of…

Studies have shown that raising L2 learners' metaphor awareness contributes to the acquisition of figurative language, which fosters students' development of language skills. However, the instruments measuring metaphor awareness, in the majority of relevant research, did not seem to have undergone proper methodological procedures for checking…

Chulalongkorn University Language Institute (CULI) test was developed as a local standardised test of English for professional and international communication. To ensure that the CULI test fulfils its intended purposes, this study employed Kane's argument-based validation and Rasch measurement approaches to construct the validity argument for the…

Focusing efficiently on potential weaknesses in the validity argument of writing assessments--such as writing subjectivity, content coverage, criteria vagueness, and raters' incompetence--has been shown to positively enhance teachers' overall writing assessment competence (AC). In this study, we propose a computational bootstrapping model of…

This study investigates the validity and reliability of generative large language models (LLMs), specifically ChatGPT and Google's Bard, in grading student essays in higher education based on an analytical grading rubric. A total of 15 experienced English as a foreign language (EFL) instructors and two LLMs were asked to evaluate three student…

Researchers have been investigating motivation to learn second (L2) and foreign (FL) languages for decades, starting with the socio-educational model, moving on to the multi-dimensional model of motivational variables, and currently incorporating the complex dynamic system theory (CDST). The study examined changes in Dörnyei's L2 Motivational…

This study introduces the first Arabic Vocabulary Levels Test (Arabic-VLT), created for foreign learners of Arabic. We present compelling evidence to substantiate its validity and reliability. The Arabic-VLT was developed according to five levels, beginning with the most frequently used words (Level 1) to the least frequently used ones (Level 5),…

Although examining teachers' various areas of knowledge in classroom practices has attracted considerable attention during recent decade, a short multidimensional questionnaire to assess the interactions of the knowledge domains with teachers' technological knowledge is unavailable in the literature. Thus, this research presents a self-assessment…

Self-regulation skill is the ability of an individual to plan, monitor, evaluate, and modify their learning process when necessary. It is highly important in foreign language learning because learning a language requires long-term motivation, discipline, and a strategic approach. This study aims to determine the level of high school students' use…

The performance decision tree (PDT; Fulcher et al., 2011) is a rubric style that is applicable to performance assessment, with origins in Upshur and Turner's (1995) empirically derived binary-choice, boundary-definition (EBB) scale. It is easier for raters to assess performance by evaluating multiple binary-choice descriptors. Additionally,…

Studies on Global Englishes (GE)-related pedagogical and curricular innovations emphasize the importance of exposing students to the diversity of English and its users. However, they do not provide direct evidence of changes in students' attitudes. The reliability and validity of existing quantitative instruments for measuring students' attitudes…

This study employed a multi-methods design to investigate the impact of preparation on Chinese test-takers' perceptions of the integrated TOEFL iBT speaking and writing design. Combining results from over 1700 surveys and 10 interviews, it was found that these Chinese test-takers, who are the most vulnerable group in the multimillion testing…

The textbook used for fifth grade elementary students in an elementary school in Kuningan, West Java claims to offer Higher Order Thinking Skill (HOTS) questions on the cover of the textbook and some questions have been labeled as HOTS questions. This research investigated the validity of this claim, analyzing the levels of cognitive domain of…

As artificial intelligence (AI) technology continues to advance, its influences across various industries have grown, leading to increasing levels of anxiety, including that in education. Nonetheless, in terms of current knowledge, the literature lacks a valid scale to measure AI anxiety among EFL teachers, particularly university EFL teachers.…

IELTS is a widely accepted English language proficiency test, required for academic and professional purposes. In this study, we examined the relationship between IELTS and the English proficiency skills of international students. We developed a proximal mediation model based on Bandura's triadic reciprocal determinism theory and tested it using…