A critical component of cognitive diagnostic models (CDMs) is a Q-matrix that stipulates associations between items of a test and their required attributes. The present study aims to develop and empirically validate a Q-matrix for the listening comprehension section of the International English Language Testing System (IELTS). To this end, a…

With recent technological advances, researchers have begun to explore the potential use of spoken dialog systems (SDSs) for L2 oral communication assessment. While several studies support the feasibility of building these systems for various types of oral tasks, research on the construct validity of SDS-delivered tasks is still limited. Thus, this…

Despite extensive research on assessing collocational knowledge, valid measures of academic collocations remain elusive. With the present study, we employ an argument-based approach to validate two Academic Collocation Tests (ACTs) that assess the ability to recognize and produce academic collocations (i.e., two-word units such as "key…

With the increasing interest in Positive Psychology within the realm of L2 learning, the role of positive emotions, particularly Foreign Language Enjoyment (FLE) has garnered attention in Second Language Acquisition research (Dewaele & MacIntyre, 2014). Despite the growing interest in FLE in Turkey, the widely used Foreign Language Enjoyment…

Recent AI-based language learning research highlights learners' crucial role, yet university learner readiness in ChatGPT-based English learning remains unexplored. Accordingly, this current research attempted to develop and validate a tool to evaluate university learner readiness for ChatGPT-assisted English learning (LRCEL) to address the…

Many Chinese universities are implementing an educational reform to transform their general English courses into academic English courses. Accordingly, how to assess students' English ability should also be reformed. In this test review, we introduce a school-based general academic English summative test developed by English instructors. An…

The Pearson Test of English Academic (PTE-A), a widely used high-stakes language proficiency test for university admissions and migration purposes, underwent a notable change from a three-hour to a two-hour version in November 2021. The implementation of the new version has prompted inquiries into the washback effects on various stakeholders.…

Prompted by Taiwanese university students' increasing demand for English proficiency assessment, the absence of a test designed specifically for this demographic subgroup, and the lack of a localized and freely-accessible proficiency measure, this project set out to develop and validate a computerized adaptive English proficiency testing (E-CAT)…

An in-depth investigation of vocabulary depth knowledge by lexical researchers plays a prominent role in language learning and teaching. The objectives of the present study were to investigate the extent of relationship and prediction of the three constitutes of vocabulary depth knowledge (i.e., analytic relations, morphological knowledge, and…

In this paper, we investigated the impact of an online classroom-based reading assessment on implementing practices in reading instruction among 30 EFL learners in an intermediate reading course at a public university in East Java, Indonesia. Our study aimed to develop an online classroom-based reading assessment and evaluate its efficacy in…

The purpose of this article is to present qualitative and quantitative tools to assist teachers and authors of examination materials in their preliminary assessment of text complexity/difficulty according to the Common European Framework of Reference for Languages. The qualitative scales were compiled specially for this study, based on previous…

Listening comprehension in English, as one of the most fundamental skills, has an essential role in the process of learning English. Non-parametric item Response Theory (NIRT) is a probabilistic-nonparametric approach to item response theory (IRT) which determines the one-dimensionality and adaptability of test. NIRT techniques are a useful tool…

This study is a conceptual replication of Teimouri et al.'s (2022) investigation into the validity of the second language (L2) grit scale (the L2-Grit scale). There are several concerns about the generalizability of the findings of Teimouri et al. (2022), especially regarding the discriminant validity of the scale and the relation of L2 grit with…

Addressing the lack of English tests that measure critical thinking (CT) abilities of EFL learners, this study aims to develop an English Critical Thinking Test (ECTT) designed to measure the consistency, analysis, and inference CT skills. It is a follow-up to a pilot study to accumulate validity evidence for the use of the ECTT. A total of 262…

This article aims to give a comprehensive guide to planning and designing vocabulary tests which include Identifying the skills to be covered by the test; outlining the course content covered; preparing a table of specifications that shows the skill, content topics and number of questions allocated to each; and preparing the test instructions. The…