A critical component of cognitive diagnostic models (CDMs) is a Q-matrix that stipulates associations between items of a test and their required attributes. The present study aims to develop and empirically validate a Q-matrix for the listening comprehension section of the International English Language Testing System (IELTS). To this end, a…

This study represents the inaugural attempt at assessing the authenticity of the tasks encompassed in the IELTS Speaking Module. The evaluation is conducted from the vantage points of applied linguistics and general education, and serves to enhance comprehension of authenticity and authentic assessment. In order to achieve this objective, an…

Large-scale standardized ESL tests such as the International English Language Testing System (IELTS) are widely used around the world to measure the language proficiency of test-takers and make different decisions based on their scores. Reading comprehension is an integral part of such tests which requires test-takers to read passages and answer a…

High stakes testing, such as IELTS, is designed to select individuals for decision-making purposes (Fulcher, 2013b). Hence, there is a slow-growing stream of research investigating the subskills of IELTS listening and, in feedback terms, its effects on individuals and educational programs. Here, cognitive diagnostic assessment (CDA) performs it…

This study presents empirical evidence for the hypothesis that reading purpose may impact upon the cognitive processes that L2 readers use in comprehending a text. 25 advanced learners of English were put into two purpose groups--testing condition (TC) and learning condition (LC). The participants in the TC read two expository passages and…

Research shows that test method can exert a significant impact on test takers' performance and thereby contaminate test scores. We argue that common test method can exert the same effect as common stimuli and violate the conditional independence assumption of item response theory models because, in general, subsets of items which have a shared…

The present study focused on the analysis of listening sections of two international English proficiency tests, i.e. IELTS and TOEFL tests, and one local English proficiency test, i.e. TOLIMO from pragmatic perspective. An attempt was made to explore the areas of pragmatic knowledge presented, and to assess test takers' pragmatic knowledge. For…