ERIC Number: EJ1361390
Record Type: Journal
Publication Date: 2022
Pages: 14
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2667-6753
Available Date: N/A
Cognitive Diagnostic Assessment of IELTS Listening: Providing Feedback from Its Internal Structure
Panahi, Ali; Mohebbi, Hassan
Language Teaching Research Quarterly, v29 p147-160 2022
High stakes testing, such as IELTS, is designed to select individuals for decision-making purposes (Fulcher, 2013b). Hence, there is a slow-growing stream of research investigating the subskills of IELTS listening and, in feedback terms, its effects on individuals and educational programs. Here, cognitive diagnostic assessment (CDA) performs it through breaking down the abstract listening concepts into fine-grained subcomponents, and applying it to in-class assessment and teaching. Therefore, the strengths and weaknesses of language learners concerning various subsections of the IELTS listening test were explored with use of three CDMs, i.e., DINA, DINO and mixed DINA-DINO. As a result, the analysis of the participants' (N=463) performances revealed that the mixed-DINA-DINO model using the original Q-matrix was the most effective model. On the other hand, all three models indicated that gap-filling was cognitively less demanding than the other subsections. However, they did not show any agreement on multiple-choice sub-competency. Accordingly, it can be argued that the CDM-driven diagnostic information related to the sub-sections of the IELTS listening test can be used in educational systems to explore the underlying structure of a test and detect the learners' potential strengths and weaknesses with mastery and non-mastery of the intended items.
Descriptors: Decision Making, Listening Comprehension Tests, Multiple Choice Tests, Diagnostic Tests, Language Tests, English (Second Language), Second Language Learning, High Stakes Tests, Feedback (Response), Models, Test Items, Listening Skills, Second Language Instruction, Goodness of Fit, Test Preparation, Foreign Countries
European Knowledge Development (EUROKD). e-mail: editorial@eurokd.com; Web site: https://www.eurokd.com/journal/jd/1
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Iran
Identifiers - Assessments and Surveys: International English Language Testing System
Grant or Contract Numbers: N/A
Author Affiliations: N/A