NotesFAQContact Us
Collection
Advanced
Search Tips
Back to results
Peer reviewed Peer reviewed
PDF on ERIC Download full text
ERIC Number: EJ1374630
Record Type: Journal
Publication Date: 2022
Pages: 10
Abstractor: As Provided
ISBN: N/A
ISSN: N/A
EISSN: EISSN-2148-9378
Available Date: N/A
Performance of the Q-Matrix Validation Methods in the DINA Model
International Journal of Psychology and Educational Studies, v9 n4 p1187-1196 2022
All cognitive diagnostic models that evaluate educational test data require a Q-matrix that combines every item in a test with the required cognitive skills for each item to be answered correctly. Generally, the Q-matrix is constructed by education experts' judgment, leading to some uncertainty in its elements. Various statistical methods are suggested to validate misspecifications in the Q-matrix. This paper evaluates the performance of the Q-matrix validation methods, the sequential expectation-maximization-based [delta]-method (SEM [delta]-method), and the Q-matrix refinement (QMR) method using a study with real data and simulations. The simulation design results showed that the misspecification percentage and the length of the test had a small or no effect on the mean q-entry recovery rates (MRRs) of both methods, while the increase in sample size had an improving effect. The MRRs of both methods decreased when the number of attributes and guessing (g) - slip (s) parameters increased. According to simulation study results, the QMR method performed better than the SEM [delta]-method. For the q-matrix validation, it can be suggested that CDM practitioners prioritize the QMR method and use a sample size of 1,000. On the other hand, the real data results revealed that the MRRs of both methods were at the base rates. This result highlights the need for further research on method comparison, specifically for real-world data applications where the number of attributes is relatively large and the test duration is short.
International Journal of Psychology and Educational Studies. Sakarya University, Faculty of Education, Department of Educational Sciences, Sakarya, Turkey. e-mail: ijpesjournal@gmail.com; Web site: https://ijpes.com/index.php/ijpes/index
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Grant or Contract Numbers: N/A
Author Affiliations: N/A