An Iterative Method for Empirically-Based Q-Matrix Validation

In cognitive diagnosis modeling, the attributesrequired for each item are specified in the Q-matrix. The traditional way ofconstructing a Q-matrix based on expert opinion is inherently subjective,consequently resulting in serious validity concerns. The current study proposesa new validation method u...

Full description

Saved in:
Bibliographic Details
Main Authors: Ragip Terzi, Jimmy De La Torre
Format: Article
Language:English
Published: izzet kara 2018-05-01
Series:International Journal of Assessment Tools in Education
Subjects:
Online Access:https://dergipark.org.tr/tr/download/article-file/442961
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In cognitive diagnosis modeling, the attributesrequired for each item are specified in the Q-matrix. The traditional way ofconstructing a Q-matrix based on expert opinion is inherently subjective,consequently resulting in serious validity concerns. The current study proposesa new validation method under the deterministic inputs, noisy “and” gate (DINA)model to empirically validate attribute specifications in the Q-matrix. Inparticular, an iterative procedure with a modified version of the sequentialsearch algorithm is introduced. Simulation studies are conducted to compare theproposed method with existing parametric and nonparametric methods. Resultsshow that the new method outperforms the other methods across the board.Finally, the method is applied to real data using fraction-subtraction data.
ISSN:2148-7456