Evaluation of Model Fit in Cognitive Diagnosis Models. Issue 2 (2nd April 2016)

• Record Type: Journal Article
• Authors: Hu, Jinxiang; Miller, M. David; Huggins-Manley, Anne Corinne; Chen, Yi-Hsin
• Is Part Of: International journal of testing. Volume 16:Issue 2(2016)
• Page Start: 119
• Page End: 141
• Publication Date: 2016-04-02
• Subjects: CDM -- CDM misspecification -- model fit -- Q-matrix misspecification; Psychological tests -- Periodicals; Educational tests and measurements -- Periodicals; 150.28705
• DOI: 10.1080/15305058.2015.1133627
• Languages: English
• ISSNs: 1530-5058

Abstract

Abstract : Cognitive diagnosis models (CDMs) estimate student ability profiles using latent attributes. Model fit to the data needs to be ascertained in order to determine whether inferences from CDMs are valid. This study investigated the usefulness of some popular model fit statistics to detect CDM fit including relative fit indices (AIC, BIC, and CAIC), and absolute fit indices (RMSEA2, ABS ( fcor ) and MAX (χ 2 jj ′ )). These fit indices were assessed under different CDM settings with respect to Q-matrix misspecification and CDM misspecification. Results showed that relative fit indices selected the correct DINA model most of the times and selected the correct G-DINA model well across most conditions. Absolute fit indices rejected the true DINA model if the Q-matrix was misspecified in any way. Absolute fit indices rejected the true G-DINA model whenever the Q-matrix was under-specified. RMSEA2 could be artificially low when the Q-matrix was over-specified.