Retrofitting Non-cognitive-diagnostic Reading Assessment Under the Generalized DINA Model Framework. Issue 3 (2nd July 2016)

• Record Type: Journal Article
• Authors: Chen, Huilin; Chen, Jinsong
• Is Part Of: Language assessment quarterly. Volume 13:Issue 3(2016)
• Page Start: 218
• Page End: 230
• Publication Date: 2016-07-02
• Subjects: Language and languages -- Ability testing -- Periodicals; Language and languages -- Examinations -- Periodicals; 418.0076
• DOI: 10.1080/15434303.2016.1210610
• Languages: English
• ISSNs: 1543-4303

Abstract

ABSTRACT: Cognitive diagnosis models (CDMs) are psychometric models developed mainly to assess examinees' specific strengths and weaknesses in a set of skills or attributes within a domain. By adopting the Generalized-DINA model framework, the recently developed general modeling framework, we attempted to retrofit the PISA reading assessments, a non-cognitive-diagnostic assessment, in three steps: (a) Q-matrices construction based on item content analysis; (b) Q-matrices validation and refinement based on a saturated CDM; and (c) reduced CDMs evaluations based on acceptable Q-matrix. Our research showed that (a) the practice of retrofitting non-cognitive-diagnostic assessment for cognitive diagnostic purpose was feasible; (b) Q-matrix construction and CDM selection were especially important when retrofitting approach was adopted; (c) compensatory and saturated CDMs could fit the PISA reading assessment better than other CDMs; and (d) the application of CDMs to reading assessments may promote research on reading construct.