Validating Student Score Inferences With Person‐Fit Statistic and Verbal Reports: A Person‐Fit Study for Cognitive Diagnostic Assessment. Issue 1 (26th March 2013)

• Record Type: Journal Article
• Authors: Cui, Ying; Roduta Roberts, Mary
• Is Part Of: Educational measurement. Volume 32:Issue 1(2013:Spring)
• Page Start: 34
• Page End: 42
• Publication Date: 2013-03-26
• Subjects: Educational tests and measurements -- Periodicals; Educational tests and measurements -- United States -- Periodicals; 371.262
• DOI: 10.1111/emip.12003
• Languages: English
• ISSNs: 0731-1745

Abstract

<abstract abstract-type="main" xml:lang="en"> <title> <x xml:space="preserve">Abstract</x> </title> <p> <italic>The goal of this study was to investigate the usefulness of person‐fit analysis in validating student score inferences in a cognitive diagnostic assessment. In this study, a two‐stage procedure was used to evaluate person fit for a diagnostic test in the domain of statistical hypothesis testing. In the first stage, the person‐fit statistic, the hierarchy consistency index (HCI; </italic> <xref ref-type="link" rid="b2">2007</xref> <italic>; </italic> <xref ref-type="link" rid="b3">2009</xref> <italic>), was used to identify the misfitting student item‐score vectors</italic>. <italic>In the second stage, students' verbal reports were collected to provide additional information about students' response processes so as to reveal the actual causes of misfits. This two‐stage procedure helped to identify the misfits of item‐score vectors to the cognitive model used in the design and analysis of the diagnostic test, and to discover the reasons of misfits so that students' problem‐solving strategies were better understood and their performances were interpreted in a more meaningful way</italic>.</p> </abstract>