Posterior Predictive Checks for Conditional Independence Between Response Time and Accuracy. (April 2016)

• Record Type: Journal Article
• Authors: Bolsinova, Maria; Tijmstra, Jesper
• Is Part Of: Journal of educational and behavioral statistics. Volume 41:Number 2(2016)
• Page Start: 123
• Page End: 145
• Publication Date: 2016-04
• Subjects: conditional independence -- item response theory -- hierarchical model -- posterior predictive checks -- response times; Educational statistics -- Periodicals; Social sciences -- Statistical methods -- Periodicals; 370.2
• DOI: 10.3102/1076998616631746
• Languages: English
• ISSNs: 1076-9986

Abstract

Conditional independence (CI) between response time and response accuracy is a fundamental assumption of many joint models for time and accuracy used in educational measurement. In this study, posterior predictive checks (PPCs) are proposed for testing this assumption. These PPCs are based on three discrepancy measures reflecting different observable consequences of different types of violations of CI. Simulation studies are performed to evaluate the specificity of the procedure, its robustness, and its sensitivity to detect different types of conditional dependence and to compare it to existing methods. The new procedure outperforms the existing methods in most of the simulation conditions. The use of the PPCs is illustrated using arithmetics test data.