Improving precision of ability estimation: Getting more from response times. (21st June 2017)

• Record Type: Journal Article
• Authors: Bolsinova, Maria; Tijmstra, Jesper
• Is Part Of: British journal of mathematical & statistical psychology. Volume 71:Part 1(2018)
• Page Start: 13
• Page End: 38
• Publication Date: 2017-06-21
• Subjects: collateral information -- hierarchical model -- item response theory -- measurement precision -- response times; Psychometrics -- Periodicals; Psychology -- Mathematical models -- Periodicals; Psychology -- Statistical methods -- Periodicals; 150.727
• DOI: 10.1111/bmsp.12104
• Languages: English
• ISSNs: 0007-1102

Abstract

Abstract : By considering information about response time (RT) in addition to response accuracy (RA), joint models for RA and RT such as the hierarchical model (van der Linden, 2007) can improve the precision with which ability is estimated over models that only consider RA. The hierarchical model, however, assumes that only the person's speed is informative of ability. This assumption of conditional independence between RT and ability given speed may be violated in practice, and ignores collateral information about ability that may be present in the residual RTs. We propose a posterior predictive check for evaluating the assumption of conditional independence between RT and ability given speed. Furthermore, we propose an extension of the hierarchical model that contains cross‐loadings between ability and RT, which enables one to take additional collateral information about ability into account beyond what is possible in the standard hierarchical model. A Bayesian estimation procedure is proposed for the model. Using simulation studies, the performance of the model is evaluated in terms of parameter recovery, and the possible gain in precision over the standard hierarchical model and an RA‐only model is considered. The model is applied to data from a high‐stakes educational test.