Modeling Item Revisit Behavior: The Hierarchical Speed–Accuracy–Revisits Model. (April 2021)

• Record Type: Journal Article
• Authors: Bezirhan, Ummugul; von Davier, Matthias; Grabovsky, Irina
• Is Part Of: Educational and psychological measurement. Volume 81:Number 2(2021)
• Page Start: 363
• Page End: 387
• Publication Date: 2021-04
• Subjects: item revisits -- Rasch Poisson counts model -- response time -- hierarchical modeling; Educational tests and measurements -- Periodicals; Psychological tests -- Periodicals; 151.205
• DOI: 10.1177/0013164420950556
• Languages: English
• ISSNs: 0013-1644

Abstract

This article presents a new approach to the analysis of how students answer tests and how they allocate resources in terms of time on task and revisiting previously answered questions. Previous research has shown that in high-stakes assessments, most test takers do not end the testing session early, but rather spend all of the time they were assigned to take the test. Rather than being an indication of speededness, this was found to be caused by test takers' tendency to revisit previous items even if they already provided answers to all questions. In accordance with this information, the proposed approach models revisit patterns simultaneously with responses and response times to gain a better understanding of the relationship between speed, ability, and revisit tendency. The empirical data analysis revealed that examinees' tendency to revisit items was strongly related to their speed and subgroups of examinees displayed different test-taking behaviors.