A New Procedure for Detection of Students' Rapid Guessing Responses Using Response Time. Issue 3 (2nd July 2016)

• Record Type: Journal Article
• Authors: Guo, Hongwen; Rios, Joseph A.; Haberman, Shelby; Liu, Ou Lydia; Wang, Jing; Paek, Insu
• Is Part Of: Applied measurement in education. Volume 29:Issue 3(2016)
• Page Start: 173
• Page End: 183
• Publication Date: 2016-07-02
• Subjects: Educational tests and measurements -- United States -- Periodicals; Educational tests and measurements -- Periodicals; Education -- Standards -- Periodicals; 371.26
• DOI: 10.1080/08957347.2016.1171766
• Languages: English
• ISSNs: 0895-7347

Abstract

ABSTRACT: Unmotivated test takers using rapid guessing in item responses can affect validity studies and teacher and institution performance evaluation negatively, making it critical to identify these test takers. The authors propose a new nonparametric method for finding response-time thresholds for flagging item responses that result from rapid-guessing behavior. Using data from a low-stakes assessment of college-level academic skills as an illustration, the authors evaluate and compare model fit and score estimation based on data sets cleaned by both new and existing methods. Flagging rapid-guessing responses is found to generally improve model fit, item parameter estimation, and score estimation, as in the literature. This new method, based on both response time and response accuracy, shows promise in detecting rapid guessing and in improving efficiency of the flagging process when built into data analysis.