Detecting Item Drift in Large‐Scale Testing. Issue 3 (1st September 2017)

• Record Type: Journal Article
• Authors: Guo, Hongwen; Robin, Frederic; Dorans, Neil
• Is Part Of: Journal of educational measurement. Volume 54:Issue 3(2017)
• Page Start: 265
• Page End: 284
• Publication Date: 2017-09-01
• Subjects: Educational tests and measurements -- Periodicals; 371.2605
• DOI: 10.1111/jedm.12144
• Languages: English
• ISSNs: 0022-0655

Abstract

Abstract : The early detection of item drift is an important issue for frequently administered testing programs because items are reused over time. Unfortunately, operational data tend to be very sparse and do not lend themselves to frequent monitoring analyses, particularly for on‐demand testing. Building on existing residual analyses, the authors propose an item index that requires only moderate‐to‐small sample sizes to form data for time‐series analysis. Asymptotic results are presented to facilitate statistical significance tests. The authors show that the proposed index combined with time‐series techniques may be useful in detecting and predicting item drift. Most important, this index is related to a well‐known differential item functioning analysis so that a meaningful effect size can be proposed for item drift detection.