Performance of Person‐Fit Statistics Under Model Misspecification. Issue 3 (15th July 2019)

• Record Type: Journal Article
• Authors: Hong, Seong Eun; Monroe, Scott; Falk, Carl F.
• Is Part Of: Journal of educational measurement. Volume 57:Issue 3(2020)
• Page Start: 423
• Page End: 442
• Publication Date: 2019-07-15
• Subjects: Educational tests and measurements -- Periodicals; 371.2605
• DOI: 10.1111/jedm.12207
• Languages: English
• ISSNs: 0022-0655

Abstract

Abstract: In educational and psychological measurement, a person‐fit statistic (PFS) is designed to identify aberrant response patterns. For parametric PFSs, valid inference depends on several assumptions, one of which is that the item response theory (IRT) model is correctly specified. Previous studies have used empirical data sets to explore the effects of model misspecification on PFSs. We further this line of research by using a simulation study, which allows us to explore issues that may be of interest to practitioners. Results show that, depending on the generating and analysis item models, Type I error rates at fixed values of the latent variable may be greatly inflated, even when the aggregate rates are relatively accurate. Results also show that misspecification is most likely to affect PFSs for examinees with extreme latent variable scores. Two empirical data analyses are used to illustrate the importance of model specification.