Advantages of Spike and Slab Priors for Detecting Differential Item Functioning Relative to Other Bayesian Regularizing Priors and Frequentist Lasso. Issue 1 (2nd January 2022)

• Record Type: Journal Article
• Authors: Chen, Siyuan Marco; Bauer, Daniel J.; Belzak, William M.; Brandt, Holger
• Is Part Of: Structural equation modeling. Volume 29:Issue 1(2022)
• Page Start: 122
• Page End: 139
• Publication Date: 2022-01-02
• Subjects: Differential item functioning -- measurement invariance -- Bayesian regularization -- integrative data analysis; Multivariate analysis -- Periodicals; Social sciences -- Statistical methods -- Periodicals; 519.535
• DOI: 10.1080/10705511.2021.1948335
• Languages: English
• ISSNs: 1070-5511

Abstract

ABSTRACT: An important step in scale development and assessment is to evaluate differential item functioning (DIF) across segments of the population. Recent approaches use lasso regularization to simultaneously detect DIF in all items and avoid incorrect anchor item assumptions that incur inflated error rates for classical DIF evaluation methods. Although promising, lasso methods cause underestimated standard errors and incorrect p -values. An alternative is Bayesian regularization that provides empirical standard errors. However, we point out that using empirical criteria such as credible intervals for selecting DIF parameters has limited validity. We argue that using a spike-and-slab prior with an inclusion probability criterion provides more theoretically coherent DIF selection and inference over Bayesian regularizing priors with empirical selection rules or frequentist lasso. We demonstrate this by simulation studies with Multi-group Item Response Theory and Moderated Nonlinear Factor Analysis models. Practical utility of the spike-and-slab prior selection criterion is discussed.