Strategies for testing statistical and practical significance in detecting DIF with logistic regression models. (October 2014)

• Record Type: Journal Article
• Authors: Fidalgo, Angel M.; Alavi, Seyed Mohammad; Amirian, Seyed Mohammad Reza
• Is Part Of: Language testing. Volume 31:Number 4(2014:Oct.)
• Page Start: 433
• Page End: 451
• Publication Date: 2014-10
• Subjects: DIF classification systems -- differential item functioning -- effect size measures -- logistic regression -- Mantel–Haenszel procedure -- small sample size -- Wald statistic; Language and languages -- Ability testing -- Periodicals; Language and languages -- Examinations -- Periodicals; 407.6
• DOI: 10.1177/0265532214526748
• Languages: English
• ISSNs: 0265-5322

Abstract

This study examines three controversial aspects in differential item functioning (DIF) detection by logistic regression (LR) models: first, the relative effectiveness of different analytical strategies for detecting DIF; second, the suitability of the Wald statistic for determining the statistical significance of the parameters of interest; and third, the degree of equivalence between the main DIF classification systems. Different strategies to tests–LR models, and different DIF classification systems, were compared using data obtained from the University of Tehran English Proficiency Test (UTEPT). The data obtained from 400 test takers who hold a master's degree in science and engineering or humanities were investigated for DIF. The data were also analyzed with the Mantel–Haenszel procedure in order to have an appropriate comparison for detecting uniform DIF. The article provides some guidelines for DIF detection using LR models that can be useful for practitioners in the field of language testing and assessment.