Effects of Differential Item Functioning on Examinees' Test Performance and Reliability of Test. Issue 1 (2nd January 2017)

• Record Type: Journal Article
• Authors: Lee, Yi-Hsuan; Zhang, Jinming
• Is Part Of: International journal of testing. Volume 17:Issue 1(2017)
• Page Start: 23
• Page End: 54
• Publication Date: 2017-01-02
• Subjects: differential item functioning -- expected a posteriori -- standard error of estimation -- test information function -- total score; Psychological tests -- Periodicals; Educational tests and measurements -- Periodicals; 150.28705
• DOI: 10.1080/15305058.2016.1224888
• Languages: English
• ISSNs: 1530-5058

Abstract

Abstract : Simulations were conducted to examine the effect of differential item functioning (DIF) on measurement consequences such as total scores, item response theory (IRT) ability estimates, and test reliability in terms of the ratio of true-score variance to observed-score variance and the standard error of estimation for the IRT ability parameter. The objective was to provide bounds of the likely DIF effects on these measurement consequences. Five factors were manipulated: test length, percentage of DIF items per form, item type, sample size, and level of group ability difference. Results indicate that the greatest DIF effect was less than 2 points on the 0 to 60 total score scale and about 0.15 on the IRT ability scale. DIF had a limited effect on the ratio of true-score variance to observed-score variance, but its influence on the standard error of estimation for the IRT ability parameter was evident for certain ability values.