Investigating Measurement Invariance in Computer-Based Personality Testing: The Impact of Using Anchor Items on Effect Size Indices. (February 2015)

• Record Type: Journal Article
• Authors: Egberink, Iris J. L.; Meijer, Rob R.; Tendeiro, Jorge N.
• Is Part Of: Educational and psychological measurement. Volume 75:Number 1(2015:Feb.)
• Page Start: 126
• Page End: 145
• Publication Date: 2015-02
• Subjects: personality -- differential item functioning -- differential test functioning -- psychological assessment -- item response theory; Educational tests and measurements -- Periodicals; Psychological tests -- Periodicals; 151.205
• DOI: 10.1177/0013164414520965
• Languages: English
• ISSNs: 0013-1644

Abstract

A popular method to assess measurement invariance of a particular item is based on likelihood ratio tests with all other items as anchor items. The results of this method are often only reported in terms of statistical significance, and researchers proposed different methods to empirically select anchor items. It is unclear, however, how many anchor items should be selected and which method will provide the "best" results using empirical data. In the present study, we examined the impact of using different numbers of anchor items on effect size indices when investigating measurement invariance on a personality questionnaire in two different assessment situations. Results suggested that the effect size indices were not influenced by using different numbers of anchor items. The values were comparable across different number of anchor items used and were small, which indicate that the effect of differential functioning at the item and test level is very small if not negligible. Practical implications are discussed and we discuss the use of anchor items and effect size indices in practice.