Rethinking the Interpretation of Item Discrimination and Factor Loadings. (December 2019)

• Record Type: Journal Article
• Authors: Jordan, Pascal; Spiess, Martin
• Is Part Of: Educational and psychological measurement. Volume 79:Number 6(2019)
• Page Start: 1103
• Page End: 1132
• Publication Date: 2019-12
• Subjects: factor loadings -- item discrimination -- person parameter -- paradox -- multidimensionality; Educational tests and measurements -- Periodicals; Psychological tests -- Periodicals; 151.205
• DOI: 10.1177/0013164419843164
• Languages: English
• ISSNs: 0013-1644

Abstract

Factor loadings and item discrimination parameters play a key role in scale construction. A multitude of heuristics regarding their interpretation are hardwired into practice—for example, neglecting low loadings and assigning items to exactly one scale. We challenge the common sense interpretation of these parameters by providing counterexamples and general results which altogether cast doubt on our understanding of these parameters. In particular, we highlight the counterintuitive way in which the best prediction of a test taker's latent ability depends on the factor loadings. As a consequence, we emphasize that practitioners need to shift their focus from interpreting item discrimination parameters by their relative loading to an interpretation which incorporates the structure of the model-based latent ability estimate.