Factor Retention Using Machine Learning With Ordinal Data. Issue 5 (July 2022)

• Record Type: Journal Article
• Authors: Goretzko, David; Bühner, Markus
• Is Part Of: Applied psychological measurement. Volume 46:Issue 5(2022)
• Page Start: 406
• Page End: 421
• Publication Date: 2022-07
• Subjects: exploratory factor analysis -- number of factors -- machine learning -- factor retention -- factorial validity -- ordinal data; Psychometrics -- Periodicals; Psychological tests -- Periodicals; Psychology, Applied -- Periodicals; 150.1519505
• DOI: 10.1177/01466216221089345
• Languages: English
• ISSNs: 0146-6216

Abstract

Determining the number of factors in exploratory factor analysis is probably the most crucial decision when conducting the analysis as it clearly influences the meaningfulness of the results (i.e., factorial validity). A new method called the Factor Forest that combines data simulation and machine learning has been developed recently. This method based on simulated data reached very high accuracy for multivariate normal data, but it has not yet been tested with ordinal data. Hence, in this simulation study, we evaluated the Factor Forest with ordinal data based on different numbers of categories (2–6 categories) and compared it to common factor retention criteria. It showed higher overall accuracy for all types of ordinal data than all common factor retention criteria that were used for comparison (Parallel Analysis, Comparison Data, the Empirical Kaiser Criterion and the Kaiser Guttman Rule). The results indicate that the Factor Forest is applicable to ordinal data with at least five categories (typical scale in questionnaire research) in the majority of conditions and to binary or ordinal data based on items with less categories when the sample size is large.