Missing value imputation through shorter interval selection driven by Fuzzy C-Means clustering. (July 2021)

• Record Type: Journal Article
• Authors: Khan, Hufsa; Wang, Xizhao; Liu, Han
• Is Part Of: Computers & electrical engineering. Volume 93(2021)
• Publication Date: 2021-07
• Subjects: Incomplete data processing -- Missing value handling -- Missing value imputation -- Fuzzy C-Means clustering; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2021.107230
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: The presence of missing data is a common and pivotal issue, which generally leads to a serious decrease of data quality and thus indicates the necessity to effectively handle missing data. In this paper, we propose a missing value imputation approach driven by Fuzzy C-Mean clustering to improve the classification accuracy by referring only to the known feature values of some selected instances. In particular, the missing values for each instance are imputed by selecting a shorter interval based on the cluster membership value within the certain threshold limit of each feature, while using a short interval is considered to improve the imputation effectiveness and get more accurate estimation of the values in comparison with using a long interval. Our method is evaluated through comparing with state-of-the-art imputation methods on UCI datasets. The experimental results demonstrate that the proposed approach performs closely to or better than those state-of-the-art imputation methods. Graphical abstract: Highlights: A missing data imputation technique called SISFCM is proposed for numeric features. The SISFCM approach improves the imputation performance in comparison with other competitive state-of-the-art imputation methods. The method shows its robustness to the change of the percentage of missing values.