Unsupervised feature selection with robust data reconstruction (UFS-RDR) and outlier detection. (1st September 2022)

• Record Type: Journal Article
• Authors: Wahid, Abdul; Khan, Dost Muhammad; Hussain, Ijaz; Khan, Sajjad Ahmad; Khan, Zardad
• Is Part Of: Expert systems with applications. Volume 201(2022)
• Publication Date: 2022-09-01
• Subjects: Unsupervised feature selection -- Data reconstruction -- Outliers -- Mahalanobis distance -- Robustness; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2022.117008
• Languages: English
• ISSNs: 0957-4174

Abstract

Abstract: In unsupervised learning, the traditional feature selection methods are not always efficient and their feature selection performance can be severely affected in the presence of outliers and noise. To address this issue, we propose a novel robust unsupervised feature selection method, called Unsupervised Feature Selection with Robust Data Reconstruction (UFS-RDR), that minimizes the graph regularized weighted data reconstruction error function. For the detection of outliers, the well-known Mahalanobis distance is used and further determine the Huber-type weight function using these Mahalanobis distances. This weight function downweights the clustering observations that have large distance. Our experimental results on both synthetic and real-world datasets indicate that the proposed UFS-RDR approach has good feature selection performance and also outperforms the competitive non-robust unsupervised feature selection methods in the presence of contamination in the unlabeled data. Highlights: Feature selection methods in unsupervised learning are sensitive to outliers. A novel unsupervised feature selection with robust data reconstruction is proposed. It minimizes the graph regularized weighted data reconstruction error function. This function down-weights the clustering observations having large distances. The proposed method outperform the competitive methods in the presence of outliers.