Spectral embedded generalized mean based k-nearest neighbors clustering with S-distance. (1st May 2021)

• Record Type: Journal Article
• Authors: Sharma, Krishna Kumar; Seal, Ayan
• Is Part Of: Expert systems with applications. Volume 169(2021)
• Publication Date: 2021-05-01
• Subjects: S-distance -- Spectral clustering -- Symmetry favored k-nearest neighbors -- Generalized mean -- Distributed computing; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2020.114326
• Languages: English
• ISSNs: 0957-4174

Abstract

Abstract: The spectral clustering algorithm is extensively employed in different aspects, especially in the field of pattern recognition. However, the efficient construction of the neighborhood graph is the main reason for its promising results. Generally, the similarity matrix relies on the applied similarity measure between two data points, selection of k − nearest neighbors (KNN), and approach for the construction of a neighborhood graph. In this study, we integrate S-distance to spectral clustering, which is capable to find out the complex and non-linear cluster structures. Moreover, generalized mean distance-based KNN is proposed to decrease the sensitiveness towards the value of the k . Also, a symmetry-favored KNN method is applied to construct the neighborhood graph, which reduces the impact of outliers and noisy data points. However, spectral clustering faces scalability and speedup issues in the case of large size datasets. Thus, the proposed spectral clustering algorithm is also executed in distributed environments. Several experiments are performed to validate the proposed clustering algorithm on 20 real-world datasets and 3 large size datasets. Experimental results demonstrate that the proposed clustering algorithm outperforms some of the baseline methods in terms of accuracy and clustering error rates. Finally, we conduct Wilcoxon's Rank-Sum test and illustrate that the proposed spectral clustering algorithm is statistically significant. Highlights: A churn prediction model is proposed using an enhanced spectral clustering (SC). A non-linear distance measure called S-distance is merged with the conventional SC. The proposed clustering algorithm is validated on 15 datasets. Three state-of-the-art methods are considered to compare with the proposed one.