A heuristic supervised Euclidean data difference dimension reduction for KNN classifier and its application to visual place classification. Issue 7 (October 2016)

• Record Type: Journal Article
• Authors: Omranpour, Hesam; Shiry Ghidary, Saeed
• Is Part Of: Neural computing & applications. Volume 27:Issue 7(2016)
• Page Start: 1867
• Page End: 1881
• Publication Date: 2016-10
• Subjects: Linear dimension reduction -- Multiclass classification -- KNN -- Visual place classification; Neural networks (Computer science) -- Periodicals; Neural circuitry -- Periodicals; Artificial intelligence -- Periodicals; Neural Networks (Computer) -- Periodicals; Réseaux neuronaux (Informatique) -- Périodiques; Réseaux nerveux -- Périodiques; Intelligence artificielle -- Périodiques; 006.32
• DOI: 10.1007/s00521-015-1979-8
• Languages: English
• ISSNs: 0941-0643

Abstract

Abstract In this paper, we propose a novel supervised dimension reduction algorithm based onK -nearest neighbor (KNN) classifier. The proposed algorithm reduces the dimension of data in order to improve the accuracy of the KNN classification. This heuristic algorithm proposes independent dimensions which decrease Euclidean distance of a sample data and itsK -nearest within-class neighbors and increase Euclidean distance of that sample and itsM -nearest between-class neighbors. This algorithm is a linear dimension reduction algorithm which produces a mapping matrix for projecting data into low dimension. The dimension reduction step is followed by a KNN classifier. Therefore, it is applicable for high-dimensional multiclass classification. Experiments with artificial data such as Helix and Twin-peaks show ability of the algorithm for data visualization. This algorithm is compared with state-of-the-art algorithms in classification of eight different multiclass data sets from UCI collection. Simulation results have shown that the proposed algorithm outperforms the existing algorithms. Visual place classification is an important problem for intelligent mobile robots which not only deals with high-dimensional data but also has to solve a multiclass classification problem. A proper dimension reduction method is usually needed to decrease computation and memory complexity of algorithms in large environments. Therefore, our method is very well suited for this problem. We extract color histogram of omnidirectional camera images as primary features, reduce the features into a low-dimensional space and apply a KNN classifier. Results of experiments on five real data sets showed superiority of the proposed algorithm against others.