Particle swarm optimisation-based KNN for improving KNN and ensemble classification performance. (2015)

• Record Type: Journal Article
• Authors: Boro, Debojit; Bhattacharyya, Dhruba K.
• Is Part Of: International journal of innovative computing and applications. Volume 6:Number 3/4(2015)
• Page Start: 145
• Page End: 162
• Publication Date: 2015
• Subjects: classifiers -- ensemble classification -- decision tree -- naive Bayes -- decision table -- random forests -- algebraic combiners -- similarity measures -- term frequency -- inverse document frequency -- KNN -- k-nearest neighbour -- particle swarm optimisation -- PSO -- evolutionary computation -- ensemble performance; Evolutionary computation -- Periodicals; Neural networks (Computer science) -- Periodicals; Genetic programming (Computer science) -- Periodicals; Biologically-inspired computing -- Periodicals; Swarm intelligence -- Periodicals; Quantum computers -- Periodicals; 006.3
• Languages: English
• ISSNs: 1751-648X

Abstract

In this paper we use KNN algorithm for our ensemble classification process that finds out the nearest K training samples given a test sample where each sample is predictions vector generated by combined computation of classifiers ensemble and algebraic combiners. In this attempt to reduce the computational time involved in finding K training samples by KNN, we used particle swarm optimisation (PSO) with KNN which randomly selects the training samples from the training set until a global consensus is reached among the particles and label that test sample with an appropriate class by weighted majority voting (WMV) of K training samples. The proposed method demonstrated better ensemble performance as compared to KNN and other traditional ensemble methods in terms of computational time and generalisation accuracies when tested over several datasets from UCI repository and other high dimensional datasets.