Enriching the random subspace method with margin theory – a solution for the high-dimensional classification task. Issue 4 (2nd October 2018)

• Record Type: Journal Article
• Authors: Xu, Hongyan; Lin, Tao; Xie, Yingtao; Chen, Zhi
• Is Part Of: Connection science. Volume 30:Issue 4(2018)
• Page Start: 409
• Page End: 424
• Publication Date: 2018-10-02
• Subjects: Random subspace method -- wrRSM -- margin theory -- weighted majority voting -- high-dimensional problem; Neural computers -- Periodicals; Artificial intelligence -- Periodicals; Cognitive science -- Periodicals; Connectionism -- Periodicals; 006.3
• DOI: 10.1080/09540091.2018.1512556
• Languages: English
• ISSNs: 0954-0091

Abstract

ABSTRACT: The random subspace method (RSM) has proved its excellence in numbers of pattern recognition tasks. However, the standard RSM is limited owing to the randomness in its feature selection procedure that is likely to lead to feature subset having poor class separability. In this paper, a proposal for a margin-based criterion has been presented for the evaluation of the true significance of the features, together with the true classification ability of base classifiers, so that both the training phase and integration phase of standard RSM could be enhanced. In the training phase, the random feature selection procedure is enhanced using a weighted random feature selection procedure, in order to improve the classification ability of the base classifier. In the integration phase, the simple majority voting strategy is enhanced using a weighted majority voting strategy for the purpose of assigning the base classifiers with poor classification ability to the lower voting weights. Experimental results on 30 benchmark datasets, together with 6 high-dimensional datasets prove that the recommended approach is capable of better providing classification ability to the usual classification task, in addition to the high-dimensional classification task.