Discrimination Structure Complementarity‐Based Feature Selection. (4th April 2017)

• Record Type: Journal Article
• Authors: Wang, Shuqin; Wei, Jinmao; Yang, Zhenglu
• Is Part Of: Computational intelligence. Volume 33:Number 4(2017)
• Page Start: 863
• Page End: 898
• Publication Date: 2017-04-04
• Subjects: discrimination structure complementarity, feature selection, multiclass classification, variable complementarity; Artificial intelligence -- Periodicals; Computational linguistics -- Periodicals; 006.3
• DOI: 10.1111/coin.12118
• Languages: English
• ISSNs: 0824-7935

Abstract

Abstract : Feature selection is crucial, particularly for processing high‐dimensional data. Existing selection methods generally compute a discriminant value for a feature with respect to class variable to indicate its classification ability. However, a scalar value can hardly reveal the multifaceted classification abilities of a feature for different subproblems of a complicated multiclass problem. In view of this, we propose to select features based on discrimination structure complementarity. To this end, the classification abilities of a feature for different subproblems are evaluated individually. Consequently, a discrimination structure vector can be obtained to indicate if the feature is discriminative respectively for different subproblems. Based on discrimination structure, indispensable and dispensable features (ID‐features for short) are defined. In selection process, the ID‐features, which are complementary in discrimination structure to the selected ones, are selected. The proposed method tries to equally treat all subproblems and hence can avoid falling into the pitfall that the discriminative features for difficult subproblems are prone to be covered by the features for easy ones in multi‐class classification. Two algorithms are developed and compared with several feature selection methods using some open data sets. Experimental results demonstrate the effectiveness of the proposed method.