Fuzzy joint mutual information feature selection based on ideal vector. (1st May 2022)

• Record Type: Journal Article
• Authors: Salem, Omar A.M.; Liu, Feng; Chen, Yi-Ping Phoebe; Hamed, Ahmed; Chen, Xi
• Is Part Of: Expert systems with applications. Volume 193(2022)
• Publication Date: 2022-05-01
• Subjects: Feature selection -- Fuzzy sets -- Information theory -- Ideal vector -- Classification models; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2021.116453
• Languages: English
• ISSNs: 0957-4174

Abstract

Abstract: Feature selection is an effective preprocess that helps the classification task to improve its performance. Information measures, especially fuzzy information measures have been a powerful solution in feature selection. However, existing feature selection frameworks based on fuzzy information measures suffer from one of two limitations: (1) discarding important feature relations as redundancy and complementarity. (2) requiring a high computational cost. To overcome these limitations, a new feature selection framework is proposed in this paper, called fuzzy joint mutual information based on ideal vector (FJMIIV), to extract all possible feature relations with minimum computational cost. The performance of the proposed framework is compared with some of the state-of-the-art frameworks on various benchmark datasets. The comparison results using four well-known classifiers show that the proposed method can effectively improve the classification performance. Highlights: A new Feature Selection, called FJMIIV, is proposed for classification models. FJMIIV uses fuzzy mutual information measures based on ideal vector. FJMIIV depends on feature-idealvector instead of feature-feature to save the cost. FJMIIV considers the joint discriminative ability to improve the feature selection. FJMIIV outperforms some state-of-the-art methods in the classification performance.