A feature selection method via relevant-redundant weight. (30th November 2022)

• Record Type: Journal Article
• Authors: Zhao, Shijie; Wang, Mengchen; Ma, Shilin; Cui, Qianqian
• Is Part Of: Expert systems with applications. Volume 207(2022)
• Publication Date: 2022-11-30
• Subjects: Information theory -- Feature selection -- Feature relevant-redundant weight -- Feature relevance; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2022.117923
• Languages: English
• ISSNs: 0957-4174

Abstract

Abstract: Feature selection is a crucial preprocessing technique in data mining and machine learning and has attracted increasing attentions. However, the relevance of existing methods only contains limited information. To enhance the classification ability of filter and information theory-based feature selection methods and reduce the redundancy of the selected subset, a relevant-redundant weight-based feature criterion (FSRRW) is proposed. In this paper, a feature relevant-redundant weight (RRW) is constructed to extract the important relevant and redundant information. Then, a novel feature relevance is defined based on the weight, which contains more comprehensive information from the dynamically changing features. Additionally, a feature evaluation criterion is presented via maximizing the feature relevance and minimizing the feature redundancy. The proposed algorithm and seven compared methods are tested on 20 benchmark datasets. Extensive experiments demonstrate that the proposed criterion exhibits better feature screening abilities, effectively facilitates classification, and has preferable applicability and robustness. Highlights: Design a feature relevant-redundant weight and define feature relevance. Construct a novel feature evaluation criterion named FSRRW. FSRRW is evaluated on 20 benchmark datasets under three classifiers. The proposed method outperforms seven popular feature selection methods.