Mutual information inspired feature selection using kernel canonical correlation analysis. (November 2019)

• Record Type: Journal Article
• Authors: Wang, Yan; Cang, Shuang; Yu, Hongnian
• Is Part Of: Expert systems with applications. Volume 4(2019)
• Publication Date: 2019-11
• Subjects: Feature selection -- Joint redundancy -- Kernel canonical correlation analysis -- Mutual information -- Incomplete Cholesky Decomposition; 006.33
• DOI: 10.1016/j.eswax.2019.100014
• Languages: English
• ISSNs: 2590-1885

Abstract

Highlights: Propose a new feature selection method. The method combines kernel canonical correlation analysis and mutual information. Incomplete Cholesky Decomposition is used to approximate the kernel matrix. Experimental results show the better performance of the proposed method. Abstract: This paper proposes a filter-based feature selection method by combining the measurement of kernel canonical correlation analysis (KCCA) with the mutual information (MI)-based feature selection method, named mRMJR-KCCA. The mRMJR-KCCA maximizes the relevance between the feature candidate and the target class labels and simultaneously minimizes the joint redundancy between the feature candidate and the already selected features in the view of KCCA. To improve the computation efficiency, we adopt the Incomplete Cholesky Decomposition to approximate the kernel matrix in implementing the KCCA in mRMJR-KCCA for larger-size datasets. The proposed method is experimentally evaluated on 13 classification-associated datasets. Compared with certain popular feature selection methods, the experimental results demonstrate the better performance of the proposed mRMJR-KCCA.