Joint hypergraph learning and sparse regression for feature selection. (March 2017)

• Record Type: Journal Article
• Authors: Zhang, Zhihong; Bai, Lu; Liang, Yuanheng; Hancock, Edwin
• Is Part Of: Pattern recognition. Volume 63(2017:Mar.)
• Page Start: 291
• Page End: 309
• Publication Date: 2017-03
• Subjects: Feature selection -- Hypergraph learning -- Sparse regression; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2016.06.009
• Languages: English
• ISSNs: 0031-3203

Abstract

Abstract: In this paper, we propose a unified framework for improved structure estimation and feature selection. Most existing graph-based feature selection methods utilize a static representation of the structure of the available data based on the Laplacian matrix of a simple graph. Here on the other hand, we perform data structure learning and feature selection simultaneously. To improve the estimation of the manifold representing the structure of the selected features, we use a higher order description of the neighborhood structures present in the available data using hypergraph learning. This allows those features which participate in the most significant higher order relations to be selected, and the remainder discarded, through a sparsification process. We formulate a single objective function to capture and regularize the hypergraph weight estimation and feature selection processes. Finally, we present an optimization algorithm to recover the hypergraph weights and a sparse set of feature selection indicators. This process offers a number of advantages. First, by adjusting the hypergraph weights, we preserve high-order neighborhood relations reflected in the original data, which cannot be modeled by a simple graph. Moreover, our objective function captures the global discriminative structure of the features in the data. Comprehensive experiments on 9 benchmark datasets show that our method achieves statistically significant improvement over state-of-art feature selection methods, supporting the effectiveness of the proposed method. Highlights: We have proposed a hypergraph learning approach for feature selection. The approach simultaneously learns hyperedge weights and does feature selection. The learned hyperedge weights better characterize the manifold structure of the data.