Joint graph optimization and projection learning for dimensionality reduction. (August 2019)

• Record Type: Journal Article
• Authors: Yi, Yugen; Wang, Jianzhong; Zhou, Wei; Fang, Yuming; Kong, Jun; Lu, Yinghua
• Is Part Of: Pattern recognition. Volume 92(2019:Aug.)
• Page Start: 258
• Page End: 273
• Publication Date: 2019-08
• Subjects: Graph optimization -- Projection learning -- Dimensionality reduction -- Robustness; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2019.03.024
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: A novel framework termed joint graph optimization and projection learning (JGOPL) is proposed for graph-based dimensionality reduction. The l 21 -norm based distance measurement is adopted in the loss function of our JGOPL so that its robustness to the negative influence caused by the outliers or variations of data can be improved. In order to well exploit and preserve the local structure information of high-dimensional data, a locality constraint is introduced into the proposed JGOPL to discourage a sample from connecting with the distant samples during graph optimization. The locality constraint and graph optimization strategy proposed is not only limited to dimensionality reduction, but also can be incorporated into other relevant graph-based tasks. Abstract: Nowadays, graph-based dimensionality reduction approaches have become more and more popular due to their successful utilization for classification and clustering tasks. In these approaches, how to establish an appropriate graph is critical. To address this issue, a novel graph-based dimensionality reduction framework termed joint graph optimization and projection learning (JGOPL) is proposed in this paper. Compared with existing dimensionality reduction approaches, there are three main advantages of JGOPL. First, through performing the graph optimization and low-dimensional feature learning simultaneously, our proposed approach can accomplish the tasks of graph construction and dimensionality reduction jointly. Second, the l 21 -norm based distance measurement is adopted in the loss function of our JGOPL so that its robustness to the negative influence caused by the outliers or variations of data can be improved. Third, in order to well exploit and preserve the local structure information of high-dimensional data, a locality constraint is introduced into the proposed JGOPL to discourage a sample from connecting with the distant samples during graph optimization. Extensive classification and clustering experiments are carried out on seven publicly available databases to demonstrate the effectiveness of our approach. At last, the locality constraint and graph optimization strategy proposed in this paper is not only limited to dimensionality reduction, but also can be incorporated into other relevant graph-based tasks (such as spectral clustering).