Speed-up and multi-view extensions to subclass discriminant analysis. (March 2021)

• Record Type: Journal Article
• Authors: Chumachenko, Kateryna; Raitoharju, Jenni; Iosifidis, Alexandros; Gabbouj, Moncef
• Is Part Of: Pattern recognition. Volume 111(2021)
• Publication Date: 2021-03
• Subjects: Subclass discriminant analysis -- Spectral regression -- Multi-view learning -- Kernel regression -- Subspace learning; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2020.107660
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: We present a speed-up extension to Subclass Discriminant Analysis. We propose an extension to SDA for multi-view problems and a fast solution to it. The proposed approaches result in lower training time and competitive performance. Abstract: In this paper, we propose a speed-up approach for subclass discriminant analysis and formulate a novel efficient multi-view solution to it. The speed-up approach is developed based on graph embedding and spectral regression approaches that involve eigendecomposition of the corresponding Laplacian matrix and regression to its eigenvectors. We show that by exploiting the structure of the between-class Laplacian matrix, the eigendecomposition step can be substituted with a much faster process. Furthermore, we formulate a novel criterion for multi-view subclass discriminant analysis and show that an efficient solution to it can be obtained in a similar manner to the single-view case. We evaluate the proposed methods on nine single-view and nine multi-view datasets and compare them with related existing approaches. Experimental results show that the proposed solutions achieve competitive performance, often outperforming the existing methods. At the same time, they significantly decrease the training time.