Scalable and compact 3D action recognition with approximated RBF kernel machines. (September 2019)
- Record Type:
- Journal Article
- Title:
- Scalable and compact 3D action recognition with approximated RBF kernel machines. (September 2019)
- Main Title:
- Scalable and compact 3D action recognition with approximated RBF kernel machines
- Authors:
- Cavazza, Jacopo
Morerio, Pietro
Murino, Vittorio - Abstract:
- Highlights: Theoretically sound approximation of the Log-Euclidean kernel with an explicit feature map. Unbiased estimation with rapidly decreasing variance. Compact but effective representation in public benchmarks. Superior performance against state-of-the-art methods with respect to ease of training (minutes on CPU are enough, not hours of GPU computation as for deep learning methods). Abstract: Despite the recent deep learning (DL) revolution, kernel machines still remain powerful methods for action recognition. DL has brought the use of large datasets and this is typically a problem for kernel approaches, which are not scaling up efficiently due to kernel Gram matrices. Nevertheless, kernel methods are still attractive and more generally applicable since they can equally manage different sizes of the datasets, also in cases where DL techniques show some limitations. This work investigates these issues by proposing an explicit approximated representation that, together with a linear model, is an equivalent, yet scalable, implementation of a kernel machine. Our approximation is directly inspired by the exact feature map that is induced by an RBF Gaussian kernel but, unlike the latter, it is finite dimensional and very compact. We justify the soundness of our idea with a theoretical analysis which proves the unbiasedness of the approximation, and provides a vanishing bound for its variance, which is shown to decrease much rapidly than in alternative methods in theHighlights: Theoretically sound approximation of the Log-Euclidean kernel with an explicit feature map. Unbiased estimation with rapidly decreasing variance. Compact but effective representation in public benchmarks. Superior performance against state-of-the-art methods with respect to ease of training (minutes on CPU are enough, not hours of GPU computation as for deep learning methods). Abstract: Despite the recent deep learning (DL) revolution, kernel machines still remain powerful methods for action recognition. DL has brought the use of large datasets and this is typically a problem for kernel approaches, which are not scaling up efficiently due to kernel Gram matrices. Nevertheless, kernel methods are still attractive and more generally applicable since they can equally manage different sizes of the datasets, also in cases where DL techniques show some limitations. This work investigates these issues by proposing an explicit approximated representation that, together with a linear model, is an equivalent, yet scalable, implementation of a kernel machine. Our approximation is directly inspired by the exact feature map that is induced by an RBF Gaussian kernel but, unlike the latter, it is finite dimensional and very compact. We justify the soundness of our idea with a theoretical analysis which proves the unbiasedness of the approximation, and provides a vanishing bound for its variance, which is shown to decrease much rapidly than in alternative methods in the literature. In a broad experimental validation, we assess the superiority of our approximation in terms of (1) ease and speed of training, (2) compactness of the model, and (3) improvements with respect to the state-of-the-art performance. … (more)
- Is Part Of:
- Pattern recognition. Volume 93(2019:Sep.)
- Journal:
- Pattern recognition
- Issue:
- Volume 93(2019:Sep.)
- Issue Display:
- Volume 93 (2019)
- Year:
- 2019
- Volume:
- 93
- Issue Sort Value:
- 2019-0093-0000-0000
- Page Start:
- 25
- Page End:
- 35
- Publication Date:
- 2019-09
- Subjects:
- Kernel machines -- Kernel approximation -- Action recognition -- Skeletal joints -- Covariance representation
Pattern perception -- Periodicals
Perception des structures -- Périodiques
Patroonherkenning
006.4 - Journal URLs:
- http://www.sciencedirect.com/science/journal/00313203 ↗
http://www.sciencedirect.com/ ↗ - DOI:
- 10.1016/j.patcog.2019.03.031 ↗
- Languages:
- English
- ISSNs:
- 0031-3203
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 22198.xml