Data-independent Random Projections from the feature-space of the homogeneous polynomial kernel. (October 2018)

• Record Type: Journal Article
• Authors: López-Sánchez, Daniel; Arrieta, Angélica González; Corchado, Juan M.
• Is Part Of: Pattern recognition. Volume 82(2018:Oct.)
• Page Start: 130
• Page End: 146
• Publication Date: 2018-10
• Subjects: Random Projection -- Homogeneous polynomial kernel -- Nonlinear dimensionality reduction; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2018.05.003
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: A novel kernel-based extension of the original Random Projection method is presented. The proposed method preserves distances form the feature space of polynomial kernels. This method can be used to efficiently boost the accuracy of linear classifiers. Abstract: Performing a Random Projection from the feature space associated to a kernel function may be important for two main reasons. (1) As a consequence of the Johnson–Lindestrauss lemma, the resulting low-dimensional representation will preserve most of the structure of data in the kernel feature space and (2) an efficient linear classifier trained on transformed data might approximate the accuracy of its nonlinear counterparts. In this paper, we present a novel method to perform Random Projections from the feature space of homogeneous polynomial kernels. As opposed to other kernelized Random Projection proposals, our method focuses on a specific kernel family to preserve some of the beneficial properties of the original Random Projection algorithm (e.g. data independence and efficiency). Our extensive experimental results evidence that the proposed method efficiently approximates a Random Projection from the kernel feature space, preserving pairwise distances and enabling a boost on linear classification accuracies.