Cascade Support Vector Machines with Dimensionality Reduction. (15th January 2015)

• Record Type: Journal Article
• Authors: Kramer, Oliver
• Other Names: Ventura Sebastian Academic Editor.
• Is Part Of: Applied computational intelligence and soft computing. Volume 2015(2015)
• Publication Date: 2015-01-15
• Subjects: Computational intelligence -- Periodicals; Soft computing -- Periodicals; 006.305
• DOI: 10.1155/2015/216132
• Languages: English
• ISSNs: 1687-9724

Abstract

Abstract : Cascade support vector machines have been introduced as extension of classic support vector machines that allow a fast training on large data sets. In this work, we combine cascade support vector machines with dimensionality reduction based preprocessing. The cascade principle allows fast learning based on the division of the training set into subsets and the union of cascade learning results based on support vectors in each cascade level. The combination with dimensionality reduction as preprocessing results in a significant speedup, often without loss of classifier accuracies, while considering the high-dimensional pendants of the low-dimensional support vectors in each new cascade level. We analyze and compare various instantiations of dimensionality reduction preprocessing and cascade SVMs with principal component analysis, locally linear embedding, and isometric mapping. The experimental analysis on various artificial and real-world benchmark problems includes various cascade specific parameters like intermediate training set sizes and dimensionalities.