A geometry‐based two‐step method for nonlinear classification using quasi‐linear support vector machine. Issue 6 (14th July 2017)

• Record Type: Journal Article
• Authors: Li, Weite; Zhou, Bo; Chen, Benhui; Hu, Jinglu
• Is Part Of: IEEJ transactions on electrical and electronic engineering. Volume 12:Issue 6(2017)
• Page Start: 883
• Page End: 890
• Publication Date: 2017-07-14
• Subjects: nonlinear classification -- support vector machine -- kernel composition -- multiple local linear classifiers; Electrical engineering -- Periodicals; Electronics -- Periodicals; 621.3
• DOI: 10.1002/tee.22479
• Languages: English
• ISSNs: 1931-4973

Abstract

Abstract : This paper proposes a two‐step method to construct a nonlinear classifier consisting of multiple local linear classifiers interpolated with a basis function. In the first step, a geometry‐based approach is first introduced to detect local linear partitions and build local linear classifiers. A coarse nonlinear classifier can then be constructed by interpolating the local linear classifiers. In the second step, a support vector machine (SVM) formulation is used to further implicitly optimize the linear parameters of the nonlinear classifier. In this way, the nonlinear classifier is constructed in exactly the same way as a standard SVM, using a special data‐dependent quasi‐linear kernel composed of the information of the local linear partitions. Numerical experiments on several real‐world datasets demonstrate the effectiveness of the proposed classifier and show that, in cases where traditional nonlinear SVMs run into overfitting problems, the proposed classifier is effective in improving the classification performance. © 2017 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.