Support vector machine classifier with truncated pinball loss. (August 2017)

• Record Type: Journal Article
• Authors: Shen, Xin; Niu, Lingfeng; Qi, Zhiquan; Tian, Yingjie
• Is Part Of: Pattern recognition. Volume 68(2017:Aug.)
• Page Start: 199
• Page End: 210
• Publication Date: 2017-08
• Subjects: Pinball loss -- Feature noise -- Sparsity -- Support vector machine; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2017.03.011
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: A new loss function and corresponding support vector machine are proposed. The model can handle feature noise. The model keeps sparsity to a certain extent. The problem is solved by concave-convex procedure and decomposition method. Abstract: Feature noise, namely noise on inputs is a long-standing plague to support vector machine(SVM). Conventional SVM with the hinge loss( C -SVM) is sparse but sensitive to feature noise. Instead, the pinball loss SVM( pin -SVM) enjoys noise robustness but loses the sparsity completely. To bridge the gap between C -SVM and pin -SVM, we propose the truncated pinball loss SVM( p i n ¯ -SVM) in this paper. It provides a flexible framework of trade-off between sparsity and feature noise insensitivity. Theoretical properties including Bayes rule, misclassification error bound, sparsity, and noise insensitivity are discussed in depth. To train p i n ¯ -SVM, the concave-convex procedure(CCCP) is used to handle non-convexity and the decomposition method is used to deal with the subproblem of each CCCP iteration. Accordingly, we modify the popular solver LIBSVM to conduct experiments and numerical results validate the properties of p i n ¯ -SVM on the synthetic and real-world data sets.