Support vector machine classifier with huberized pinball loss. (May 2020)

• Record Type: Journal Article
• Authors: Zhu, Wenxin; Song, Yunyan; Xiao, Yingyuan
• Is Part Of: Engineering applications of artificial intelligence. Volume 91(2020)
• Publication Date: 2020-05
• Subjects: Support vector machine -- Huberized pinball loss -- Proximal gradient -- Wilcoxon signed rank test -- Friedman test -- ROC curve -- AUC; Engineering -- Data processing -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Ingénierie -- Informatique -- Périodiques; Intelligence artificielle -- Périodiques; Systèmes experts (Informatique) -- Périodiques; Artificial intelligence; Engineering -- Data processing; Expert systems (Computer science); Periodicals; 620.00285
• DOI: 10.1016/j.engappai.2020.103635
• Languages: English
• ISSNs: 0952-1976

Abstract

Abstract: The original support vector machine (SVM) uses the hinge loss function, which is non-differentiable and makes the problem difficult to solve in particular for regularized SVM, such as with ℓ 1 -regularized. On the other hand, the hinge loss is sensitive to noise. To circumvent these drawbacks, a huberized pinball loss function is proposed. It is less sensitive to noise, similar to the pinball loss which is related to the quantile distance. The proposed loss function is differentiable everywhere and this differentiability can significantly reduce the computational cost for the SVM algorithm. The elastic net penalty is applied to the SVM and the support vector machine classifier with huberized pinball loss (HPSVM) is proposed. Due to the continuous differentiability of the huberized pinball loss function, the Proximal Gradient method is used to solve the proposed model. The numerical experiments on synthetic data, real world datasets confirm the robustness and effectiveness of the proposed method. Statistical comparison is performed to show the significant difference between the proposed method and other compered ones.