Robust support vector machines based on the rescaled hinge loss function. (March 2017)

• Record Type: Journal Article
• Authors: Xu, Guibiao; Cao, Zheng; Hu, Bao-Gang; Principe, Jose C.
• Is Part Of: Pattern recognition. Volume 63(2017:Mar.)
• Page Start: 139
• Page End: 148
• Publication Date: 2017-03
• Subjects: Support vector machine -- Robustness -- Rescaled hinge loss -- Half-quadratic optimization; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2016.09.045
• Languages: English
• ISSNs: 0031-3203

Abstract

Abstract: The support vector machine ( SVM ) is a popular classifier in machine learning, but it is not robust to outliers. In this paper, based on the Correntropy induced loss function, we propose the rescaled hinge loss function which is a monotonic, bounded and nonconvex loss that is robust to outliers. We further show that the hinge loss is a special case of the proposed rescaled hinge loss. Then, we develop a new robust SVM based on the rescaled hinge loss. After using the half-quadratic optimization method, we find that the new robust SVM is equivalent to an iterative weighted SVM, which can help explain the robustness of iterative weighted SVM from a loss function perspective. Experimental results confirm that the new robust SVM not only performs better than SVM and the existing robust SVMs on the datasets that have outliers, but also presents better sparseness than SVM. Abstract : Highlights: We propose a new loss function called the rescaled hinge loss function. The hinge loss function is a special case of the rescaled hinge loss function. We develop a new robust SVM based on the rescaled hinge loss function. The new robust SVM is equivalent to an iterative weighted SVM.