Smoothly approximated support vector domain description. (January 2016)

• Record Type: Journal Article
• Authors: Zheng, Songfeng
• Is Part Of: Pattern recognition. Volume 49(2016:Jan.)
• Page Start: 55
• Page End: 64
• Publication Date: 2016-01
• Subjects: Support vector domain description -- Smooth approximation -- Quadratic programming -- conjugate gradient; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2015.07.003
• Languages: English
• ISSNs: 0031-3203

Abstract

Abstract: Support vector domain description (SVDD) is a well-known tool for pattern analysis when only positive examples are reliable. The SVDD model is often fitted by solving a quadratic programming problem, which is time consuming. This paper attempts to fit SVDD in the primal form directly. However, the primal objective function of SVDD is not differentiable which prevents the well-behaved gradient based optimization methods from being applicable. As such, we propose to approximate the primal objective function of SVDD by a differentiable function, and a conjugate gradient method is applied to minimize the smoothly approximated objective function. Extensive experiments on pattern classification were conducted, and compared to the quadratic programming based SVDD, the proposed approach is much more computationally efficient and yields similar classification performance on these problems. Abstract : Highlights: Smoothly approximates the objective function of support vector domain description. Gradient based optimization method could be applied to the smoothed model. The proposed algorithms have asymptotic training complexity ( n 2 ) . The algorithm is easy to implement, without requiring any optimization package.