Sparse Lq-norm least squares support vector machine with feature selection. (June 2018)

• Record Type: Journal Article
• Authors: Shao, Yuan-Hai; Li, Chun-Na; Liu, Ming-Zeng; Wang, Zhen; Deng, Nai-Yang
• Is Part Of: Pattern recognition. Volume 78(2018:Jun.)
• Page Start: 167
• Page End: 181
• Publication Date: 2018-06
• Subjects: Least squares support vector machine (LS-SVM) -- Lq-norm -- Feature selection -- Sparse approximation -- Global optimality; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2018.01.016
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: We propose an Lq -norm LS-SVM with feature selection for small size samples. Feature selection is achieved effectively by minimizing the Lq -norm of weight. The number of selected features can be adjusted by choosing the parameters. An efficient iterative global convergent algorithm is introduced to solve the primal problem. Experimental results show its feasibility and efficiency. Abstract: Least squares support vector machine (LS-SVM) is a popular hyperplane-based classifier and has attracted many attentions. However, it may suffer from singularity or ill-condition issue for the small sample size (SSS) problem where the sample size is much smaller than the number of features of a data set. Feature selection is an effective way to solve this problem. Motivated by this, in the paper, we propose a sparse Lq -norm least squares support vector machine ( Lq -norm LS-SVM) with 0 < q < 1, where feature selection and prediction are performed simultaneously. Different from traditional LS-SVM, our Lq -norm LS-SVM minimizes the Lq -norm of weight and releases the least squares problem in primal space, resulting in that feature selection can be achieved effectively and small enough number of features can be selected by adjusting the parameters. Furthermore, our Lq -norm LS-SVM can be solved by an efficient iterative algorithm, which is proved to be convergent to a global optimal solution under some assumptions on the sparsity. The effectiveness of the proposed Lq -norm LS-SVM is validated via theoretical analysis as well as some illustrative numerical experiments.