Support subsets estimation for support vector machines retraining. (February 2023)

• Record Type: Journal Article
• Authors: Aceña, Víctor; Martín de Diego, Isaac; R． Fernández, Rubén; M． Moguerza, Javier
• Is Part Of: Pattern recognition. Volume 134(2023)
• Publication Date: 2023-02
• Subjects: Support subset -- SVM -- Incremental learning -- Retraining -- Alpha seeding; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2022.109117
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: A new retraining methodology for SVMs is proposed The new concept of Support Subsets is introduced Methodology proposal reduces complexity computation for SVM training Imbalance datasets produce balanced Support Subsets The proposal compares successfully to well-known retraining techniques Abstract: The availability of new data in previously trained Machine Learning ( ML ) models usually requires retraining and adjustment of the model. Support Vector Machine s ( SVM s) are widely used in ML because of their strong mathematical foundations and flexibility. However, SVM training is computationally expensive, both in time and memory. Hence, the training phase might be a limitation in problems where the model is updated regularly. As a solution, new methods for training and updating SVM s have been proposed in the past. In this paper, we introduce the concept of Support Subset and a new retraining methodology for SVM s. A Support Subset is a subset of the training set, such that retraining a ML model with this subset and the new data is equivalent to training with all the data. The performance of the proposal is evaluated in a variety of experiments on simulated and real datasets in terms of time, quality of the solution, resultant support vectors, and amount of employed data. The promising results provide a new research line for improving the effectiveness and adaptability of the proposed technique, including its generalization to other ML models.