A hybrid transfer learning algorithm incorporating TrSVM with GASEN. (August 2019)

• Record Type: Journal Article
• Authors: Ye, Rui; Dai, Qun; Li, MeiLing
• Is Part Of: Pattern recognition. Volume 92(2019:Aug.)
• Page Start: 192
• Page End: 202
• Publication Date: 2019-08
• Subjects: Transfer learning -- Ensemble selection -- Genetic Algorithm based Selective Ensemble algorithm (GASEN) -- Support Vector Machine based Transfer Learning algorithm (TrSVM) -- Transfer Learning algorithm incorporating TrSVM with GASEN (TrGASVM); Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2019.03.027
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: TrSVM is a novel transfer learning model based on Support Vector Machine. TrSVM constructs a representative subset of source data by using support vectors. TrSVM discards redundant data and effectively reduces the computational cost. TrGASVM assigns corresponding weights to different support vectors in the representative subset of source data. TrGASVM accomplishes the pruning process by incorporating the principle of GASEN. Abstract: Traditional machine learning is generally committed to obtaining classifiers which are well-performed over unlabeled test data. This usually relies on two critical assumptions: firstly, sufficient labeled training data are available; secondly, training and testing data are drawn from the same distribution and the same feature space. Unfortunately, in most cases, the actual situation is difficult to meet the above conditions. Transfer learning scheme is naturally proposed to alleviate this problem. In order to get robust classifiers with relatively lower computational costs, we incorporate the rationale of Support Vector Machine (SVM) into transfer learning scheme and propose a novel SVM-based transfer learning model, abbreviated as TrSVM. In this method, support vector sets are extracted to represent the source domain. New training datasets are respectively constructed by combining each support vector set and target labeled dataset. On the basis of these training datasets, a number of new base classifiers can be acquired. Since performance of a classifiers ensemble is generally superior to that of individual classifiers, ensemble selection is utilized in our work. A hybrid transfer learning algorithm, integrating the Genetic Algorithm based Selective Ensemble (GASEN) with TrSVM, is proposed, and abbreviated as TrGASVM, naturally. GASEN is a genetic algorithm-based heuristic algorithm for solving combinatorial optimization problems. It can not only enhance the generalization ability of an ensemble, but also alleviate the local minimum problem of greedy ensemble pruning methods. Since TrGASVM is under frame of TrSVM and GASEN, it inevitably inherits the advantages of both algorithms. The reasonable incorporation of TrSVM with GASEN endows TrGASVM with favorable transfer learning capability, with its effectiveness being demonstrated by the experimental results on three real-world text classification datasets.