A dual evolutionary bagging for class imbalance learning. (15th November 2022)

• Record Type: Journal Article
• Authors: Guo, Yinan; Feng, Jiawei; Jiao, Botao; Cui, Ning; Yang, Shengxiang; Yu, Zekuan
• Is Part Of: Expert systems with applications. Volume 206(2022)
• Publication Date: 2022-11-15
• Subjects: Imbalance learning -- Multi-modal genetic algorithm -- Oversampling -- Ensemble structure; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2022.117843
• Languages: English
• ISSNs: 0957-4174

Abstract

Abstract: Bagging, as a commonly-used class imbalance learning method, combines resampling techniques with ensemble learning to provide a strong classifier with high generalization for a skewed dataset. However, integrating different numbers of base classifiers may obtain the same classification performance, called multi-modality. To seek the most compact ensemble structure with the highest accuracy, a dual evolutionary bagging framework composed of inner and outer ensemble models is proposed. In inner ensemble model, three sub-classifiers are built by SVM, MLP and DT, respectively, with the purpose of enhancing the diversity among them. For each sub-dataset, a classifier with the best performance is selected as a base classifier of outer ensemble model. Following that, all optimal combinations of base classifiers is found by a multi-modal genetic algorithm with a niche strategy in terms of their average G-mean. A combination that aggregates the smallest number of base classifiers by the weighted sum forms the final ensemble structure. Experimental results on 40 KEEL benchmark datasets and a practical one of coal burst show that dual ensemble framework proposed in the paper provides the simplest ensemble structure with the best classification accuracy for imbalance datasets and outperforms the state-of-the-art ensemble learning methods. Highlights: A dual-ensemble framework for class imbalanced datasets is constructed. Optimizing the base classifier for each sub-dataset in inner ensemble. Multi-modal genetic algorithm is employed to seek the optimal ensemble model.