FIRE-DES++: Enhanced online pruning of base classifiers for dynamic ensemble selection. (January 2019)

• Record Type: Journal Article
• Authors: Cruz, Rafael M.O.; Oliveira, Dayvid V.R.; Cavalcanti, George D.C.; Sabourin, Robert
• Is Part Of: Pattern recognition. Volume 85(2019:Jan.)
• Page Start: 149
• Page End: 160
• Publication Date: 2019-01
• Subjects: Ensemble of classifiers -- Dynamic ensemble selection -- Classifier competence -- Prototype selection; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2018.07.037
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: We propose an improved version of the FIRE-DES framework called FIRE-DES++. The FIRE-DES++ framework tackles the main drawbacks from its previous version. Results show the proposed framework is more robust to imbalanced and noisy datasets. The FIRE-DES++ outperforms FIRE-DES and the state-of-the-art en- semble techniques. Abstract: Dynamic Ensemble Selection (DES) techniques aim to select one or more competent classifiers for the classification of each new test sample. Most DES techniques estimate the competence of classifiers using a given criterion over the region of competence of the test sample, usually defined as the set of nearest neighbors of the test sample in the validation set. Despite being very effective in several classification tasks, DES techniques can select classifiers that classify all samples in the region of competence as being from the same class. The Frienemy Indecision REgion DES (FIRE-DES) tackles this problem by pre-selecting classifiers that correctly classify at least one pair of samples from different classes in the region of competence of the test sample. However, FIRE-DES applies the pre-selection for the classification of a test sample if and only if its region of competence is composed of samples from different classes (indecision region), even though this criterion is not reliable for determining if a test sample is located close to the borders of classes (true indecision region) when the region of competence is obtained using classical nearest neighbors approach. Because of that, FIRE-DES mistakes noisy regions for true indecision regions, leading to the pre-selection of incompetent classifiers, and mistakes true indecision regions for safe regions, leaving samples in such regions without any pre-selection. To tackle these issues, we propose the FIRE-DES++, an enhanced FIRE-DES that removes noise and reduces the overlap of classes in the validation set; and defines the region of competence using an equal number of samples of each class, avoiding selecting a region of competence with samples of a single class. Experiments are conducted using FIRE-DES++ with 8 different dynamic selection techniques on 64 classification datasets. Experimental results show that FIRE-DES++ increases the classification performance of all DES techniques considered in this work, outperforming FIRE-DES with 7 out of the 8 DES techniques, and outperforming state-of-the-art DES frameworks.