Boosting prediction performance on imbalanced dataset. (2018)

• Record Type: Journal Article
• Authors: Zareapoor, Masoumeh; Shamsolmoali, Pourya
• Is Part Of: International journal of information and communication technology. Volume 13:Number 2(2018)
• Page Start: 186
• Page End: 195
• Publication Date: 2018
• Subjects: imbalanced dataset -- classification -- re-sampling -- ensemble; Information technology -- Periodicals; Computer science -- Periodicals; Telecommunication -- Periodicals; 004.05
• Languages: English
• ISSNs: 1466-6642

Abstract

Mining from imbalance data is an important problem in algorithmic and performance evaluation. When a dataset is imbalanced, the classification technique is not equal considering both the classes. It is obvious that the standard classifiers are not suitable to deal with imbalanced data, since they will likely classify all the instances into the majority class, which is the less important class. Additionally some of the performance measurement, like accuracy - which is known to be a biased metric in the case of imbalance data - does not have a very good performance when the data is imbalanced. In this paper, we tried to apply various techniques used commonly to handle class imbalance, before giving the data to the classifiers. But, the performance of the classifiers is found degrading because of the highly imbalanced nature of the datasets. Hence, we propose an integrated sampling technique with an ensemble of AdaBoost to improve the prediction performance. Meanwhile, through empirical, we show the more appropriate performance measures for mining imbalanced datasets.