The bootstrap procedure in classification problems. (5th November 2020)

• Record Type: Journal Article
• Authors: Vrigazova, Borislava Petrova; Ivanov, Ivan Ganchev
• Is Part Of: International journal of data mining, modelling and management. Volume 12:Number 4(2020)
• Page Start: 428
• Page End: 446
• Publication Date: 2020-11-05
• Subjects: logistic regression -- decision tree -- k-nearest neighbour -- KNN -- the bootstrap -- cross-validation; Data mining -- Periodicals; Information science -- Periodicals; Databases -- Periodicals; 005.7
• Languages: English
• ISSNs: 1759-1163

Abstract

In classification problems, cross-validation chooses random samples from the dataset in order to improve the ability of the model to classify properly new observations in the respective class. Research articles from various fields show that when applied to regression problems, the bootstrap can improve either the prediction ability of the model or the ability for feature selection. The purpose of our research is to show that the bootstrap as a model selection procedure in classification problems can outperform cross-validation. We compare the performance measures of cross-validation and the bootstrap on a set of classification problems and analyse their practical advantages and disadvantages. We show that the bootstrap procedure can accelerate execution time compared to the cross-validation procedure while preserving the accuracy of the classification model. This advantage of the bootstrap is particularly important in big datasets as the time needed for fitting the model can be reduced without decreasing the model's performance.