Ensemble of penalized logistic models for classification of high-dimensional data. Issue 7 (12th August 2021)

• Record Type: Journal Article
• Authors: Ijaz, Musarrat; Asghar, Zahid; Gul, Asma
• Is Part Of: Communications in statistics. Volume 50:Issue 7(2021)
• Page Start: 2072
• Page End: 2088
• Publication Date: 2021-08-12
• Subjects: Classification -- High-dimension data -- Ensemble method -- Penalized logistic models; Mathematical statistics -- Periodicals; Mathematical statistics -- Data processing -- Periodicals; Digital computer simulation -- Periodicals; 519.5
• DOI: 10.1080/03610918.2019.1595647
• Languages: English
• ISSNs: 0361-0918

Abstract

Abstract: Classification of High-dimensional data, such as gene expression data having far more variables (genes) than observations, is challenging. Classifiers aggregation known as ensemble method has proven improved classification accuracy in a wide range of applications. In this study, we propose an Ensemble of Penalized Logistic models (EPL) which utilizes Ridge regression, Lasso and Elastic net as base learners for ensemble generation. Classification is done on the basis of majority votes of the models. The EPL is assessed on both simulated data and bench mark microarray data sets. Its performance in terms of classification accuracy is compared with state-of-the-art classifiers, i.e., Support Vector Machines (SVM), K-Nearest Neighbors (KNN) and Random Forest (RF). The experimental comparisons show that the EPL has high classification accuracy as compared to the other classifiers considered here.