A weighted voting ensemble of efficient regularized extreme learning machine. (July 2020)

• Record Type: Journal Article
• Authors: Shehab, Mohanad Abd; Kahraman, Nihan
• Is Part Of: Computers & electrical engineering. Volume 85(2020)
• Publication Date: 2020-07
• Subjects: Extreme learning machines -- Ensemble -- PRESS -- SVD -- Weighted majority voting -- Face recognition; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2020.106639
• Languages: English
• ISSNs: 0045-7906

Abstract

ABSTRACT : The exact evaluation of Extreme Learning Machine (ELM) compactness is difficult due to the randomness in hidden layer nodes number, weight and bias values. To overcome this randomness, and other problems such as resultant overfitting and large variance, a selective weighted voting ensemble model based on regularized ELM is investigated. It can strongly enhance the overall performance including accuracy, variance and time consumption. Efficient Prediction Sum of Squares (PRESS) criteria that utilizing Singular Value Decomposition (SVD) is proposed to address the slow execution. Furthermore, an ensemble pruning approach based on the eigenvalues for the input weight matrix is developed. In this work, the ensemble base classifiers weights are calculated based on the same PRESS error metric used for the solutions of the output weight vector (β) in RELM, thus, it can reduce computational cost and space requirement. Different state-of-the-art learning approaches and various well-known facial expressions faces and object recognition benchmark datasets were examined in this work.