Smoothing L0 Regularization for Extreme Learning Machine. (6th July 2020)

• Record Type: Journal Article
• Authors: Fan, Qinwei; Liu, Ting
• Other Names: Leiviskä Kauko Academic Editor.
• Is Part Of: Mathematical problems in engineering. Volume 2020(2020)
• Publication Date: 2020-07-06
• Subjects: Engineering mathematics -- Periodicals; 510.2462
• DOI: 10.1155/2020/9175106
• Languages: English
• ISSNs: 1024-123X

Abstract

Abstract : Extreme learning machine (ELM) has been put forward for single hidden layer feedforward networks. Because of its powerful modeling ability and it needs less human intervention, the ELM algorithm has been used widely in both regression and classification experiments. However, in order to achieve required accuracy, it needs many more hidden nodes than is typically needed by the conventional neural networks. This paper considers a new efficient learning algorithm for ELM with smoothing L 0 regularization. A novel algorithm updates weights in the direction along which the overall square error is reduced the most and then this new algorithm can sparse network structure very efficiently. The numerical experiments show that the ELM algorithm with smoothing L 0 regularization has less hidden nodes but better generalization performance than original ELM and ELM with L 1 regularization algorithms.