A fast kernel extreme learning machine based on conjugate gradient. (2nd October 2018)

• Record Type: Journal Article
• Authors: He, Chunmei; Xu, Fanhua; Liu, Yaqi; Zheng, Jinhua
• Is Part Of: Network. Volume 29:Number 1/4(2018)
• Page Start: 70
• Page End: 80
• Publication Date: 2018-10-02
• Subjects: Kernel extreme learning machine -- conjugate gradient method -- generalization ability -- image restoration; Neural computers -- Periodicals; Neural networks (Computer science) -- Periodicals; 006.32
• DOI: 10.1080/0954898X.2018.1562247
• Languages: English
• ISSNs: 0954-898X

Abstract

ABSTRACT: Kernel extreme learning machine (KELM) introduces kernel leaning into extreme learning machine (ELM) in order to improve the generalization ability and stability. But the Penalty parameter in KELM is randomly set and it has a strong impact on the performance of KELM. A fast KELM combining the conjugate gradient method (CG-KELM) is presented in this paper. The CG-KELM computes the output weights of the neural network by the conjugate gradient iteration method. There is no penalty parameter to be set in CG-KELM. Therefore, the CG-KELM has good generalization ability and fast learning speed. The simulations in image restoration show that CG-KELM outperforms KELM. The CG-KELM provides a balanced method between KELM and ELM.