Representation learning by hierarchical ELM auto‐encoder with double random hidden layers. Issue 4 (8th May 2019)

• Record Type: Journal Article
• Authors: Li, Rui; Wang, Xiaodan; Lei, Lei; Wu, Chongming
• Is Part Of: IET computer vision. Volume 13:Issue 4(2019)
• Page Start: 411
• Page End: 419
• Publication Date: 2019-05-08
• Subjects: learning (artificial intelligence) -- pattern classification; random hidden mapping layers -- output layer -- decoding feature -- stacking DELM-AE -- hierarchical structure -- H-DELM model -- feature representation -- original input information -- original input data -- expressive feature -- compact feature -- deep learning algorithms -- extreme learning machine -- multilayer network architecture lead -- extremely fast training speed -- expressive representation learning method -- hierarchical ELM -- H-ELM -- novel architectural unit -- double random hidden layers ELM -- auto-encoder -- novel DELM-AE -- research developments -- relevant multilayer ELM; Computer vision -- Periodicals; Pattern recognition systems -- Periodicals; 006.37
• DOI: 10.1049/iet-cvi.2018.5590
• Languages: English
• ISSNs: 1751-9632

Abstract

Abstract : Recent research developments of extreme learning machine (ELM) with multilayer network architecture lead to a promising high performance with extremely fast training speed for representation learning. In this work, the authors are dedicated to develop an efficient and expressive representation learning method with hierarchical ELM, and proposing a novel architectural unit named as double random hidden layers ELM auto‐encoder (DELM‐AE). The novel DELM‐AE consists of one input layer, two random hidden mapping layers for encoding feature, and one output layer for decoding feature. When stacking DELM‐AE in the hierarchical structure, they can construct an H‐DELM model, where the input of the current AE is the feature representation learned by the previous one, but the output is identical to the original input information and is not the input. Hence, the H‐DELM can reproduce the original input data as much as possible to learn more expressive and compact feature. They validate their method on various widely public datasets, and the results demonstrate that H‐DELM can bring significant performance improvements in terms of classification accuracy and robustness compared with existing relevant multilayer ELM and other deep learning algorithms at a slight computational cost.