Representation learning using deep random vector functional link networks for clustering. (September 2022)

• Record Type: Journal Article
• Authors: Hu, Minghui; Suganthan, P.N.
• Is Part Of: Pattern recognition. Volume 129(2022)
• Publication Date: 2022-09
• Subjects: Random vector functional link -- Unsupervised learning -- Consensus clustering -- Manifold regularization; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2022.108744
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: Unsupervised RVFL (usRVFL) framework based on manifold regularization proposed to perform unsupervised representation learning. Embedded features allow usRVFL to perform unsupervised tasks such as clustering. Inspired by consensus clustering, unsupervised deep RVFL proposed. Evaluations on benchmark datasets have shown that usdRVFL achieves equivalent or superior clustering performance to state-of-the-art spectral clustering methods. Abstract: Random Vector Functional Link (RVFL) Networks have received a lot of attention due to the fast training speed as the non-iterative solution characteristic. Currently, the main research direction of RVFLs has supervised learning, including semi-supervised and multi-label. There are hardly any unsupervised research results for RVFLs. In this paper, we propose the unsupervised RVFL (usRVFL), and the unsupervised framework is generic that can be used with other RVFL variants, thus we extend it to an ensemble deep variant, unsupervised deep RVFL (usdRVFL). The unsupervised method is based on the manifold regularization while the deep variant is related to the consensus clustering method, which can increase the capability and diversity of RVFLs. Our unsupervised approaches also benefit from fast training speed, even the deep variant offers a very competitive computation efficiency. Empirical experiments on several benchmark datasets demonstrated the effectiveness of the proposed algorithms.