A dynamic routing CapsNet based on increment prototype clustering for overcoming catastrophic forgetting. Issue 1 (18th September 2021)

• Record Type: Journal Article
• Authors: Wang, Meng; Guo, Zhengbing; Li, Huafeng
• Is Part Of: IET computer vision. Volume 16:Issue 1(2022)
• Page Start: 83
• Page End: 97
• Publication Date: 2021-09-18
• Subjects: capsule network -- catastrophic forgetting -- continual learning -- dynamic routing -- prototype clustering; computer vision -- learning (artificial intelligence) -- image classification -- neural nets -- pattern clustering; Computer vision -- Periodicals; Pattern recognition systems -- Periodicals; 006.37
• DOI: 10.1049/cvi2.12068
• Languages: English
• ISSNs: 1751-9632

Abstract

Abstract: In continual learning, previously learnt knowledge tends to be overlapped by the subsequent training tasks. This bottleneck, known as catastrophic forgetting, has recently been relieved between vision tasks involving pixel shuffles etc. Nevertheless, the challenge lies in the continuous classification of the sequential sets discriminated by global transformations, such as excessively spatial rotations. Aim at this, a novel strategy of dynamic memory routing is proposed to dominate the forward paths of capsule network (CapsNet) according to the current input sets. To recall previous knowledge, a binary routing table is maintained among these sequential tasks. Then, an increment procedure of competitive prototype clustering is integrated to update the routing of the current task. Moreover, a sparsity measurement is employed to decouple the salient routing among the different learnt tasks. The experimental results demonstrate the superiority of the proposed memory network over the state–of–the–art approaches by the recalling evaluations on extended sets of Cifar–100, CelebA and Tiny ImageNet etc.