A dynamic routing CapsNet based on increment prototype clustering for overcoming catastrophic forgetting. Issue 1 (18th September 2021)
- Record Type:
- Journal Article
- Title:
- A dynamic routing CapsNet based on increment prototype clustering for overcoming catastrophic forgetting. Issue 1 (18th September 2021)
- Main Title:
- A dynamic routing CapsNet based on increment prototype clustering for overcoming catastrophic forgetting
- Authors:
- Wang, Meng
Guo, Zhengbing
Li, Huafeng - Abstract:
- Abstract: In continual learning, previously learnt knowledge tends to be overlapped by the subsequent training tasks. This bottleneck, known as catastrophic forgetting, has recently been relieved between vision tasks involving pixel shuffles etc. Nevertheless, the challenge lies in the continuous classification of the sequential sets discriminated by global transformations, such as excessively spatial rotations. Aim at this, a novel strategy of dynamic memory routing is proposed to dominate the forward paths of capsule network (CapsNet) according to the current input sets. To recall previous knowledge, a binary routing table is maintained among these sequential tasks. Then, an increment procedure of competitive prototype clustering is integrated to update the routing of the current task. Moreover, a sparsity measurement is employed to decouple the salient routing among the different learnt tasks. The experimental results demonstrate the superiority of the proposed memory network over the state–of–the–art approaches by the recalling evaluations on extended sets of Cifar–100, CelebA and Tiny ImageNet etc.
- Is Part Of:
- IET computer vision. Volume 16:Issue 1(2022)
- Journal:
- IET computer vision
- Issue:
- Volume 16:Issue 1(2022)
- Issue Display:
- Volume 16, Issue 1 (2022)
- Year:
- 2022
- Volume:
- 16
- Issue:
- 1
- Issue Sort Value:
- 2022-0016-0001-0000
- Page Start:
- 83
- Page End:
- 97
- Publication Date:
- 2021-09-18
- Subjects:
- capsule network -- catastrophic forgetting -- continual learning -- dynamic routing -- prototype clustering
computer vision -- learning (artificial intelligence) -- image classification -- neural nets -- pattern clustering
Computer vision -- Periodicals
Pattern recognition systems -- Periodicals
006.37 - Journal URLs:
- http://digital-library.theiet.org/content/journals/iet-cvi ↗
http://www.ietdl.org/IET-CVI ↗
https://ietresearch.onlinelibrary.wiley.com/journal/17519640 ↗
http://www.theiet.org/ ↗ - DOI:
- 10.1049/cvi2.12068 ↗
- Languages:
- English
- ISSNs:
- 1751-9632
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - 4363.252250
British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 26270.xml