Efficient continual learning at the edge with progressive segmented training. Issue 4 (1st December 2022)

• Record Type: Journal Article
• Authors: Du, Xiaocong; Venkataramanaiah, Shreyas Kolala; Li, Zheng; Suh, Han-Sok; Yin, Shihui; Krishnan, Gokul; Liu, Frank; Seo, Jae-sun; Cao, Yu
• Is Part Of: Neuromorphic computing and engineering. Volume 2:Issue 4(2022)
• Publication Date: 2022-12-01
• Subjects: continual learning -- acquisitive learning -- deep neural network -- brain inspiration -- model adaption; Neural networks (Computer science) -- Periodicals; Neural computers -- Periodicals; Neuromorphics -- Periodicals; 006.3
• DOI: 10.1088/2634-4386/ac9899
• Languages: English
• ISSNs: 2634-4386

Abstract

Abstract: There is an increasing need for continual learning in dynamic systems at the edge, such as self-driving vehicles, surveillance drones, and robotic systems. Such a system requires learning from the data stream, training the model to preserve previous information and adapt to a new task, and generating a single-headed vector for future inference, within a limited power budget. Different from previous continual learning algorithms with dynamic structures, this work focuses on a single network and model segmentation to mitigate catastrophic forgetting problem. Leveraging the redundant capacity of a single network, model parameters for each task are separated into two groups: one important group which is frozen to preserve current knowledge, and a secondary group to be saved (not pruned) for future learning. A fixed-size memory containing a small amount of previously seen data is further adopted to assist the training. Without additional regularization, the simple yet effective approach of progressive segmented training (PST) successfully incorporates multiple tasks and achieves state-of-the-art accuracy in the single-head evaluation on the CIFAR-10 and CIFAR-100 datasets. Moreover, the segmented training significantly improves computation efficiency in continual learning and thus, enabling efficient continual learning at the edge. On Intel Stratix-10 MX FPGA, we further demonstrate the efficiency of PST with representative CNNs trained on CIFAR-10.