A deep-learning real-time visual SLAM system based on multi-task feature extraction network and self-supervised feature points. (15th January 2021)

• Record Type: Journal Article
• Authors: Li, Guangqiang; Yu, Lei; Fei, Shumin
• Is Part Of: Measurement. Volume 168(2021)
• Publication Date: 2021-01-15
• Subjects: Simultaneous localization and mapping (SLAM) -- Convolutional neural network (CNN) -- Deep learning -- Self-supervised feature points; Weights and measures -- Periodicals; Measurement -- Periodicals; Measurement; Weights and measures; Periodicals; 530.8
• DOI: 10.1016/j.measurement.2020.108403
• Languages: English
• ISSNs: 0263-2241

Abstract

Highlights: A simplified multi-task CNN is used for feature detection. Features keep the same descriptor format as the ORB features. Depth information of the RGB-D camera is adopted to construct the dense 3D map. Abstract: Simultaneous Localization and Mapping (SLAM) is the basis for intelligent mobile robots to work in unknown environments. However, traditional feature extraction algorithms that traditional visual SLAM systems rely on have difficulty dealing with texture-less regions and other complex scenes, which limits the development of visual SLAM. The studies of feature points extraction adopting deep learning show that this method has more advantages than traditional methods in dealing with complex scenes, but these studies consider accuracy while ignoring the efficiency. To solve these problems, this paper proposes a deep-learning real-time visual SLAM system based on multi-task feature extraction network and self-supervised feature points. By designing a simplified Convolutional Neural Network (CNN) for detecting feature points and descriptors to replace the traditional feature extractor, the accuracy and stability of the visual SLAM system are enhanced. The experimental results in a dataset and real environments show that the proposed system can maintain high accuracy in a variety of challenging scenes, run on a GPU in real-time, and support the construction of dense 3D maps. Moreover, its overall performance is better than the current traditional visual SLAM system.