Bioinspired Co‐Design of Tactile Sensor and Deep Learning Algorithm for Human–Robot Interaction. (26th April 2022)

• Record Type: Journal Article
• Authors: Kong, Depeng; Yang, Geng; Pang, Gaoyang; Ye, Zhiqiu; Lv, Honghao; Yu, Zhangwei; Wang, Fei; Wang, Xi Vincent; Xu, Kaichen; Yang, Huayong
• Is Part Of: Advanced intelligent systems. Volume 4:Number 6(2022)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2022-04-26
• Subjects: data augmentation -- deep learning -- human–robot interaction -- tactile sensor; Artificial intelligence -- Periodicals; Robotics -- Periodicals; Control theory -- Periodicals; 006.3
• DOI: 10.1002/aisy.202200050
• Languages: English
• ISSNs: 2640-4567

Abstract

Abstract : Robots equipped with bionic skins for enhancing the robot perception capability are increasingly deployed in wide applications ranging from healthcare to industry. Artificial intelligence algorithms that can provide bionic skins with efficient signal processing functions further accelerate the development of this trend. Inspired by the somatosensory processing hierarchy of humans, the bioinspired co‐design of a tactile sensor and a deep learning‐based algorithm is proposed herein, simplifying the sensor structure while providing computation‐enhanced tactile sensing performance. The soft piezoresistive sensor, based on the carbon black‐coated polyurethane sponge, offers a continuous sensing area. By utilizing a customized deep neural network (DNN), it can detect external tactile stimulus spatially continuously. Besides, a novel data augmentation method is developed based on the sensor's hexagonal structure that has a sixfold rotation symmetry. It can significantly enhance the generalization ability of the DNN model by enriching the collected training data with generated pseudo‐data. The functionality of the sensor and the robustness of the proposed data augmentation strategy are verified by precisely recognizing five touch modalities, illustrating a well‐generalized performance, and providing a promising application prospect in human–robot interaction. Abstract : Herein, the bioinspired co‐design of deep learning algorithms and tactile sensor is implemented. By utilizing deep neural networks (DNNs), the tactile sensor can effectively detect the location and magnitude of external force and recognize touch modalities. Besides, a novel data augmentation method is developed based on the sensor's rotation symmetry structure, which enhances the DNNs' generalization performance.