A portable, self-contained neuroprosthetic hand with deep learning-based finger control. (11th October 2021)

• Record Type: Journal Article
• Authors: Nguyen, Anh Tuan; Drealan, Markus W; Khue Luu, Diu; Jiang, Ming; Xu, Jian; Cheng, Jonathan; Zhao, Qi; Keefer, Edward W; Yang, Zhi
• Is Part Of: Journal of neural engineering. Volume 18:Number 5(2021)
• Publication Date: 2021-10-11
• Subjects: artificial intelligence -- deep learning -- electroneurography (ENG) -- motor decoding -- NVIDIA Jetson Nano -- neuroprosthesis -- peripheral nerve; Neurosciences -- Periodicals; Biomedical engineering -- Periodicals; 612.8
• DOI: 10.1088/1741-2552/ac2a8d
• Languages: English
• ISSNs: 1741-2560

Abstract

Abstract: Objective. Deep learning-based neural decoders have emerged as the prominent approach to enable dexterous and intuitive control of neuroprosthetic hands. Yet few studies have materialized the use of deep learning in clinical settings due to its high computational requirements. Approach. Recent advancements of edge computing devices bring the potential to alleviate this problem. Here we present the implementation of a neuroprosthetic hand with embedded deep learning-based control. The neural decoder is designed based on the recurrent neural network architecture and deployed on the NVIDIA Jetson Nano—a compacted yet powerful edge computing platform for deep learning inference. This enables the implementation of the neuroprosthetic hand as a portable and self-contained unit with real-time control of individual finger movements. Main results. A pilot study with a transradial amputee is conducted to evaluate the proposed system using peripheral nerve signals acquired from implanted intrafascicular microelectrodes. The preliminary experiment results show the system's capabilities of providing robust, high-accuracy (95%–99%) and low-latency (50–120 ms) control of individual finger movements in various laboratory and real-world environments. Conclusion. This work is a technological demonstration of modern edge computing platforms to enable the effective use of deep learning-based neural decoders for neuroprosthesis control as an autonomous system. Significance. The proposed system helps pioneer the deployment of deep neural networks in clinical applications underlying a new class of wearable biomedical devices with embedded artificial intelligence. Clinical trial registration: DExterous Hand Control Through Fascicular Targeting (DEFT). Identifier: NCT02994160.