Machine learning–based haptic‐enabled surgical navigation with security awareness. (21st October 2018)

• Record Type: Journal Article
• Authors: Tai, Yonghang; Wei, Lei; Zhou, Hailing; Li, Qiong; Huang, Xiaoqiao; Shi, Junsheng; Nahavandi, Saeid
• Other Names: Wyrzykowski Roman guestEditor.; Szymanski Boleslaw guestEditor.; Pan Lei guestEditor.; Zhang Jun guestEditor.; Oliver Jonathan guestEditor.
• Is Part Of: Concurrency and computation. Volume 31:Number 19(2019)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2018-10-21
• Subjects: biopsy -- Haptic‐enable -- machine learning -- security awareness -- surgical navigation; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.4908
• Languages: English
• ISSNs: 1532-0626

Abstract

Summary: A novel security awareness surgical navigation system has been proposed for the accurate minimally invasive surgery with machine learning algorithms, haptic‐enabled devices, and customized surgical tools to guide the surgery with real‐time force and visual navigation. To provide a direct and simplified user interface during the operation, we combined traditional surgical guide images with AR‐based view and implemented a 3D reconstructed patient‐specific surgical environment includes with all surgical requisite details. In particular, we trained the surgical collected biomechanics haptic data by employed LSTM‐based RNN algorithm, and residual network for the intraoperative force manipulation prediction and classification, respectively. Experiments evaluation results on percutaneous therapy surgery demonstrated a higher performance and distinguished accuracy by the visual and haptic combined than the traditional navigation system. These preliminary study findings may suggested a new framework in the minimally invasive surgical navigation application and hint at the possibility integration of haptic, AR, and machine learning algorithms implementation in medical simulation. In addition, we take security into account when implementation this new framework.