DSRD-Net: Dual-stream residual dense network for semantic segmentation of instruments in robot-assisted surgery. (15th September 2022)

• Record Type: Journal Article
• Authors: Mahmood, Tahir; Cho, Se Woon; Park, Kang Ryoung
• Is Part Of: Expert systems with applications. Volume 202(2022)
• Publication Date: 2022-09-15
• Subjects: Surgical instruments segmentation -- Minimally invasive surgery -- Gastrointestinal endoscopy and abdominal porcine procedures -- DSRD-Net; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2022.117420
• Languages: English
• ISSNs: 0957-4174

Abstract

Highlights: DSRD-Net can extract multiscale context features of surgical instruments. The proposed residual dense combination efficiently resolves the latency problem. A minimal number of layers are used to prevent loss with small number of parameters. Our trained model and code are publicly available. Abstract: In conventional robot-assisted minimally invasive procedures (RMIS), surgeons have narrow visual and complex working spaces, along with specular reflection, blood, camera-lens fogging, and complex backgrounds, which increase the risk of human error and tissue damage. The use of deep learning-based techniques can decrease these risks by providing segmented instruments, real-time tracking, pose estimation, and surgeons' skill assessment. Recently, several deep learning-based methods have been proposed for surgical instrument segmentation. These methods have shown significant performance for the RMIS. However, we found that most of these methods still have scope for improvement in terms of accuracy, robustness, and computational cost. In addition, gastrointestinal pathologies have not been explored in previous studies. Therefore, we propose a dual-stream residual dense network (DSRD-Net), an accurate and robust deep learning-based surgical instrument segmentation method that mainly utilizes the strength of residual, dense, and atrous spatial pyramid pooling architectures. Our proposed method was tested on publicly available gastrointestinal endoscopy (the Kvasir-Instrument Dataset) and abdominal porcine procedures datasets (The 2017 Robotic Instrument Segmentation Challenge Dataset). The experimental results show that the proposed method outperforms the state-of-the-art methods.