Continuous lung region segmentation from endoscopic images for intra-operative navigation. (1st August 2017)

• Record Type: Journal Article
• Authors: Wu, Shuqiong; Nakao, Megumi; Matsuda, Tetsuya
• Is Part Of: Computers in biology and medicine. Volume 87(2017)
• Page Start: 200
• Page End: 210
• Publication Date: 2017-08-01
• Subjects: Endoscopic image segmentation -- GrabCut -- Optical flow -- Thoracoscopic surgery -- Lung; Medicine -- Data processing -- Periodicals; Biology -- Data processing -- Periodicals; 610.285
• DOI: 10.1016/j.compbiomed.2017.05.029
• Languages: English
• ISSNs: 0010-4825

Abstract

Abstract: Although preoperative Computed tomography images are widely used in intraoperative navigation, they can not provide precise information for organs such as the lungs, which deform severely during surgery because of deflation. By segmenting lung regions using intraoperative endoscopic images, a more accurate navigation can be obtained because endoscopic images directly provide real-time organ descriptions. However, satisfactory segmentation is rarely achieved with the algorithms in the literature due to the high deformability of the lungs and similarity between the background and object. This article addresses these problems by describing a novel approach for lung region segmentation based on endoscopic images. The proposed method leverages both GrabCut and optical flow for continuous segmentation. It also introduces a novel technique for quick user interaction, in which users are required to quickly provide a rough curve that shows the possible area of the boundary, and then a much more precise segmentation is deduced based on the rough curve. The effectiveness of the proposed approach was demonstrated by comparing it with conventional algorithms. The results show that the average F-measure of the proposed method is more than 97%. The position, size, and boundary of the lungs obtained by the proposed method can provide useful intraoperative navigation for lung resection surgeries. Highlights: Proposed a two-step lung region segmentation approach for sequential endoscopic images. In the first step, a novel method "Active-masking" is proposed to achieve precise segmentation from a rough user quick mark. In the second step, lung regions are tracked by combining GrabCut and optical flow in a novel way. Detail experiments were designed to prove the effectiveness of the proposed algorithms. Analyzed the time cost and parameter tuning of the proposed system to show its meaning in practical cases.