Appearance learning for 3D tracking of robotic surgical tools. (February 2014)

• Record Type: Journal Article
• Authors: Reiter, Austin; Allen, Peter K; Zhao, Tao
• Is Part Of: International journal of robotics research. Volume 33:Number 2(2014:Feb.)
• Page Start: 342
• Page End: 356
• Publication Date: 2014-02
• Subjects: Tool tracking -- surgical robotics -- learning features -- fusion; Robots -- Periodicals; Robots, Industrial -- Periodicals; 629.89205
• DOI: 10.1177/0278364913507796
• Languages: English
• ISSNs: 0278-3649

Abstract

In this paper, we present an appearance learning approach which is used to detect and track surgical robotic tools in laparoscopic sequences. By training a robust visual feature descriptor on low-level landmark features, we build a framework for fusing robot kinematics and 3D visual observations to track surgical tools over long periods of time across various types of environment. We demonstrate 3D tracking on multiple types of tool (with different overall appearances) as well as multiple tools simultaneously. We present experimental results using the da Vinci ® surgical robot using a combination of both ex-vivo and in-vivo environments.