Facial landmark‐guided surface matching for image‐to‐patient registration with an RGB‐D camera. Issue 3 (8th February 2022)

• Record Type: Journal Article
• Authors: Su, Yixian; Sun, Yu; Hosny, Mohamed; Gao, Wenpeng; Fu, Yili
• Is Part Of: International journal of medical robotics and computer assisted surgery. Volume 18:Issue 3(2022)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2022-02-08
• Subjects: deep learning -- facial landmark -- image‐to‐patient registration -- RGB‐D camera -- surface matching; Robotics in medicine -- Periodicals; Surgery -- Technological innovations -- Periodicals; Imaging systems in medicine -- Periodicals; 617.90285
• DOI: 10.1002/rcs.2373
• Languages: English
• ISSNs: 1478-5951

Abstract

Abstract: Background: Fiducial marker‐based image‐to‐patient registration is the most common way in image‐guided neurosurgery, which is labour‐intensive, time consuming, invasive and error prone. Methods: We proposed a method of facial landmark‐guided surface matching for image‐to‐patient registration using an RGB‐D camera. Five facial landmarks are localised from preoperative magnetic resonance (MR) images using deep learning and RGB image using Adaboost with multi‐scale block local binary patterns, respectively. The registration of two facial surface point clouds derived from MR images and RGB‐D data is initialised by aligning these five landmarks and further refined by weighted iterative closest point algorithm. Results: Phantom experiment results show the target registration error is less than 3 mm when the distance from the camera to the phantom is less than 1000 mm. The registration takes less than 10 s. Conclusions: The proposed method is comparable to the state‐of‐the‐arts in terms of the accuracy yet more time‐saving and non‐invasive.