Patch-based field-of-view matching in multi-modal images for electroporation-based ablations. (September 2020)

• Record Type: Journal Article
• Authors: Lafitte, L.; Giraud, R.; Zachiu, C.; Ries, M.; Sutter, O.; Petit, A.; Seror, O.; Poignard, C.; de Senneville, B. Denis
• Is Part Of: Computerized medical imaging and graphics. Volume 84(2020)
• Publication Date: 2020-09
• Subjects: Multi-modal image registration -- Patch-based matching -- Interventional procedures; Diagnostic imaging -- Periodicals; Imaging systems in medicine -- Periodicals; Diagnosis, Radioscopic -- Data processing -- Periodicals; Diagnostic Imaging -- Periodicals; Imagerie pour le diagnostic -- Périodiques; Diagnostic imaging; Periodicals; Electronic journals; Electronic journals; 616.0754
• DOI: 10.1016/j.compmedimag.2020.101750
• Languages: English
• ISSNs: 0895-6111

Abstract

Highlights: A new fast method – using as a starting-point a 3D modified PatchMatch algorithm – is proposed to align the field-of-view in medical 3D images. The modified PatchMatch algorithm is combined with a well-adapted multi-modal image similarity metric in order to cope with multi-modal medical images. The performance – in terms of registration accuracy and computational needs – is analyzed, and demonstrated to be compatible with clinical constraints in the practical case of on-line irreversible electroporation procedures. The benefit of proposed approach is evaluated for a potential pre-conditioning of a more complex multi-modal deformable image registration algorithm. Abstract: Various multi-modal imaging sensors are currently involved at different steps of an interventional therapeutic work-flow. Cone beam computed tomography (CBCT), computed tomography (CT) or Magnetic Resonance (MR) images thereby provides complementary functional and/or structural information of the targeted region and organs at risk. Merging this information relies on a correct spatial alignment of the observed anatomy between the acquired images. This can be achieved by the means of multi-modal deformable image registration (DIR), demonstrated to be capable of estimating dense and elastic deformations between images acquired by multiple imaging devices. However, due to the typically different field-of-view (FOV) sampled across the various imaging modalities, such algorithms may severely fail in finding a satisfactory solution. In the current study we propose a new fast method to align the FOV in multi-modal 3D medical images. To this end, a patch-based approach is introduced and combined with a state-of-the-art multi-modal image similarity metric in order to cope with multi-modal medical images. The occurrence of estimated patch shifts is computed for each spatial direction and the shift value with maximum occurrence is selected and used to adjust the image field-of-view. The performance of the proposed method – in terms of both registration accuracy and computational needs – is analyzed in the practical case of on-line irreversible electroporation procedures. In total, 30 pairs of pre-/per-operative IRE images are considered to illustrate the efficiency of our algorithm. We show that a regional registration approach using voxel patches provides a good structural compromise between the voxel-wise and "global shifts" approaches. The method was thereby beneficial for CT to CBCT and MRI to CBCT registration tasks, especially when highly different image FOVs are involved. Besides, the benefit of the method for CT to CBCT and MRI to CBCT image registration is analyzed, including the impact of artifacts generated by percutaneous needle insertions. Additionally, the computational needs using commodity hardware are demonstrated to be compatible with clinical constraints in the practical case of on-line procedures. The proposed patch-based workflow thus represents an attractive asset for DIR at different stages of an interventional procedure.