An Indirect Multimodal Image Registration and Completion Method Guided by Image Synthesis. (30th June 2020)

• Record Type: Journal Article
• Authors: Yang, Huan; Qian, Pengjiang; Fan, Chao
• Other Names: Huang Chenxi Guest Editor.
• Is Part Of: Computational and mathematical methods in medicine. Volume 2020(2020)
• Publication Date: 2020-06-30
• Subjects: Medicine -- Computer simulation -- Periodicals; Medicine -- Mathematical models -- Periodicals; 610.11
• DOI: 10.1155/2020/2684851
• Languages: English
• ISSNs: 1748-670X

Abstract

Abstract : Multimodal registration is a challenging task due to the significant variations exhibited from images of different modalities. CT and MRI are two of the most commonly used medical images in clinical diagnosis, since MRI with multicontrast images, together with CT, can provide complementary auxiliary information. The deformable image registration between MRI and CT is essential to analyze the relationships among different modality images. Here, we proposed an indirect multimodal image registration method, i.e., sCT-guided multimodal image registration and problematic image completion method. In addition, we also designed a deep learning-based generative network, Conditional Auto-Encoder Generative Adversarial Network, called CAE-GAN, combining the idea of VAE and GAN under a conditional process to tackle the problem of synthetic CT (sCT) synthesis. Our main contributions in this work can be summarized into three aspects: (1) We designed a new generative network called CAE-GAN, which incorporates the advantages of two popular image synthesis methods, i.e., VAE and GAN, and produced high-quality synthetic images with limited training data. (2) We utilized the sCT generated from multicontrast MRI as an intermediary to transform multimodal MRI-CT registration into monomodal sCT-CT registration, which greatly reduces the registration difficulty. (3) Using normal CT as guidance and reference, we repaired the abnormal MRI while registering the MRI to the normal CT.