Adversarial learning for deformable registration of brain MR image using a multi-scale fully convolutional network. (August 2019)

• Record Type: Journal Article
• Authors: Duan, Luwen; Yuan, Gang; Gong, Lun; Fu, Tianxiao; Yang, Xiaodong; Chen, Xinjian; Zheng, Jian
• Is Part Of: Biomedical signal processing and control. Volume 53(2019)
• Publication Date: 2019-08
• Subjects: Deformable registration -- Deep network -- Unsupervised model -- Multi-scale -- Adversarial training; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2019.101562
• Languages: English
• ISSNs: 1746-8094

Abstract

Highlights: It is a deep end-to-end unsupervised network for fast and high-accurate 3D medical image registration. A novel multi-scale FCN is proposed to capture the complementary multi-scale features for precisely modeling the complex deformation mapping. We add an additional discriminator network to judge whether the image pair are well aligned, and give mismatch feedback to further train the FCN. Compared with other recent methods, our model provides higher registration accuracy in terms of Dice coefficient (by 4%) and distance error. Our model can achieve a high-accurate 3D registration result in average 0.74 s, with roughly hundred speed-up over conventional methods. Abstract: Background and objective: Deformable registration is very significant for various clinical image applications. Unfortunately, existing conventional medical image registration approaches, which involve time-consuming iterative optimization, have not reached the level of routine clinical practice in terms of registration time and robustness. The aim of this study is to propose a tuning-free 3D image registration model based on adversarial deep network, and to achieve rapid and high-accurate registration. Methods: We propose a fully convolutional network (FCN) to regress the 3D dense deformation field in one shot from the to-be-registered image pair. To precisely regress the complex deformation and produce optimal registration, we design the FCN as a novel multi-scale frame to capture the complementary multi-scale image features and effectively characterize the spatial correspondence between the image pair. Moreover, we learn a discriminator network simultaneously to discriminate the registered two images, where the discrimination loss helps further update the FCN. Thus by the adversarial training strategy, the registration network is urged to produce well-registered two images that are indistinguishable for the discriminator. Results: We perform registration experiments on four different brain MR datasets using the model trained by ANDI database. Compared with some state-of-the-art registration algorithms including other newest deeplearning-based methods, the proposed method provides a considerable increase of large than 4% in terms of Dice similarity coefficient (DSC). Moreover, our model also obtains comparable distance errors. More significantly, our model can achieve a high-accurate 3D registration result in average 0.74 s, with roughly hundred speed-up over conventional registration methods. Conclusions: The proposed model shows consistent high performance for various registration tasks under a second without any additional parameter tuning, which proves its potential for real-time clinical applications.