Anatomical‐functional image fusion based on deep convolution neural networks in local Laplacian pyramid domain. Issue 3 (20th November 2020)

• Record Type: Journal Article
• Authors: Huang, Yuping; Li, Weisheng; Du, Jiao
• Is Part Of: International journal of imaging systems and technology. Volume 31:Issue 3(2021)
• Page Start: 1246
• Page End: 1264
• Publication Date: 2020-11-20
• Subjects: color distortion -- convolutional neural networks -- image contrast -- local Laplacian pyramid -- medical image fusion; Imaging systems -- Periodicals; Image processing -- Periodicals; 621.367
• DOI: 10.1002/ima.22523
• Languages: English
• ISSNs: 0899-9457

Abstract

Abstract: Medical image fusion technology makes clinical diagnosis and treatment more accurate. This technique can solve the existing problem that single mode medical images conveying insufficient information. Therefore, the key to this technology is to retain as much as possible information in the original medical image of multiple modes. However, the existing methods often lose source image detail with a low contrast and cause color distortion. This article proposed a novel multi‐modal medical image fusion framework. Our framework has four key steps. First, extracting the super‐resolution images from anatomical images via a deep neural network is performed. Second, decomposing the source images into detail‐enhanced approximate and residual images, and then processing by local Laplacian filtering. Third, a convolution neural network is used to complete the mapping of the source image to the feature map and the local energy‐based strategy is used to integrate the coefficients. Finally, the inversed local Laplacian pyramid is adopted to reconstruct the fused image. The experimental results prove that the fused image via the proposed method has the characteristics of high contrast, high brightness, and high color saturation and great advantages in retaining the color and structural information.