Siamese networks and multi-scale local extrema scheme for multimodal brain medical image fusion. (July 2021)

• Record Type: Journal Article
• Authors: Ding, Zhaisheng; Zhou, Dongming; Li, Haiyan; Hou, Ruichao; Liu, Yanyu
• Is Part Of: Biomedical signal processing and control. Volume 68(2021)
• Publication Date: 2021-07
• Subjects: Medical image fusion -- CNNs -- Spiking cortical model -- Local extrema scheme -- Siamese network; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2021.102697
• Languages: English
• ISSNs: 1746-8094

Abstract

Highlights: Medical image fusion is an auxiliary approach to help doctors diagnose diseases accurately. CNNs have attracted considerable attention in the image processing field. The spiking cortical model is a simplified PCNN model that reduces the number of undetermined parameters. A novel image decomposition algorithm named MSLES based on the existing LES algorithm. The Siamese network has been proved to be excellent in medical image fusion. Abstract: Multimodal medical image fusion is an auxiliary approach to help doctors diagnose diseases accurately leveraging information enhancement technology. Up to now, none of the fusion strategies is authoritative. Exploring methods with excellent performance is still the theme of image fusion works. The local extrema scheme (LES) and convolutional neural networks (CNNs) perform remarkable in medical image fusion tasks. However, the low decomposition efficiency of the LES and the limitations of CNNs should be addressed. Therefore, a novel framework proposed by combining the local extrema scheme and a Siamese network. This paper tried to solve the mentioned issues by improving the decomposition efficiency of LES and customizing the fusion strategy. Initially, the multi-scale local extrema scheme (MSLES) is introduced to decompose the source image into a series of detailed layers and a smoothed layer. Simultaneously, an adaptive dual-channel spiking cortical model (ADCSCM) based on the image information entropy (EN) is constructed to fuse the smoothed layer, and subsequently a feasible weight allocation strategy is designed by combining the Siamese network and EN to fuse the detailed layers. Ultimately, the informative image is reconstructed with the fused smoothed layer and detailed layers. By analyzing the extensive experimental results and metrics, the proposed framework achieves better performance against other state-of-art methods.