A multiscale residual pyramid attention network for medical image fusion. (April 2021)

• Record Type: Journal Article
• Authors: Fu, Jun; Li, Weisheng; Du, Jiao; Huang, Yuping
• Is Part Of: Biomedical signal processing and control. Volume 66(2021)
• Publication Date: 2021-04
• Subjects: Multiscale -- Residual -- Pyramid -- Attention -- State-of-the-art; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2021.102488
• Languages: English
• ISSNs: 1746-8094

Abstract

Highlights: MSRPAN is proposed for medical image fusion. The fusion strategy of feature energy ratio is proposed. Our algorithm has better fusion quality than the compared algorithms. Abstract: Recently, deep learning has been widely used in the imaging field. Residual, pyramid and attention networks are proposed successively, and are extensively used because of their excellent performance. However, the performance of a single network is limited. Based on this, we propose a multiscale residual pyramid attention network (MSRPAN) for medical image fusion. Our network consists of one feature extractor, fuser and reconstructor. The feature extractor is composed of three MSRPAN blocks, which are utilized to extract multiscale features. The reconstructor consists of three convolution layers, which are used to reconstruct the fused features. In addition, we propose the feature energy ratio strategy for the feature fusion process. The proposed strategy achieved better fusion results in the experiments. Compared with the existing state-of-the-art algorithms, our algorithm achieves better performance in terms of vision quality and objective metrics.