A fusion algorithm based on composite decomposition for PET and MRI medical images. (July 2022)

• Record Type: Journal Article
• Authors: Zhou, Jian; Xing, Xiaoxue; Yan, Minghan; Yuan, Dongfang; Zhu, Cancan; Zhang, Cong; Xu, Tingfa
• Is Part Of: Biomedical signal processing and control. Volume 76(2022)
• Publication Date: 2022-07
• Subjects: Medical Image Fusion -- Improved Structure Tensor -- Non-Subsampled Shearlet Transform -- YUV; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2022.103717
• Languages: English
• ISSNs: 1746-8094

Abstract

Highlights: A composite decomposition fusion framework is proposed. By taking the full advantage of spatial domain and transform domain, the fusion performance can be effectively improved. An IST algorithm is proposed to obtain the weighted gradient information, which can compensate for the reduction of image brightness brought by the NSST algorithm. A weighted fusion rule jointly guided by gradient and energy (WAGLE) is introduced to fuse the low-frequency sub-bands images to further improve the brightness quality. Abstract: Medical image fusion is of great significance in medical analysis and disease diagnosis. Until now, there are still limitations to the current fusion methods to our current knowledge, such as the restricted ability to extract detailed information and the luminance deterioration. In this paper, we propose a composite decomposition algorithm to overcome the limitations mentioned above, and which consists of the following steps. Firstly, an improved structure tensor (IST) is proposed to convert the MRI images to the smoothing layer, edges layer and corners layer, which ensures the resulting image has better brightness quality; Secondly, Non-Subsampled Shearlet Transform (NSST) is adopted to decompose the smoothing layer of MRI and the Y component of PET obtained from YUV transform into low- and high-frequency sub-bands images; The use of NSST can allow important detailed information to be preserved in the resulting image. Thirdly, the weighted averaged fusion rule guided by gradient and local energy (WAGLE) is introduced to fuse the low-frequency sub-bands, which can further improve the brightness of the fused images. The Whole Brain Atlas Database is used to evaluate the proposed method. The experimental results show that the algorithm proposed in this paper has significant improvement in the smoothness, color brightness, edge and local features of the images. Qualitative and quantitative analysis results show that the presented method has overcome the disadvantages of some current methods, which is superior to the other seven advanced fusion methods.