A resolution enhancement plug-in for deformable registration of medical images. (January 2023)

• Record Type: Journal Article
• Authors: Sun, Kaicong; Simon, Sven
• Is Part Of: Biomedical signal processing and control. Volume 79(2023)Part 1
• Publication Date: 2023-01
• Subjects: Cascaded network -- Deformable image registration -- Resolution enhanced registration -- Super-resolution; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2022.104090
• Languages: English
• ISSNs: 1746-8094

Abstract

Abstract: Image registration is a fundamental task for medical imaging. Resampling of the intensity values is required during registration and better spatial resolution with finer and sharper structures can improve the resampling performance and hence the registration accuracy. Super-resolution (SR) is an algorithmic technique targeting at spatial resolution enhancement to achieve an image resolution beyond the hardware limitation. In this work, we consider SR as a preprocessing technique and present a CNN-based lightweight resolution enhancement module (REM) which can be easily plugged into the registration networks in a cascaded manner. Different residual schemes and network configurations of REM are investigated to obtain an effective architecture design. Besides, an auxiliary loss is introduced into the cascaded network to empower multi-hierarchical supervision and strengthen the fidelity of the output. In fact, REM is not confined to image registration, it can also be straightforwardly integrated into other vision tasks for enhanced resolution. In the experiments, REM and the cascaded registration network are evaluated on Brain MR images quantitatively and qualitatively at different upscaling factors. It is shown that REM not only improves the registration accuracy, especially when the input images severely suffer from the degraded spatial resolution, but also reconstructs resolution enhanced images which can be exploited for successive diagnosis. Highlights: A resolution enhancement module (REM) based on residual CNN as plug-in is presented. An auxiliary loss is proposed to enable hierarchical supervision and improve fidelity. REM not only improves registration accuracy but also produces super-resolved images.