Multi-scale feature learning network with channel self-attention for remote sensing single-image super-resolution. Issue 18 (17th September 2022)

• Record Type: Journal Article
• Authors: Wang, Xueqin; Jiang, Wenzong; Zhao, Lifei; Liu, Baodi; Wang, Yanjiang
• Is Part Of: International journal of remote sensing. Volume 43:Issue 18(2022)
• Page Start: 6669
• Page End: 6688
• Publication Date: 2022-09-17
• Subjects: Channel self-attention -- multi-scale feature -- remote sensing image -- image super-resolution -- single image; Remote sensing -- Periodicals; Télédétection -- Périodiques; 621.3678
• DOI: 10.1080/01431161.2022.2143732
• Languages: English
• ISSNs: 0143-1161

Abstract

ABSTRACT: The performance of the remote sensing image super-resolution (SR) task has been significantly improved by applying deep learning. However, previously reported methods usually require sufficient synthetic datasets obtained by bicubic downsampling for long-term training, which can get better results when the input of the test phase is still the bicubic downsampling low-resolution (LR) image. However, when the input does not meet this bicubic downsampling situation, the performance of the model will be significantly degraded, and the generated SR image will be blurred. In order to better adapt to remote sensing image SR in different situations, this paper proposes a multi-scale feature learning network with channel self-attention for remote sensing single-image super-resolution (MSFLCSA). The proposed MSFLCSA does not need any extra synthetic paired dataset but one LR input image for training. Further, MSFLCSA uses a well-designed channel self-attention multi-scale feature learning network to fully learn the repetitive multi-scale features of the input image to realize remote sensing image SR tasks. Specifically, the proposed MSFLCSA extracts features of different levels through multi-column convolutions with different receptive fields to better learn the multi-scale features inside remote sensing images. In addition, the channel self-attention module constructs the channel dependence relationship between channels, selectively emphasizes the interdependent channel features, and further improves the learned multi-scale feature representation. Various types of qualitative and quantitative experiments have validated the effectiveness of MSFLCSA. Compared with advanced technologies, MSFLCSA has achieved superior performance.