Weakly supervised adversarial learning via latent space for hyperspectral target detection. (March 2023)

• Record Type: Journal Article
• Authors: Qin, Haonan; Xie, Weiying; Li, Yunsong; Jiang, Kai; Lei, Jie; Du, Qian
• Is Part Of: Pattern recognition. Volume 135(2023)
• Publication Date: 2023-03
• Subjects: Hyperspectral image -- Target detection -- Weakly supervised learning -- Adversarial learning -- Latent space; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2022.109125
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: Background estimation and reconstruction are realized via adversarial learning. Latent variables effectively represent and reconstruct the background spectrums. Sample selection via coarse detection solves the issue of lacking training instances. Abstract: As an advanced technique in remote sensing, hyperspectral target detection (HTD) is widely concerned in civilian and military applications. However, the limitation of prior and mixed pixels phenomenon makes HTD models sensitive to data corruption under various interference from environment. In this work, a novel two-stage detection framework based on adversarial learning is proposed, which extracts spectral features in latent space through background reconstruction under weak supervision. To address the issues of insufficient utilization of both background information and limited prior knowledge, the generative adversarial network (GAN) is applied to estimate background in a weakly supervised manner with target-based constraints and channel-wise attention, which produces the detection proposal in the first stage. Then, a refined result is produced in the second stage, in which the input data consists of the refined data and refined feature map based on previous detection proposal. To provide samples for weakly supervised learning (WSL), the pseudo datasets are produced by a coarse sample selection procedure, which makes full use of limited prior information. Finally, an exponential constrained nonlinear function is adopted to acquire pixel-level prediction via suppressing the background and combining features from different stages. Experiments on real hyperspectral images (HSIs) captured by different sensors at various scenes verify the effectiveness of the proposed framework.