A non-local capsule neural network for hyperspectral remote sensing image classification. Issue 1 (2nd January 2021)

• Record Type: Journal Article
• Authors: Lei, Runmin; Zhang, Chunju; Du, Shihong; Wang, Chen; Zhang, Xueying; Zheng, Hui; Huang, Jianwei; Yu, Min
• Is Part Of: Remote sensing letters. Volume 12:Issue 1(2021)
• Page Start: 40
• Page End: 49
• Publication Date: 2021-01-02
• Subjects: Capsule neural network -- convolutional neural network -- hyperspectral image classification -- non-local operation; Remote sensing -- Periodicals; Remote sensing; Periodicals; 621.3678
• DOI: 10.1080/2150704X.2020.1864052
• Languages: English
• ISSNs: 2150-704X

Abstract

ABSTRACT: In this study, we introduce a non-local block of the attention mechanism into capsule neural network (CapsNet) to form a non-local capsule network (NLCapsNet) for hyperspectral remote sensing image (HSI) classification. The presented NLCapsNet uses global information from input images and has a powerful representation of the capacity and spatial relationships among HSI features. It can effectively isolate invalid information and consolidate valid information, in addition to learning more representative features and capturing the long-distance dependencies of HSIs with only a few layers. An additional convolutional layer is embedded before the capsule layers to capture high-level features and speed up the routing procedure. The proposed method can effectively enhance the classification accuracy with a rapid convergence speed and avoid overfitting when the number of training samples is limited. The NLCapsNet performs well on the classification of the Kennedy Space Center, Pavia University and Salinas datasets.