Adaptive aggregation with self‐attention network for gastrointestinal image classification. Issue 9 (10th April 2022)

• Record Type: Journal Article
• Authors: Li, Sheng; Cao, Jing; Yao, Jiafeng; Zhu, Jinhui; He, Xiongxiong; Jiang, Qianru
• Is Part Of: IET image processing. Volume 16:Issue 9(2022)
• Page Start: 2384
• Page End: 2397
• Publication Date: 2022-04-10
• Subjects: Image processing -- Periodicals; 621.36705
• DOI: 10.1049/ipr2.12495
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract: Automatic classification of diseases in endoscopic images is essential to the improvement of diagnostic performance and the reduction of colorectal cancer mortality. However, due to the ambiguous boundary between background and foreground, abnormal classification in endoscopic images is still challenging. To tackle such a situation, an adaptive aggregation with self‐attention network (AASAN), including a global branch, a local branch, and a fusion branch, is proposed imitating the diagnosis process of endoscopists. On this basis, the self‐attention with relative position encoding (SA‐RPE) module is designed to capture long‐range dependencies and gather lesion neighborhood information. Furthermore, an adaptive aggregation feature (AAF) module is proposed and embedded into the fusion branch for final image label prediction, which is helpful to capture more discriminant features. Extensive experiments show that the classification accuracy of the authors' method on Kvasir public dataset reaches 96.37% in a fivefold cross‐validation, higher than the state‐of‐the‐art deep learning algorithms.