Automated lesion segmentation in fundus images with many-to-many reassembly of features. (April 2023)

• Record Type: Journal Article
• Authors: Liu, Qing; Liu, Haotian; Ke, Wei; Liang, Yixiong
• Is Part Of: Pattern recognition. Volume 136(2023)
• Publication Date: 2023-04
• Subjects: Feature reassembly -- Upsampling operator -- Downsampling operator -- Lesion segmentation -- Fundus image analysis; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2022.109191
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: We propose M2MRF to maintain subtle lesion activations and capture long-range dependencies for tiny lesion segmentation. Our M2MRF reassembles multiple features inside a large predefined region into multiple output features simultaneously via learning. Comprehensive experiments on DDR and IDRiD datasets show that our M2MRF outperforms state-of-the-art feature reassembly operators. Abstract: Existing CNN-based segmentation approaches have achieved remarkable progresses on segmenting objects in regular sizes. However, when migrating them to segment tiny retinal lesions, they encounter challenges. The feature reassembly operators that they adopt are prone to discard the subtle activations about tiny lesions and fail to capture long-term dependencies. This paper aims to solve these issues and proposes a novel Many-to-Many Reassembly of Features (M2MRF) for tiny lesion segmentation. Our proposed M2MRF reassembles features in a dimension-reduced feature space and simultaneously aggregates multiple features inside a large predefined region into multiple output features. In this way, subtle activations about small lesions can be maintained as much as possible and long-term spatial dependencies can be captured to further enhance the lesion features. Experimental results on two lesion segmentation benchmarks, i.e., DDR and IDRiD, show that 1) our M2MRF outperforms existing feature reassembly operators, and 2) equipped with our M2MRF, the HRNetV2 is able to achieve substantially better performances and generalisation ability than existing methods. Our code is made publicly available at https://github.com/CVIU-CSU/M2MRF-Lesion-Segmentation .