Instance segmentation of biological images using graph convolutional network. (April 2022)
- Record Type:
- Journal Article
- Title:
- Instance segmentation of biological images using graph convolutional network. (April 2022)
- Main Title:
- Instance segmentation of biological images using graph convolutional network
- Authors:
- Xu, Rongtao
Li, Ye
Wang, Changwei
Xu, Shibiao
Meng, Weiliang
Zhang, Xiaopeng - Abstract:
- Abstract: Instance segmentation in biological images is an important task in the field of biological images and biomedical analysis. Different from the instance segmentation of natural image scenes, this task is still challenging because there are a large number of overlapping objects with similar appearance as well as great variability in shape, size and texture in the foreground and background. In this paper, we propose a novel method for segmentation of graph-guided instances of biological images, which successfully addresses these peculiarities. Our method predicts the embedding at each pixel and uses clustering to recover instances during testing. Specifically, we design the Graph-guided Feature Fusion Module in response to overlapping instances. Our Graph-guided Feature Fusion Module combines fine deep features and coarse shallow features to learn the affinity matrix, and then uses graph convolutional network to guide the network to learn object-level local features. Next, we devise the Gated Spatial Attention Module to effectively learn key spatial information by introducing a gating mechanism. Furthermore, we give the Cluster Distance Loss that can effectively distinguish foreground objects from similar backgrounds. The effectiveness of our proposed method has been verified on various biological and biomedical datasets. The experimental results show that our method is superior to previous embedding-based instance segmentation methods. The SBD metric for our methodAbstract: Instance segmentation in biological images is an important task in the field of biological images and biomedical analysis. Different from the instance segmentation of natural image scenes, this task is still challenging because there are a large number of overlapping objects with similar appearance as well as great variability in shape, size and texture in the foreground and background. In this paper, we propose a novel method for segmentation of graph-guided instances of biological images, which successfully addresses these peculiarities. Our method predicts the embedding at each pixel and uses clustering to recover instances during testing. Specifically, we design the Graph-guided Feature Fusion Module in response to overlapping instances. Our Graph-guided Feature Fusion Module combines fine deep features and coarse shallow features to learn the affinity matrix, and then uses graph convolutional network to guide the network to learn object-level local features. Next, we devise the Gated Spatial Attention Module to effectively learn key spatial information by introducing a gating mechanism. Furthermore, we give the Cluster Distance Loss that can effectively distinguish foreground objects from similar backgrounds. The effectiveness of our proposed method has been verified on various biological and biomedical datasets. The experimental results show that our method is superior to previous embedding-based instance segmentation methods. The SBD metric for our method reached 90.8% on the plant phenotype dataset (CVPPP), 72.5% on the cell nucleus dataset (DSB2018), and 81.8% on the C.elegans dataset, all achieving state-of-the-art performance. … (more)
- Is Part Of:
- Engineering applications of artificial intelligence. Volume 110(2022)
- Journal:
- Engineering applications of artificial intelligence
- Issue:
- Volume 110(2022)
- Issue Display:
- Volume 110, Issue 2022 (2022)
- Year:
- 2022
- Volume:
- 110
- Issue:
- 2022
- Issue Sort Value:
- 2022-0110-2022-0000
- Page Start:
- Page End:
- Publication Date:
- 2022-04
- Subjects:
- Instance segmentation -- Biological images -- GCN -- Spatial attention -- Graph-guided feature fusion
Engineering -- Data processing -- Periodicals
Artificial intelligence -- Periodicals
Expert systems (Computer science) -- Periodicals
Ingénierie -- Informatique -- Périodiques
Intelligence artificielle -- Périodiques
Systèmes experts (Informatique) -- Périodiques
Artificial intelligence
Engineering -- Data processing
Expert systems (Computer science)
Periodicals
620.00285 - Journal URLs:
- http://www.sciencedirect.com/science/journal/09521976 ↗
http://www.elsevier.com/journals ↗ - DOI:
- 10.1016/j.engappai.2022.104739 ↗
- Languages:
- English
- ISSNs:
- 0952-1976
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - 3755.704500
British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 21024.xml