DAN-NucNet: A dual attention based framework for nuclei segmentation in cancer histology images under wild clinical conditions. (1st March 2023)

• Record Type: Journal Article
• Authors: Ahmad, Ibtihaj; Xia, Yong; Cui, Hengfei; Islam, Zain Ul
• Is Part Of: Expert systems with applications. Volume 213:Part A(2023)
• Publication Date: 2023-03-01
• Subjects: 0000 -- 1111; Nuclei segmentation -- Histopathology segmentation -- Attention UNet -- Spatial Channel Attention; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2022.118945
• Languages: English
• ISSNs: 0957-4174

Abstract

Abstract: Nuclei segmentation plays an essential role in histology analysis. The nuclei segmentation in histology images is challenging in variable conditions (clinical wild), such as poor staining quality, stain variability, tissue variability, and conditions having higher morphological variability. Recently, some deep learning models have been proposed for nuclei segmentation. However, these models rarely solve the problems mentioned above simultaneously. Most of the information in Hematoxylin and Eosin (H&E) stained histology images is in its channel, and the remaining information is in the spatial domain. We observed that most problems could be solved by considering channel and spatial features simultaneously, e.g., the spatial and channel features provide the solution to the morphological variability and staining variability, respectively. Therefore, we propose a novel spatial-channel attention-based modified UNet architecture with ResNet blocks in encoder layers. The UNet baseline preserves coarse and fine features, thus proving the solution to the tissue variability. The proposed method significantly improves the segmentation performance compared to the state-of-the-art methods on three different benchmark datasets. We demonstrate that the proposed model is generalized for 20 cancer sites, more than any reported literature. The proposed model is less complex than most state-of-the-art models. The impact of the proposed model is that it will help improve further procedures such as nuclei instance segmentation, nuclei classification, and cancer grading. Highlights: Nuclei segmentation in histology slides is a challenge in harsh conditions. We propose dual attention-based architecture with ResNet encoder block. Our method is generalized for 20 cancer sites, more than reported literature. Our method improves nuclei segmentation compared to the state-of-the-art.