Saliency map-guided hierarchical dense feature aggregation framework for breast lesion classification using ultrasound image. (March 2022)

• Record Type: Journal Article
• Authors: Di, Xiaohui; Zhong, Shengzhou; Zhang, Yu
• Is Part Of: Computer methods and programs in biomedicine. Volume 215(2022)
• Publication Date: 2022-03
• Subjects: Breast lesion classification -- Ultrasound image -- Saliency map -- Hierarchical dense feature aggregation -- Deep learning; Medicine -- Computer programs -- Periodicals; Biology -- Computer programs -- Periodicals; Computers -- Periodicals; Medicine -- Periodicals; Médecine -- Logiciels -- Périodiques; Biologie -- Logiciels -- Périodiques; Biology -- Computer programs; Medicine -- Computer programs; Periodicals; Electronic journals; 610.28
• DOI: 10.1016/j.cmpb.2021.106612
• Languages: English
• ISSNs: 0169-2607

Abstract

Highlights: We propose to generate saliency maps via super-pixel clustering and multi-scale region grouping as a priors for domain-specific representation learning and improving the performance of network. We propose a saliency map-guided triple-branch hierarchical dense feature aggregation network that consists of two feature extraction branches and a feature aggregation branch, to extract and fuse discriminative domain-specific representations under the guidance of priors provided by saliency maps. Extensive experiments on two datasets have demonstrated that the proposed method outperforms several deep learning methods on breast lesion diagnosis using BUS images. We visualize class activation maps (CAMs) of feature maps to highlight the important regions of images. Abstract: Deep learning methods, especially convolutional neural networks, have advanced the breast lesion classification task using breast ultrasound (BUS) images. However, constructing a highly-accurate classification model still remains challenging due to complex pattern, relatively-low contrast and fuzzy boundary existing between lesion regions (i.e., foreground) and the surrounding tissues (i.e., background). Few studies have separated foreground and background for learning domain-specific representations, and then fused them for improving performance of models. In this paper, we propose a saliency map-guided hierarchical dense feature aggregation framework for breast lesion classification using BUS images. Specifically, we first generate saliency maps for foreground and background via super-pixel clustering and multi-scale region grouping. Then, a triple-branch network, including two feature extraction branches and a feature aggregation branch, is constructed to learn and fuse discriminative representations under the guidance of priors provided by saliency maps. In particular, two feature extraction branches take the original image and corresponding saliency map as input for extracting foreground- and background-specific representations. Subsequently, a hierarchical feature aggregation branch receives and fuses the features from different stages of two feature extraction branches, for lesion classification in a task-oriented manner. The proposed model was evaluated on three datasets using 5-fold cross validation, and experimental results have demonstrated that it outperforms several state-of-the-art deep learning methods on breast lesion diagnosis using BUS images.