A bimodal BI-RADS-guided GoogLeNet-based CAD system for solid breast masses discrimination using transfer learning. (March 2022)

• Record Type: Journal Article
• Authors: Assari, Zahra; Mahloojifar, Ali; Ahmadinejad, Nasrin
• Is Part Of: Computers in biology and medicine. Volume 142(2022)
• Publication Date: 2022-03
• Subjects: Bimodal CAD system -- Deep learning -- Transfer learning -- Solid mass -- Mammography -- Ultrasound imaging; Medicine -- Data processing -- Periodicals; Biology -- Data processing -- Periodicals; 610.285
• DOI: 10.1016/j.compbiomed.2021.105160
• Languages: English
• ISSNs: 0010-4825

Abstract

Abstract: Numerous solid breast masses require sophisticated analysis to establish a differential diagnosis. Consequently, complementary modalities such as ultrasound imaging are frequently required to evaluate mammographically further detected masses. Radiologists mentally integrate complementary information from images acquired of the same patient to make a more conclusive and effective diagnosis. However, it has always been a challenging task. This paper details a novel bimodal GoogLeNet-based CAD system that addresses the challenges associated with combining information from mammographic and sonographic images for solid breast mass classification. Each modality is initially trained using two distinct monomodal models in the proposed framework. Then, using the high-level feature maps extracted from both modalities, a bimodal model is trained. In order to fully exploit the BI-RADS descriptors, different image content representations of each mass are obtained and used as input images. In addition, using an ImageNet pre-trained GoogLeNet model, two publicly available databases, and our collected dataset, a two-step transfer learning strategy has been proposed. Our bimodal model achieves the best recognition results in terms of sensitivity, specificity, F1-score, Matthews Correlation Coefficient, area under the receiver operating characteristic curve, and accuracy metrics of 90.91%, 89.87%, 90.32%, 80.78%, 95.82%, and 90.38%, respectively. The promising results indicate that the proposed CAD system can facilitate bimodal suspicious mass analysis and thus contribute significantly to improving breast cancer diagnostic performance. Graphical abstract: Image 1 Highlights: A novel bimodal GoogLeNet-Based CAD system for solid breast mass classification is proposed. The model is presented to address the challenges of combining mammograms and sonograms data. Different image content representations are obtained to exploit the BI-RADS descriptors effectively. A two-step transfer learning strategy is presented in the proposed framework.