WeGleNet: A weakly-supervised convolutional neural network for the semantic segmentation of Gleason grades in prostate histology images. (March 2021)

• Record Type: Journal Article
• Authors: Silva-Rodríguez, Julio; Colomer, Adrián; Naranjo, Valery
• Is Part Of: Computerized medical imaging and graphics. Volume 88(2021)
• Publication Date: 2021-03
• Subjects: Gleason grading -- Prostate cancer -- Semantic segmentation -- Tissue micro-arrays -- Weakly supervised; Diagnostic imaging -- Periodicals; Imaging systems in medicine -- Periodicals; Diagnosis, Radioscopic -- Data processing -- Periodicals; Diagnostic Imaging -- Periodicals; Imagerie pour le diagnostic -- Périodiques; Diagnostic imaging; Periodicals; Electronic journals; Electronic journals; 616.0754
• DOI: 10.1016/j.compmedimag.2020.101846
• Languages: English
• ISSNs: 0895-6111

Abstract

Highlights: Segmentation of Gleason grades in prostate histology images using global Gleason score during training. A weakly-supervised architecture that perform multi-class segmentation, including the background class. Log-sum exponential pooling allows to adapt the weakly-supervised architecture to the extent of cancerous structures in the tissue. Weakly-supervised CNNs perform at the same level as fully-supervised techniques for Gleason grading of tissue micro-arrays. Abstract: Background and objective: Prostate cancer is one of the main diseases affecting men worldwide. The Gleason scoring system is the primary diagnostic tool for prostate cancer. This is obtained via the visual analysis of cancerous patterns in prostate biopsies performed by expert pathologists, and the aggregation of the main Gleason grades in a combined score. Computer-aided diagnosis systems allow to reduce the workload of pathologists and increase the objectivity. Nevertheless, those require a large number of labeled samples, with pixel-level annotations performed by expert pathologists, to be developed. Recently, efforts have been made in the literature to develop algorithms aiming the direct estimation of the global Gleason score at biopsy/core level with global labels. However, these algorithms do not cover the accurate localization of the Gleason patterns into the tissue. These location maps are the basis to provide a reliable computer-aided diagnosis system to the experts to be used in clinical practice by pathologists. In this work, we propose a deep-learning-based system able to detect local cancerous patterns in the prostate tissue using only the global-level Gleason score obtained from clinical records during training. Methods: The methodological core of this work is the proposed weakly-supervised-trained convolutional neural network, WeGleNet, based on a multi-class segmentation layer after the feature extraction module, a global-aggregation, and the slicing of the background class for the model loss estimation during training. Results: Using a public dataset of prostate tissue-micro arrays, we obtained a Cohen's quadratic kappa ( κ ) of 0.67 for the pixel-level prediction of cancerous patterns in the validation cohort. We compared the model performance for semantic segmentation of Gleason grades with supervised state-of-the-art architectures in the test cohort. We obtained a pixel-level κ of 0.61 and a macro-averaged f1-score of 0.58, at the same level as fully-supervised methods. Regarding the estimation of the core-level Gleason score, we obtained a κ of 0.76 and 0.67 between the model and two different pathologists. Conclusions: WeGleNet is capable of performing the semantic segmentation of Gleason grades similarly to fully-supervised methods without requiring pixel-level annotations. Moreover, the model reached a performance at the same level as inter-pathologist agreement for the global Gleason scoring of the cores.