Uncertainty-aware pseudo-label and consistency for semi-supervised medical image segmentation. (January 2023)

• Record Type: Journal Article
• Authors: Lu, Liyun; Yin, Mengxiao; Fu, Liyao; Yang, Feng
• Is Part Of: Biomedical signal processing and control. Volume 79(2023)Part 2
• Publication Date: 2023-01
• Subjects: Semi-supervised learning -- Medical image segmentation -- Pseudo-labeling -- Consistency regularization -- Uncertainty estimation; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2022.104203
• Languages: English
• ISSNs: 1746-8094

Abstract

Abstract: In medical image segmentation tasks, fully-supervised learning has been a huge success by using abundant labeled data. However, it is time-consuming and expensive for technicians to label medical images. In this paper, we propose a novel framework for semi-supervised medical image segmentation, named Uncertainty-aware Pseudo-label and Consistency. Our framework is made up of the student–teacher models. The supervised loss on labeled data and the consistency loss on both labeled and unlabeled data are weighted and combined to optimize the models. Our method combines the recent state-of-the-art semi-supervised methods, which are consistency regularization and pseudo-labeling. More importantly, we calculate the Kullback–Leibler variance between the student model's prediction and the teacher model's prediction as uncertainty estimation, and directly use the uncertainty to rectify the learning of noisy pseudo-labels, instead of setting a fixed threshold to filter the pseudo-labels. Experiments on the Left Atrium dataset show that our method can efficiently utilize unlabeled data to achieve high performance and outperform other state-of-the-art semi-supervised methods. In addition, we have also analyzed its difference from conventional methods of consistency regularization and pseudo-labeling in semi-supervised medical image segmentation. Code is available in https://github.com/GXU-GMU-MICCAI/UPC-Pytorch . Highlights: A novel framework for semi-supervised medical image segmentation. The framework combines consistency regularization and pseudo-labeling. Consistency regularization is performed through the student–teacher models. Kullback–Leibler variance as uncertainty to rectify the noisy pseudo-labels. Proposed method can efficiently utilize unlabeled data to achieve high performance.