Semi-supervised medical image classification with adaptive threshold pseudo-labeling and unreliable sample contrastive loss. (January 2023)
- Record Type:
- Journal Article
- Title:
- Semi-supervised medical image classification with adaptive threshold pseudo-labeling and unreliable sample contrastive loss. (January 2023)
- Main Title:
- Semi-supervised medical image classification with adaptive threshold pseudo-labeling and unreliable sample contrastive loss
- Authors:
- Peng, Zhen
Tian, Shengwei
Yu, Long
Zhang, Dezhi
Wu, Weidong
Zhou, Shaofeng - Abstract:
- Highlights: A novel semi-supervised learning classification framework for medical images. A method to dynamically adjust the thresholds is proposed. A loss function is constructed based on contrastive learning. Abstract: Semi-supervised learning (SSL) may employ unlabeled data to improve model performance, which has great significance in medical imaging tasks. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in medical image datasets: (1) the models' predictions are biased toward the majority class in imbalanced datasets, and (2) discarding unlabeled data with confidence below the thresholds results in the loss of useful information. To solve these issues, we propose a novel SSL framework, FullMatch, which improves the model's performance by utilizing all unlabeled data. Specifically, we propose adaptive threshold pseudo-labeling (ATPL), a method for generating pseudo-labels based on the model's current learning status. ATPL dynamically adjusts the thresholds for each class during the training process, which can generate more pseudo-labels for classes with learning difficulties, thus alleviating the problem of data imbalance. Unlike existing semi-supervised methods based on pseudo-labeling, we do not discard unlabeled data with confidence below the thresholds. We propose an unreliable sample contrastive loss (USCL) to leverage useful information from unlabeled data with confidence below the thresholds by learning the similarities andHighlights: A novel semi-supervised learning classification framework for medical images. A method to dynamically adjust the thresholds is proposed. A loss function is constructed based on contrastive learning. Abstract: Semi-supervised learning (SSL) may employ unlabeled data to improve model performance, which has great significance in medical imaging tasks. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in medical image datasets: (1) the models' predictions are biased toward the majority class in imbalanced datasets, and (2) discarding unlabeled data with confidence below the thresholds results in the loss of useful information. To solve these issues, we propose a novel SSL framework, FullMatch, which improves the model's performance by utilizing all unlabeled data. Specifically, we propose adaptive threshold pseudo-labeling (ATPL), a method for generating pseudo-labels based on the model's current learning status. ATPL dynamically adjusts the thresholds for each class during the training process, which can generate more pseudo-labels for classes with learning difficulties, thus alleviating the problem of data imbalance. Unlike existing semi-supervised methods based on pseudo-labeling, we do not discard unlabeled data with confidence below the thresholds. We propose an unreliable sample contrastive loss (USCL) to leverage useful information from unlabeled data with confidence below the thresholds by learning the similarities and differences between sample features. To evaluate the performance of the proposed method, we conducted experiments on the ISIC 2018 skin lesion classification dataset and the blood cell classification dataset. The experimental results show that our method outperforms the state-of-the-art SSL methods. … (more)
- Is Part Of:
- Biomedical signal processing and control. Volume 79(2023)Part 2
- Journal:
- Biomedical signal processing and control
- Issue:
- Volume 79(2023)Part 2
- Issue Display:
- Volume 79, Issue 2, Part 2 (2023)
- Year:
- 2023
- Volume:
- 79
- Issue:
- 2
- Part:
- 2
- Issue Sort Value:
- 2023-0079-0002-0002
- Page Start:
- Page End:
- Publication Date:
- 2023-01
- Subjects:
- Semi-supervised learning -- Pseudo-labeling -- Contrastive learning -- Medical image classification
Signal processing -- Periodicals
Biomedical engineering -- Periodicals
Signal Processing, Computer-Assisted -- Periodicals
Image Processing, Computer-Assisted -- Periodicals
Biomedical Engineering -- Periodicals
610.28 - Journal URLs:
- http://www.sciencedirect.com/science/journal/17468094 ↗
http://www.elsevier.com/journals ↗
http://www.sciencedirect.com/science?_ob=PublicationURL&_tockey=%23TOC%2329675%232006%23999989998%23626449%23FLA%23&_cdi=29675&_pubType=J&_auth=y&_acct=C000045259&_version=1&_urlVersion=0&_userid=836873&md5=664b5cf9a57fc91971a17faf20c32ec1 ↗ - DOI:
- 10.1016/j.bspc.2022.104142 ↗
- Languages:
- English
- ISSNs:
- 1746-8094
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - 2087.880400
British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 24379.xml