PyMIC: A deep learning toolkit for annotation-efficient medical image segmentation. (April 2023)

• Record Type: Journal Article
• Authors: Wang, Guotai; Luo, Xiangde; Gu, Ran; Yang, Shuojue; Qu, Yijie; Zhai, Shuwei; Zhao, Qianfei; Li, Kang; Zhang, Shaoting
• Is Part Of: Computer methods and programs in biomedicine. Volume 231(2023)
• Publication Date: 2023-04
• Subjects: Medical image segmentation -- Deep learning -- Semi-supervised learning -- Weakly-supervised learning -- Noisy label; Medicine -- Computer programs -- Periodicals; Biology -- Computer programs -- Periodicals; Computers -- Periodicals; Medicine -- Periodicals; Médecine -- Logiciels -- Périodiques; Biologie -- Logiciels -- Périodiques; Biology -- Computer programs; Medicine -- Computer programs; Periodicals; Electronic journals; 610.28
• DOI: 10.1016/j.cmpb.2023.107398
• Languages: English
• ISSNs: 0169-2607

Abstract

Highlights: A new deep learning toolkit for annotation-efficient medical image segmentation. Functions for learning from unlabelled, partially or inaccurately labeled images. Allow fast development of semi/weakly-supervised and noisy-label learning methods. Modular and extensible, allowing customized modules integrated into the pipeline. Abstract: Background and Objective: Open-source deep learning toolkits are one of the driving forces for developing medical image segmentation models that are essential for computer-assisted diagnosis and treatment procedures. Existing toolkits mainly focus on fully supervised segmentation that assumes full and accurate pixel-level annotations are available. Such annotations are time-consuming and difficult to acquire for segmentation tasks, which makes learning from imperfect labels highly desired for reducing the annotation cost. We aim to develop a new deep learning toolkit to support annotation-efficient learning for medical image segmentation, which can accelerate and simplify the development of deep learning models with limited annotation budget, e.g., learning from partial, sparse or noisy annotations. Methods: Our proposed toolkit named PyMIC is a modular deep learning library for medical image segmentation tasks. In addition to basic components that support development of high-performance models for fully supervised segmentation, it contains several advanced components that are tailored for learning from imperfect annotations, such as loading annotated and unannounced images, loss functions for unannotated, partially or inaccurately annotated images, and training procedures for co-learning between multiple networks, etc. PyMIC is built on the PyTorch framework and supports development of semi-supervised, weakly supervised and noise-robust learning methods for medical image segmentation. Results: We present several illustrative medical image segmentation tasks based on PyMIC: (1) Achieving competitive performance on fully supervised learning; (2) Semi-supervised cardiac structure segmentation with only 10% training images annotated; (3) Weakly supervised segmentation using scribble annotations; and (4) Learning from noisy labels for chest radiograph segmentation. Conclusions: The PyMIC toolkit is easy to use and facilitates efficient development of medical image segmentation models with imperfect annotations. It is modular and flexible, which enables researchers to develop high-performance models with low annotation cost. The source code is available at:https://github.com/HiLab-git/PyMIC .