Knowledge transfer between brain lesion segmentation tasks with increased model capacity. (March 2021)

• Record Type: Journal Article
• Authors: Liu, Yanlin; Cui, Wenhui; Ha, Qing; Xiong, Xiaoliang; Zeng, Xiangzhu; Ye, Chuyang
• Is Part Of: Computerized medical imaging and graphics. Volume 88(2021)
• Publication Date: 2021-03
• Subjects: Brain lesion segmentation -- Knowledge transfer -- Fine-tuning -- Increased model capacity; Diagnostic imaging -- Periodicals; Imaging systems in medicine -- Periodicals; Diagnosis, Radioscopic -- Data processing -- Periodicals; Diagnostic Imaging -- Periodicals; Imagerie pour le diagnostic -- Périodiques; Diagnostic imaging; Periodicals; Electronic journals; Electronic journals; 616.0754
• DOI: 10.1016/j.compmedimag.2020.101842
• Languages: English
• ISSNs: 0895-6111

Abstract

Highlights: We address the problem of scarce annotated data for brain lesion segmentation. Knowledge transfer between brain lesion segmentation tasks is proposed. A fine-tuning strategy with increased model capacity is developed. We also introduce a spatially adaptive mechanism for the model capacity increase. Our method achieves better performance on ischemic stroke lesion segmentation. Abstract: Convolutional neural networks (CNNs) have become an increasingly popular tool for brain lesion segmentation in recent years due to its accuracy and efficiency. However, CNN-based brain lesion segmentation generally requires a large amount of annotated training data, which can be costly for medical imaging. In many scenarios, only a few annotations of brain lesions are available. One common strategy to address the issue of limited annotated data is to transfer knowledge from a different yet relevant source task, where training data is abundant, to the target task of interest. Typically, a model can be pretrained for the source task, and then fine-tuned with the scarce training data associated with the target task. However, classic fine-tuning tends to make small modifications to the pretrained model, which could hinder its adaptation to the target task. Fine-tuning with increased model capacity has been shown to alleviate this negative impact in image classification problems. In this work, we extend the strategy of fine-tuning with increased model capacity to the problem of brain lesion segmentation, and then develop an advanced version that is better suitable for segmentation problems. First, we propose a vanilla strategy of increasing the capacity, where, like in the classification problem, the width of the network is augmented during fine-tuning. Second, because unlike image classification, in segmentation problems each voxel is associated with a labeling result, we further develop a spatially adaptive augmentation strategy during fine-tuning. Specifically, in addition to the vanilla width augmentation, we incorporate a module that computes a spatial map of the contribution of the information given by width augmentation in the final segmentation. For demonstration, the proposed method was applied to ischemic stroke lesion segmentation, where a model pretrained for brain tumor segmentation was fine-tuned, and the experimental results indicate the benefit of our method.