Multi-domain medical image translation generation for lung image classification based on generative adversarial networks. (February 2023)

• Record Type: Journal Article
• Authors: Chen, Yunfeng; Lin, Yalan; Xu, Xiaodie; Ding, Jinzhen; Li, Chuzhao; Zeng, Yiming; Xie, Weifang; Huang, Jianlong
• Is Part Of: Computer methods and programs in biomedicine. Volume 229(2023)
• Publication Date: 2023-02
• Subjects: Key transfer branch -- Multi-domain translation -- MI-GAN -- Image processing -- Lung classification; Medicine -- Computer programs -- Periodicals; Biology -- Computer programs -- Periodicals; Computers -- Periodicals; Medicine -- Periodicals; Médecine -- Logiciels -- Périodiques; Biologie -- Logiciels -- Périodiques; Biology -- Computer programs; Medicine -- Computer programs; Periodicals; Electronic journals; 610.28
• DOI: 10.1016/j.cmpb.2022.107200
• Languages: English
• ISSNs: 0169-2607

Abstract

Highlights: Medical image multi-domain translation model MI-GAN based on the focus transfer generation branch is proposed. Conversion between domains ensures the attention performance of the medical image multi-domain translation model and the quality of the synthesized images. Pneumonia classification network based on InceptionV3 pretraining model, training data includes real images and synthetic images. Model can effectively improve the efficiency and accuracy of image classification. Abstract: Objective: Lung image classification-assisted diagnosis has a large application market. Aiming at the problems of poor attention to existing translation models, the insufficient ability of key transfer and generation, insufficient quality of generated images, and lack of detailed features, this paper conducts research on lung medical image translation and lung image classification based on generative adversarial networks. Methods: This paper proposes a medical image multi-domain translation algorithm MI-GAN based on the key migration branch. After the actual analysis of the imbalanced medical image data, the key target domain images are selected, the key migration branch is established, and a single generator is used to complete the medical image multi-domain translation. The conversion between domains ensures the attention performance of the medical image multi-domain translation model and the quality of the synthesized images. At the same time, a lung image classification model based on synthetic image data augmentation is proposed. The synthetic lung CT medical images and the original real medical images are used as the training set together to study the performance of the auxiliary diagnosis model in the classification of normal healthy subjects, and also of the mild and severe COVID-19 patients. Results: Based on the chest CT image dataset, MI-GAN has completed the mutual conversion and generation of normal lung images without disease, viral pneumonia and Mild COVID-19 images. The synthetic images GAN-test and GAN-train indicators reached, respectively 92.188% and 85.069%, compared with other generative models in terms of authenticity and diversity, there is a considerable improvement. The accuracy rate of pneumonia diagnosis of the lung image classification model is 93.85%, which is 3.1% higher than that of the diagnosis model trained only with real images; the sensitivity of disease diagnosis is 96.69%, a relative improvement of 7.1%. 1%, the specificity was 89.70%; the area under the ROC curve (AUC) increased from 94.00% to 96.17%. Conclusion: In this paper, a multi-domain translation model of medical images based on the key transfer branch is proposed, which enables the translation network to have key transfer and attention performance. It is verified on lung CT images and achieved good results. The required medical images are synthesized by the above medical image translation model, and the effectiveness of the synthesized images on the lung image classification network is verified experimentally.