Multi-input convolutional neural network for breast cancer detection using thermal images and clinical data. (June 2021)

• Record Type: Journal Article
• Authors: Sánchez-Cauce, Raquel; Pérez-Martín, Jorge; Luque, Manuel
• Is Part Of: Computer methods and programs in biomedicine. Volume 204(2021)
• Publication Date: 2021-06
• Subjects: Breast cancer -- Classification -- Clinical data -- Convolutional neural network -- Thermal images; Medicine -- Computer programs -- Periodicals; Biology -- Computer programs -- Periodicals; Computers -- Periodicals; Medicine -- Periodicals; Médecine -- Logiciels -- Périodiques; Biologie -- Logiciels -- Périodiques; Biology -- Computer programs; Medicine -- Computer programs; Periodicals; Electronic journals; 610.28
• DOI: 10.1016/j.cmpb.2021.106045
• Languages: English
• ISSNs: 0169-2607

Abstract

Highlights: A novel multi-input convolutional neural network is proposed to detect breast cancer. The model combines thermal images of different views with personal and clinical data. The model achieves better results than the ones only considering the front views. Personal and clinical data helps to better detect patients with cancer. Graphical abstract: Abstract: Background and objective: Breast cancer is the most common cancer in women. While mammography is the most widely used screening technique for the early detection of this disease, it has several disadvantages such as radiation exposure or high economic cost. Recently, multiple authors studied the ability of machine learning algorithms for early diagnosis of breast cancer using thermal images, showing that thermography can be considered as a complementary test to mammography, or even as a primary test under certain circumstances. Moreover, although some personal and clinical data are considered risk factors of breast cancer, none of these works considered that information jointly with thermal images. Methods: We propose a novel approach for early detection of breast cancer combining thermal images of different views with personal and clinical data, building a multi-input classification model which exploits the benefits of convolutional neural networks for image analysis. First, we searched for structures using only thermal images. Next, we added the clinical data as a new branch of each of these structures, aiming to improve its performance. Results: We applied our method to the most widely used public database of breast thermal images, the Database for Mastology Research with Infrared Image. The best model achieves a 97% accuracy and an area under the ROC curve of 0.99, with a specificity of 100% and a sensitivity of 83%. Conclusions: After studying the impact of thermal images and personal and clinical data on multi-input convolutional neural networks for breast cancer diagnosis, we conclude that: (1) adding the lateral views to the front view improves the performance of the classification model, and (2) including personal and clinical data helps the model to recognize sick patients.