3D‐PulCNN: Pulmonary cancer classification from hyperspectral images using convolution combination unit based CNN. Issue 12 (23rd August 2021)

• Record Type: Journal Article
• Authors: Zhang, Qing; Wang, Yan; Qiu, Song; Chen, Jiangang; Sun, Li; Li, Qingli
• Is Part Of: Journal of biophotonics. Volume 14:Issue 12(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-08-23
• Subjects: convolutional neural networks -- image classification -- microscopic hyperspectral image -- pulmonary cancer; Photonics -- Periodicals; Optical materials -- Periodicals; Optics -- Periodicals; Medical instruments and apparatus -- Periodicals; 621.3605
• DOI: 10.1002/jbio.202100142
• Languages: English
• ISSNs: 1864-063X

Abstract

Abstract: Pulmonary cancer is one of the most common malignancies worldwide. Accurate classification of its subtypes is required in differential diagnosis. However, existing algorithms are mostly based on color images, and the improvement of accuracy is quite challenging. In this study, we propose a convolution combination unit (CCU)‐based three‐dimensional convolutional neural network (3D‐PulCNN) for classifying pulmonary cancer presented in microscopic hyperspectral image with both spatial and spectral information. CCU is designed to fuse the features acquired by different convolution scales. Compared with VGGNet, only two fully connected layers are used in this model, reducing the network parameters and model complexity. Experimental results show that 3D‐PulCNN achieves overall average (OA) of 0.962 and Precision, Recall, and Kappa of more than 0.920, superior to 2D‐VGGNet. Then, 3D‐UNet is leveraged to segment cancer cells, and their morphological characteristics are calculated to supply quantitative virtual analysis data for classification results explanation and prognosis assessment. Abstract : Pulmonary cancer is one of the most common malignancies worldwide. Existing algorithms for its classification are mostly based on color images, and the improvement of accuracy is quite challenging. This article proposes a new framework named as three‐dimensional convolutional neural network (3D‐PulCNN) for classifying pulmonary cancer based on microscopic hyperspectral image. Also, 3D‐UNet is leveraged to segment cancer cells, and their morphological characteristics are calculated to help with prognosis assessment.