Automated pneumothorax triaging in chest X‐rays in the New Zealand population using deep‐learning algorithms. Issue 8 (27th February 2022)

• Record Type: Journal Article
• Authors: Feng, Sijing; Liu, Qixiu; Patel, Aakash; Bazai, Sibghat Ullah; Jin, Cheng‐Kai; Kim, Ji Soo; Sarrafzadeh, Mikal; Azzollini, Damian; Yeoh, Jason; Kim, Eve; Gordon, Simon; Jang‐Jaccard, Julian; Urschler, Martin; Barnard, Stuart; Fong, Amy; Simmers, Cameron; Tarr, Gregory P; Wilson, Ben
• Is Part Of: Journal of medical imaging and radiation oncology. Volume 66:Issue 8(2022)
• Page Start: 1035
• Page End: 1043
• Publication Date: 2022-02-27
• Subjects: artificial intelligence -- neural networks -- pneumothorax -- triage -- X‐ray; Radiology, Medical -- Periodicals; Radiology, Medical -- Australasia -- Periodicals; 616.0757
• DOI: 10.1111/1754-9485.13393
• Languages: English
• ISSNs: 1754-9477

Abstract

Abstract: Introduction: The primary aim was to develop convolutional neural network (CNN)‐based artificial intelligence (AI) models for pneumothorax classification and segmentation for automated chest X‐ray (CXR) triaging. A secondary aim was to perform interpretability analysis on the best‐performing candidate model to determine whether the model's predictions were susceptible to bias or confounding. Method: A CANDID‐PTX dataset, that included 19, 237 anonymized and manually labelled CXRs, was used for training and testing candidate models for pneumothorax classification and segmentation. Evaluation metrics for classification performance included Area under the receiver operating characteristic curve (AUC‐ROC), sensitivity and specificity, whilst segmentation performance was measured using mean Dice and true‐positive (TP)‐Dice coefficients. Interpretability analysis was performed using Grad‐CAM heatmaps. Finally, the best‐performing model was implemented for a triage simulation. Results: The best‐performing model demonstrated a sensitivity of 0.93, specificity of 0.95 and AUC‐ROC of 0.94 in identifying the presence of pneumothorax. A TP‐Dice coefficient of 0.69 is given for segmentation performance. In triage simulation, mean reporting delay for pneumothorax‐containing CXRs is reduced from 9.8 ± 2 days to 1.0 ± 0.5 days ( P ‐value < 0.001 at 5% significance level), with sensitivity 0.95 and specificity of 0.95 given for the classification performance. Finally, interpretability analysis demonstrated models employed logic understandable to radiologists, with negligible bias or confounding in predictions. Conclusion: AI models can automate pneumothorax detection with clinically acceptable accuracy, and potentially reduce reporting delays for urgent findings when implemented as triaging tools.