The effect of deep convolutional neural networks on radiologists' performance in the detection of hip fractures on digital pelvic radiographs. Issue 130 (September 2020)

• Record Type: Journal Article
• Authors: Mawatari, Tsubasa; Hayashida, Yoshiko; Katsuragawa, Shigehiko; Yoshimatsu, Yuta; Hamamura, Toshihiko; Anai, Kenta; Ueno, Midori; Yamaga, Satoru; Ueda, Issei; Terasawa, Takashi; Fujisaki, Akitaka; Chihara, Chihiro; Miyagi, Tomoyuki; Aoki, Takatoshi; Korogi, Yukunori
• Is Part Of: European journal of radiology. Issue 130(2020)
• Publication Date: 2020-09
• Subjects: DCNN Deep Convolutional Neural Network -- ROC analysis: receiver operating characteristic analysis -- AUC area under ROC curve; Femoral Fractures -- Radiography -- Neural Networks, Computer -- Diagnosis, Computer-Assisted -- Reference Standards; Medical radiology -- Periodicals; Radiology -- Periodicals; Radiologie médicale -- Périodiques; Medical radiology; Periodicals; 616.075705
• DOI: 10.1016/j.ejrad.2020.109188
• Languages: English
• ISSNs: 0720-048X

Abstract

Highlights: We developed an automated deep learning system for detecting hip fractures on radiographs using CT and MRI as a gold standard annotated by radiologists trying to avoid the omission of false negative cases from the onset of the study. We also evaluated the diagnostic performance of human readers with and without DCNN output. DCNN output improved the diagnostic performance including the experienced readers. Abstract: Purpose: The purpose of our study is to develop deep convolutional neural network (DCNN) for detecting hip fractures using CT and MRI as a gold standard, and to evaluate the diagnostic performance of 7 readers with and without DCNN. Methods: The study population consisted of 327 patients who underwent pelvic CT or MRI and were diagnosed with proximal femoral fractures. All radiographs were manually checked and annotated by radiologists referring to CT and MRI for selecting ROI. At first, a DCNN with the GoogLeNet model was trained by 302 cases. The remaining 25 cases and 25 control subjects were used for the observer performance study and for the testing of DCNN. Seven readers took part in this study. A continuous rating scale was used to record each observer's confidence level. Subsequently, each observer interpreted with the DCNN outputs and rated them again. The area under the curve (AUC) was used to compare the fracture detection. Results: The average AUC of the 7 readers was 0.832. The AUC of DCNN alone was 0.905. The average AUC of the 7 readers with DCNN outputs was 0.876. The AUC of readers with DCNN output were higher than those without(p < 0.05). The AUC of the 2 experienced readers with DCNN output exceeded the AUC of DCNN alone. Conclusion: For detecting the hip fractures on radiographs, DCNN developed using CT and MRI as a gold standard by radiologists improved the diagnostic performance including the experienced readers.