Biomedical compound figure detection using deep learning and fusion techniques. Issue 6 (1st June 2018)

• Record Type: Journal Article
• Authors: Lee, Sheng Long; Zare, Mohammad Reza
• Is Part Of: IET image processing. Volume 12:Issue 6(2018)
• Page Start: 1031
• Page End: 1037
• Publication Date: 2018-06-01
• Subjects: medical image processing -- feature extraction -- neural nets -- support vector machines -- image classification -- image fusion -- learning (artificial intelligence); biomedical compound figure detection -- deep learning model -- compound figure detection -- CFD -- pre‐trained convolutional neural networks -- CNN -- transfer learning -- image classification -- support vector machine classifier -- score‐based fusion; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/iet-ipr.2017.0800
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract : Images contain significant amounts of information but present different challenges relative to textual information. One such challenge is compound figures or images made up of two or more subfigures. A deep learning model is proposed for compound figure detection (CFD) in the biomedical article domain. First, pre‐trained convolutional neural networks (CNNs) are selected for transfer learning to take advantage of the image classification performance of CNNs and to overcome the limited dataset of the CFD problem. Next, the pre‐trained CNNs are fine‐tuned on the training data with early‐stopping to avoid overfitting. Alternatively, layer activations of the pre‐trained CNNs are extracted and used as input features to a support vector machine classifier. Finally, individual model outputs are combined with score‐based fusion. The proposed combined model obtained a best test accuracy of 90.03 and 96.93% outperforming traditional hand‐crafted and other deep learning representations on the ImageCLEF 2015 and 2016 CFD subtask datasets, respectively, by using AlexNet, VGG‐16, VGG‐19 pre‐trained CNNs fine‐tuned until best validation accuracy stops increasing combined with the combPROD score‐based fusion operator.