Adapting content-based image retrieval techniques for the semantic annotation of medical images. (April 2016)

• Record Type: Journal Article
• Authors: Kumar, Ashnil; Dyer, Shane; Kim, Jinman; Li, Changyang; Leong, Philip H.W.; Fulham, Michael; Feng, Dagan
• Is Part Of: Computerized medical imaging and graphics. Volume 49(2016)
• Page Start: 37
• Page End: 45
• Publication Date: 2016-04
• Subjects: Image annotation -- Content-based image retrieval -- Computed tomography -- Liver -- ImageCLEF; Diagnostic imaging -- Periodicals; Imaging systems in medicine -- Periodicals; Diagnosis, Radioscopic -- Data processing -- Periodicals; Diagnostic Imaging -- Periodicals; Imagerie pour le diagnostic -- Périodiques; Diagnostic imaging; Periodicals; Electronic journals; Electronic journals; 616.0754
• DOI: 10.1016/j.compmedimag.2016.01.001
• Languages: English
• ISSNs: 0895-6111

Abstract

Abstract : Graphical abstract: Abstract : Highlights: Proposed a method for annotating 3D computed tomography images of the liver. Leveraged content-based image retrieval techniques to derive semantic labels from a collection of similar images. Adapted support vector machines and nearest-neighbour search. The method achieved high annotation accuracy than other well-established methods. The method had the best result at ImageCLEF 2014 Liver Annotation challenge. Abstract: The automatic annotation of medical images is a prerequisite for building comprehensive semantic archives that can be used to enhance evidence-based diagnosis, physician education, and biomedical research. Annotation also has important applications in the automatic generation of structured radiology reports. Much of the prior research work has focused on annotating images with properties such as the modality of the image, or the biological system or body region being imaged. However, many challenges remain for the annotation of high-level semantic content in medical images (e.g., presence of calcification, vessel obstruction, etc.) due to the difficulty in discovering relationships and associations between low-level image features and high-level semantic concepts. This difficulty is further compounded by the lack of labelled training data. In this paper, we present a method for the automatic semantic annotation of medical images that leverages techniques from content-based image retrieval (CBIR). CBIR is a well-established image search technology that uses quantifiable low-level image features to represent the high-level semantic content depicted in those images. Our method extends CBIR techniques to identify or retrieve a collection of labelled images that have similar low-level features and then uses this collection to determine the best high-level semantic annotations. We demonstrate our annotation method using retrieval via weighted nearest-neighbour retrieval and multi-class classification to show that our approach is viable regardless of the underlying retrieval strategy. We experimentally compared our method with several well-established baseline techniques (classification and regression) and showed that our method achieved the highest accuracy in the annotation of liver computed tomography (CT) images.