A weakly supervised tooth‐mark and crack detection method in tongue image. (18th March 2021)

• Record Type: Journal Article
• Authors: Weng, Hui; Li, Lei; Lei, Huangwei; Luo, Zhiming; Li, Candong; Li, Shaozi
• Is Part Of: Concurrency and computation. Volume 33:Number 16(2021)
• Page Start: n/a
• Page End: n/a
• Publication Date: 2021-03-18
• Subjects: cracked tongue -- deep learning -- detection -- tooth‐marked tongue -- weakly supervised; Parallel processing (Electronic computers) -- Periodicals; Parallel computers -- Periodicals; 004.35
• DOI: 10.1002/cpe.6262
• Languages: English
• ISSNs: 1532-0626

Abstract

Abstract: Tongue diagnosis is one of the primary clinical diagnostic methods in Traditional Chinese Medicine. Recognizing the tooth‐marked tongue and the crackled tongue plays an essential role in evaluating the status of patients. Previous methods mainly focus on identifying whether a tongue image is a tooth‐marked tongue (cracked tongue) or not, while cannot provide more details. In this study, we propose a weakly supervised method for training the tooth‐mark and crack detection model by leveraging fully bounding‐box level annotated and coarse image‐level annotated tongue images. The proposed model is extended from the YOLO object detection model, and we add several classification branches for recognizing the tooth‐marked tongue and cracked tongue. The classification branch aims to predict the coarse label for both coarse‐labeled data and fully annotated data. The detection branch is used to locate the position of tooth marks and cracks from the fully annotated data. Finally, we utilize a multitask loss function for training the model. Experimental results on a challenging tongue image dataset demonstrate the effectiveness of our proposed weakly supervised method.