Automated tongue diagnosis on the smartphone and its applications. (June 2019)

• Record Type: Journal Article
• Authors: Hu, Min-Chun; Lan, Kun-Chan; Fang, Wen-Chieh; Huang, Yu-Chia; Ho, Tsung-Jung; Lin, Chun-Pang; Yeh, Ming-Hsien; Raknim, Paweeya; Lin, Ying-Hsiu; Cheng, Ming-Hsun; He, Yi-Ting; Tseng, Kuo-Chih
• Is Part Of: Computer methods and programs in biomedicine. Volume 174(2019)
• Page Start: 51
• Page End: 64
• Publication Date: 2019-06
• Subjects: Tongue fur -- Automatic tongue diagnosis framework on smartphone -- Lighting condition estimation -- Tongue image color correction -- Tongue fur (white fur) detection; Medicine -- Computer programs -- Periodicals; Biology -- Computer programs -- Periodicals; Computers -- Periodicals; Medicine -- Periodicals; Médecine -- Logiciels -- Périodiques; Biologie -- Logiciels -- Périodiques; Biology -- Computer programs; Medicine -- Computer programs; Periodicals; Electronic journals; 610.28
• DOI: 10.1016/j.cmpb.2017.12.029
• Languages: English
• ISSNs: 0169-2607

Abstract

Highlights: We propose a SVM-based lighting condition estimation method according to color differences of tongue images taken with and without flash on the smartphone under different lighting conditions. We then train a tongue image color correction matrix for each lighting condition based on the ColorChecker to remove the effect of color distortion. The effects of different model parameters and ColorCheckers on the performance of color correction are also discussed. Finally, in order to demonstrate the potential use of our proposed system, we recruited 246 patients and examined the correlations between the captured tongue features and ALT/ AST. We found that some tongue features have strong correlation with the AST or ALT, which suggests the possible use of these tongue features captured on a smartphone to provide an early warning of liver diseases. Abstract: Tongue features are important objective basis for clinical diagnosis and treatment in both western medicine and Chinese medicine. The need for continuous monitoring of health conditions inspires us to develop an automatic tongue diagnosis system based on built-in sensors of smartphones. However, tongue images taken by smartphone are quite different in color due to various lighting conditions, and it consequently affects the diagnosis especially when we use the appearance of tongue fur to infer health conditions. In this paper, we captured paired tongue images with and without flash, and the color difference between the paired images is used to estimate the lighting condition based on the Support Vector Machine (SVM). The color correction matrices for three kinds of common lights (i.e., fluorescent, halogen and incandescent) are pre-trained by using a ColorChecker-based method, and the corresponding pre-trained matrix for the estimated lighting is then applied to eliminate the effect of color distortion. We further use tongue fur detection as an example to discuss the effect of different model parameters and ColorCheckers for training the tongue color correction matrix under different lighting conditions. Finally, in order to demonstrate the potential use of our proposed system, we recruited 246 patients over a period of 2.5 years from a local hospital in Taiwan and examined the correlations between the captured tongue features and alanine aminotransferase (ALT)/aspartate aminotransferase (AST), which are important bio-markers for liver diseases. We found that some tongue features have strong correlation with AST or ALT, which suggests the possible use of these tongue features captured on a smartphone to provide an early warning of liver diseases.