Context based image analysis with application in dietary assessment and evaluation. Issue 15 (August 2018)

• Record Type: Journal Article
• Authors: Wang, Yu; He, Ye; Boushey, Carol; Zhu, Fengqing; Delp, Edward
• Is Part Of: Multimedia tools and applications. Volume 77:Issue 15(2018)
• Page Start: 19769
• Page End: 19794
• Publication Date: 2018-08
• Subjects: Image analysis -- Image segmentation -- Object classification -- Context information -- Dietary assessment
• DOI: 10.1007/s11042-017-5346-x
• Languages: English
• ISSNs: 1380-7501

Abstract

Abstract Dietary assessment is essential for understanding the link between diet and health. We develop a context based image analysis system for dietary assessment to automatically segment, identify and quantify food items from images. In this paper, we describe image segmentation and object classification methods used in our system to detect and identify food items. We then use context information to refine the classification results. We define contextual dietary information as the data that is not directly produced by the visual appearance of an object in the image, but yields information about a user's diet or can be used for diet planning. We integrate contextual dietary information that a user supplies to the system either explicitly or implicitly to correct potential misclassifications. We evaluate our models using food image datasets collected during dietary assessment studies from natural eating events.