Image region annotation based on segmentation and semantic correlation analysis. Issue 8 (1st August 2018)

• Record Type: Journal Article
• Authors: Zhang, Jing; Mu, Yakun; Feng, Shengwei; Li, Kehuang; Yuan, Yubo; Lee, Chin‐Hui
• Is Part Of: IET image processing. Volume 12:Issue 8(2018)
• Page Start: 1331
• Page End: 1337
• Publication Date: 2018-08-01
• Subjects: image segmentation -- optical correlation -- image texture -- image enhancement -- image coding -- image representation -- image classification -- learning (artificial intelligence); segmentation correlation analysis -- semantic correlation analysis -- image region annotation framework -- syntactic correlation analysis -- texture‐enhanced image segmentation JSEG algorithm -- image codeword -- visual alphabet -- low‐level image feature -- visual lexicon -- middle‐level semantic concept -- maximal figure‐of‐merit algorithm -- region‐semantic correlation model -- Corel 5K dataset -- concept classification model; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/iet-ipr.2017.0917
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract : The authors propose an image region annotation framework by exploring syntactic and semantic correlations among segmented regions in an image. A texture‐enhanced image segmentation JSEG algorithm is first used to improve the pixel consistency in a segmented image region. Next, each region is represented by a set of image codewords, also known as visual alphabets, with each of them used to characterise certain low‐level image features. A visual lexicon, with its vocabulary items defined as either a codeword or a co‐occurrence of multiple alphabets, is formed and used to model middle‐level semantic concepts. The concept classification models are trained by a maximal figure‐of‐merit algorithm with a collection of training images with multiple correlations, including spatial, syntactic and semantic relationship, between regions and their corresponding concepts. In addition, a region‐semantic correlation model constructed with latent semantic analysis is used to correct the potentially wrong annotations by analysing the relationship between image region positions and labels. When evaluated on the Corel 5K dataset, the proposed image region annotation framework achieves accurate results on image region concept tagging as well as whole image based annotations.