Reversed Sketch: A scalable and comparable shape representation. (August 2018)

• Record Type: Journal Article
• Authors: Huang, Ming; Lin, JiaJun; Chen, Ning; An, Wei; Zhu, WeiJian
• Is Part Of: Pattern recognition. Volume 80(2018:Aug.)
• Page Start: 168
• Page End: 182
• Publication Date: 2018-08
• Subjects: Shape representation -- Image matching -- Contour detection -- Polygon evolution -- Content-based image retrieval; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2018.03.001
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: We proposed a polygonal shape representation which can simplify the shape features for better processing and comparison. We proposed a polygonal contour detection algorithm which can quickly extract contour from a binary or segment image. We proposed a comparable metric which can measure the similarity between polygons and the corresponding comparison algorithm. Made a great improvement on the existing metric, our metric and algorithm can be applied to concave or even spiral polygons. Our shape representation can be used to build hierarchical index on large image database for content-based image retrieval. Abstract: The shape features of images are essential to image recognition, comparison and retrieval since most users are more interested in recognizing or comparing images by shape than by color and texture [1]. Comparing or retrieving images by shape is still envisioned as one of the most challenging works in image comparison and retrieval because of the lack of effective and efficient representations of shape features in image comparison and retrieval. In this paper, we propose a scalable and comparable shape representation, namely "Reversed Sketch", is proposed, on which a shape feature extraction and utilization framework is built. With this representation, we represent an image object using a polygon extracted from the contour of the image object by a force-driving sliding box algorithm. A polygon evolution algorithm is then proposed for transforming the first wiggly polygon into a more sketchy form for efficiently processing, which makes our shape representation more scalable. Also, we present a comparable metric drawn from this representation combined with the comparing algorithm, which is invariant to scaling, rotation and translation and thereby is suitable for image recognition, registration and comparison. The proposed shape representation is especially suitable for image retrieval because with it a hierarchical index which is very useful for image retrieval can be built on the image dataset. Extensive experiments are carried out and the experiment results show that with our shape representation the shape features can be quickly extracted from an image, simplified as needed, and used to efficiently comparing shapes in accord with people's perception. Experiment results derived with practical datasets indicate that our framework can achieve better comparing precision and efficiency, compared with some other methods.