Characterizing the performance of an image-based recognizer for planar mechanical linkages in textbook graphics and hand-drawn sketches. (November 2015)

• Record Type: Journal Article
• Authors: Eicholtz, Matthew; Kara, Levent Burak
• Is Part Of: Computers & graphics. Volume 52(2015)
• Page Start: 1
• Page End: 17
• Publication Date: 2015-11
• Subjects: Computer vision -- Evolutionary multiobjective optimization -- Image processing -- Kinematic modeling -- Object recognition -- Sketch recognition; Computer graphics -- Periodicals; 006.6
• DOI: 10.1016/j.cag.2015.06.002
• Languages: English
• ISSNs: 0097-8493

Abstract

Abstract: In this work, we present a computational framework for automatically generating kinematic models of planar mechanical linkages from raw images. The hallmark of our approach is a novel combination of supervised learning methods for detecting mechanical parts (e.g. joints, rigid bodies) with the optimizing power of a multiobjective evolutionary algorithm, which concurrently maximizes image consistency and mechanical feasibility. A rigorous set of experiments was conducted to systematically evaluate the performance of each phase in our framework, comparing various combinations of joint and body detection schemes and feasibility constraints. Precision–recall curves are used to assess object detection performance. For the optimization, in addition to standard accuracy measures such as top- N accuracy, we introduce a new performance metric called user effort ratio that quantifies the amount of user interaction required to correct an inaccurate optimization solution. Current state-of-the-art performance is achieved with (i) one (or a cascade of) support vector machines for joint detection, (ii) foreground extraction to reduce false positives, (iii) supervised body detection using normalized geodesic time, distance, and detected joint confidence, and (iv) feasibility constraints derived from graph theory. The proposed framework generalizes moderately well from textbook graphics to hand-drawn sketches, and user effort ratio results demonstrate the potential power of an interactive system in which simple user interactions complement computer recognition for fast kinematic modeling. Abstract : Graphical abstract: Abstract : Highlights: We systematically evaluate a framework for recognizing mechanical linkages in images. We introduce user effort ratio to assess overall benefit over manual model creation. New rigid body detection and graph–theoretic constraints enhance performance. Top-1 accuracy for textbook images is 70% with user effort of 10% on average. Performance on sketches is lower overall, but still reduces user effort by 72% on average.