A gesture-free geometric approach for mid-air expression of design intent in 3D virtual pottery. (December 2015)

• Record Type: Journal Article
• Authors: Vinayak, ; Ramani, Karthik
• Is Part Of: Computer aided design. Volume 69(2015)
• Page Start: 11
• Page End: 24
• Publication Date: 2015-12
• Subjects: Hand-based shape modeling -- Mid-air interactions -- Virtual pottery -- Gestures -- Natural user interfaces -- Mesh deformation; Computer-aided design -- Periodicals; Engineering design -- Data processing -- Periodicals; Computer graphics -- Periodicals; Conception technique -- Informatique -- Périodiques; Infographie -- Périodiques; Computer graphics; Engineering design -- Data processing; Periodicals; Electronic journals; 620.00420285
• DOI: 10.1016/j.cad.2015.06.006
• Languages: English
• ISSNs: 0010-4485

Abstract

Abstract: The advent of depth cameras has enabled mid-air interactions for shape modeling with bare hands. Typically, these interactions employ a finite set of pre-defined hand gestures to allow users to specify modeling operations in virtual space. However, human interactions in real world shaping processes (such as pottery or sculpting) are complex, iterative, and continuous. In this paper, we show that the expression of user intent in shaping processes can be derived from the geometry of contact between the hand and the manipulated object. Specifically, we describe the design and evaluation of a geometric interaction technique for bare-hand mid-air virtual pottery. We model the shaping of a pot as a gradual and progressive convergence of the pot's profile to the shape of the user's hand represented as a point-cloud (PCL). Thus, a user does not need to learn, know, or remember any gestures to interact with our system. Our choice of pottery simplifies the geometric representation, allowing us to systematically study how users use their hands and fingers to express the intent of deformation during a shaping process. Our evaluations demonstrate that it is possible to enable users to express their intent for shape deformation without the need for a fixed set of gestures for clutching and deforming a shape. Graphical abstract: Highlights: We introduce a geometric approach for mid-air virtual pottery design. A user can design virtual pots without the need to remember gestures. The shape of a pot gradually converges to the point-cloud of the user's hands. Applications are shown with two depth sensors, Leap Motion and SoftKinetic DepthSense. User evaluation demonstrates strengths and weaknesses of our approach.