Reconstruction of Colored Soft Deformable Objects Based on Self-Generated Template. (February 2022)

• Record Type: Journal Article
• Authors: Li, Jituo; Liu, Xinqi; Deng, Haijing; Wang, Tianwei; Lu, Guodong; Wang, Jin
• Is Part Of: Computer aided design. Volume 143(2022)
• Publication Date: 2022-02
• Subjects: 3D reconstruction -- Soft objects -- Self-generated template -- Non-rigid registration -- Texture; Computer-aided design -- Periodicals; Engineering design -- Data processing -- Periodicals; Computer graphics -- Periodicals; Conception technique -- Informatique -- Périodiques; Infographie -- Périodiques; Computer graphics; Engineering design -- Data processing; Periodicals; Electronic journals; 620.00420285
• DOI: 10.1016/j.cad.2021.103124
• Languages: English
• ISSNs: 0010-4485

Abstract

Abstract: In reconstructing soft objects under different deformation states with RGB-D sensors, the results usually suffer from incomplete geometries and textures due to self-occlusion, such as dynamic wrinkles on a garment. A priori template is usually used for addressing this issue, but it requires complex scanning and an elaborate setup. This paper proposes a new framework to reconstruct a deformable soft object with complete geometry and consistent texture by introducing an incremental-completion self-generated template (SGT). By building a non-rigid registration that combines geometry and optical flow features, the SGT is dynamically updated and completed by supplementing the information from each initial state model. Then the updated SGT is reversely deformed to each state to obtain a sequence of dynamic reconstructed results with consistent geometry. Furthermore, a consistent Markov random field is also proposed to constrain mesh models in different states to generate consistent texture and guide non-rigid deformation. Experimental results show that our method achieves multi-state high-quality reconstruction effects, which provides a new solution for dynamically reconstructing colored soft objects. Graphical abstract: Highlights: Creating a self-generated template to reconstruct soft object in different states. Proposing a new non-rigid registration combining geometric and optical flow features. Generating high-quality texture by a consistent Markov Random Field optimization.