Visual enhancement of single-view 3D point cloud reconstruction. (February 2022)

• Record Type: Journal Article
• Authors: Ping, Guiju; Abolfazli Esfahani, Mahdi; Chen, Jiaying; Wang, Han
• Is Part Of: Computers & graphics. Volume 102(2022)
• Page Start: 112
• Page End: 119
• Publication Date: 2022-02
• Subjects: 3D reconstruction -- Single-view -- Point clouds -- Differentiable render; Computer graphics -- Periodicals; 006.6
• DOI: 10.1016/j.cag.2022.01.001
• Languages: English
• ISSNs: 0097-8493

Abstract

Abstract: 3D reconstruction from a single image is one of the core computer vision problems. Thanks to the development of deep learning, 3D reconstruction of a single image has demonstrated impressive progress in recent years. Existing researches use Chamfer distance as a loss function to guard the training of the neural network. However, the Chamfer loss will give equal weights to all points inside the 3D point clouds. It tends to sacrifice fine-grained and thin structures to avoid incurring a high loss, which will lead to visually unsatisfactory results. This paper proposes a framework that can recover a detailed three-dimensional point cloud from a single image by focusing more on boundaries (edge and corner points). Experimental results demonstrate that the proposed method outperforms existing techniques significantly, both qualitatively and quantitatively, and has fewer training parameters. Graphical abstract: Highlights: Reconstructing the full 3D shape of an object from a single image. Using a differentiable point cloud projection module to get the projected images. Increasing visual reconstruction quality.