A Deep Facial BRDF Estimation Method Based on Image Translation. Issue 1 (1st November 2022)

• Record Type: Journal Article
• Authors: Feng, Lulu; Weng, Dongdong; Liang, Bin
• Is Part Of: Journal of physics. Volume 2363: Issue 1(2022)
• Publication Date: 2022-11-01
• Subjects: 3D face reconstruction -- BRDF estimation -- cGAN -- image translation; Physics -- Congresses; 530.5
• DOI: 10.1088/1742-6596/2363/1/012011
• Languages: English
• ISSNs: 1742-6588

Abstract

Abstract : The reconstruction of photorealistic 3D face geometry, textures and reflectance (BRDF) is one of the most popular fields in computer vision, graphics and machine learning. However, the acquisition of facial reflectance remains a challenge. In this article, we propose a method for estimating the facial reflection properties of a single portrait image based on image translation. From a RGB face image, we obtain the BRDF with a large amount of detail. To achieve it, we perform a reverse engineer, which renders face images with the obtained texture map to form training data pairs based on the Blinn-Phong illumination model. We also apply random rotate-and-crop and sliding-window-crop to augment the data and optimize the network weights by minimizing the generated adversarial loss and reconstruction loss. As demonstrated in a chain of quantitative and qualitative experiments, our method achieves superior performance compared to the state-of-the-art methods.