Controlling Material Appearance by Examples. (30th July 2022)

• Record Type: Journal Article
• Authors: Hu, Yiwei; Hašan, Miloš; Guerrero, Paul; Rushmeier, Holly; Deschaintre, Valentin
• Is Part Of: Computer graphics forum. Volume 41:Number 4(2022)
• Page Start: 117
• Page End: 128
• Publication Date: 2022-07-30
• Subjects: CCS Concepts -- Computing methodologies → Reflectance modeling; Computer graphics -- Periodicals; 006.605
• DOI: 10.1111/cgf.14591
• Languages: English
• ISSNs: 0167-7055

Abstract

Abstract: Despite the ubiquitous use of materials maps in modern rendering pipelines, their editing and control remains a challenge. In this paper, we present an example‐based material control method to augment input material maps based on user‐provided material photos. We train a tileable version of MaterialGAN and leverage its material prior to guide the appearance transfer, optimizing its latent space using differentiable rendering. Our method transfers the micro and meso‐structure textures of user provided target(s) photographs, while preserving the structure and quality of the input material. We show our methods can control existing material maps, increasing realism or generating new, visually appealing materials.