Neural Denoising with Layer Embeddings. (20th July 2020)

• Record Type: Journal Article
• Authors: Munkberg, Jacob; Hasselgren, Jon
• Is Part Of: Computer graphics forum. Volume 39:Number 4(2020)
• Page Start: 1
• Page End: 12
• Publication Date: 2020-07-20
• Subjects: CCS Concepts -- Computing methodologies → Ray tracing -- Neural networks; Computer graphics -- Periodicals; 006.605
• DOI: 10.1111/cgf.14049
• Languages: English
• ISSNs: 0167-7055

Abstract

Abstract: We propose a novel approach for denoising Monte Carlo path traced images, which uses data from individual samples rather than relying on pixel aggregates. Samples are partitioned into layers, which are filtered separately, giving the network more freedom to handle outliers and complex visibility. Finally the layers are composited front‐to‐back using alpha blending. The system is trained end‐to‐end, with learned layer partitioning, filter kernels, and compositing. We obtain similar image quality as recent state‐of‐the‐art sample based denoisers at a fraction of the computational cost and memory requirements.