StyleBlit: Fast Example‐Based Stylization with Local Guidance. (7th June 2019)

• Record Type: Journal Article
• Authors: Sýkora, D.; Jamriška, O.; Texler, O.; Fišer, J.; Lukáč, M.; Lu, J.; Shechtman, E.
• Is Part Of: Computer graphics forum. Volume 38:Number 2(2019)
• Page Start: 83
• Page End: 91
• Publication Date: 2019-06-07
• Subjects: CCS Concepts -- Computing methodologies → Non‐photorealistic rendering -- Image processing; Computer graphics -- Periodicals; 006.605
• DOI: 10.1111/cgf.13621
• Languages: English
• ISSNs: 0167-7055

Abstract

Abstract: We present StyleBlit—an efficient example‐based style transfer algorithm that can deliver high‐quality stylized renderings in real‐time on a single‐core CPU. Our technique is especially suitable for style transfer applications that use local guidance ‐ descriptive guiding channels containing large spatial variations. Local guidance encourages transfer of content from the source exemplar to the target image in a semantically meaningful way. Typical local guidance includes, e.g., normal values, texture coordinates or a displacement field. Contrary to previous style transfer techniques, our approach does not involve any computationally expensive optimization. We demonstrate that when local guidance is used, optimization‐based techniques converge to solutions that can be well approximated by simple pixel‐level operations. Inspired by this observation, we designed an algorithm that produces results visually similar to, if not better than, the state‐of‐the‐art, and is several orders of magnitude faster. Our approach is suitable for scenarios with low computational budget such as games and mobile applications.