ScaffoldGAN: Synthesis of Scaffold Materials based on Generative Adversarial Networks. (September 2021)

• Record Type: Journal Article
• Authors: Zhang, Hui; Yang, Lei; Li, Changjian; Wu, Bojian; Wang, Wenping
• Is Part Of: Computer aided design. Volume 138(2021)
• Publication Date: 2021-09
• Subjects: 3D shape synthesis -- Generative adversarial networks -- Deep learning -- Scaffold material -- Complex structure; Computer-aided design -- Periodicals; Engineering design -- Data processing -- Periodicals; Computer graphics -- Periodicals; Conception technique -- Informatique -- Périodiques; Infographie -- Périodiques; Computer graphics; Engineering design -- Data processing; Periodicals; Electronic journals; 620.00420285
• DOI: 10.1016/j.cad.2021.103041
• Languages: English
• ISSNs: 0010-4485

Abstract

Abstract: Digitally synthesizing scaffold-like materials with complex structures, e.g., bones or metal foam, is a fundamental yet challenging task in tissue engineering and other biomedical applications, because it is difficult to generate synthesized results with equal visual complexity, strong spatial coherence, and similar statistical metrics. To handle these challenges, we present ScaffoldGAN, an efficient end-to-end framework based on generative adversarial networks (GANs) for synthesizing three-dimensional (3D) materials with complex internal structures resembling the given exemplar. Specifically, we propose a novel structural loss to enforce strong spatial coherence in the synthesized results by leveraging the deep features learned by our networks. To demonstrate the effectiveness of our model and the proposed structural loss term, we collected example data containing various structural complexities, covering two categories of materials, i.e., bones and metal foams. Extensive comparative experiments on these collected data showed that our method outperforms state-of-the-art methods, producing synthesized results with better visual quality and desirable statistical metrics. The ablation study proves the structural loss is the main contributor to the performance gain, validating our design choice. Highlights: We propose ScaffoldGAN, a novel end-to-end solution to the synthesis of bone scaffolds, which can efficiently produce high-quality synthesized results with intricate inner structures, while maintaining strong spatial coherence and similar statistical metrics to the material exemplars. We design a novel structural loss term to enforce strong spatial coherence of synthesized results by considering deep features similarity in the network. We collect training datasets (i.e., bones and metal foams), which could be further used to facilitate future studies in both computer vision and biomedical engineering.