3D shape segmentation via shape fully convolutional networks. (February 2018)

• Record Type: Journal Article
• Authors: Wang, Pengyu; Gan, Yuan; Shui, Panpan; Yu, Fenggen; Zhang, Yan; Chen, Songle; Sun, Zhengxing
• Is Part Of: Computers & graphics. Volume 70(2018)
• Page Start: 128
• Page End: 139
• Publication Date: 2018-02
• Subjects: Computer graphics -- Periodicals; 006.6
• DOI: 10.1016/j.cag.2017.07.030
• Languages: English
• ISSNs: 0097-8493

Abstract

Highlights: We proposed a shape fully convolutional network (SFCN) for 3D shapes. We achieved effective convolution and pooling operations on 3D shapes. We outperformed the sate-of-the-art in shape segmentation by using SFCN. Achieving excellent segmentation results on predicting shapes of mixed categories. Graphical abstract: Abstract: We propose a novel fully convolutional network architecture for shapes, denoted by Shape Fully Convolutional Networks (SFCN) . 3D shapes are represented as graph structures in the SFCN architecture, based on novel graph convolution and pooling operations, which are similar to convolution and pooling operations used on images. Meanwhile, to build our SFCN architecture in the original image segmentation fully convolutional network (FCN) architecture, we also design and implement a generating operation with bridging function. This ensures that the convolution and pooling operation we have designed can be successfully applied in the original FCN architecture. In this paper, we also present a new shape segmentation approach based on SFCN. Furthermore, we allow more general and challenging input, such as mixed datasets of different categories of shapes which can prove the ability of our generalisation. In our approach, SFCNs are trained triangles-to-triangles by using three low-level geometric features as input. Finally, the feature voting-based multi-label graph cuts is adopted to optimise the segmentation results obtained by SFCN prediction. The experiment results show that our method can effectively learn and predict mixed shape datasets of either similar or different characteristics, and achieve excellent segmentation results.