Automatic Extraction and Labelling of Memorial Objects From 3D Point Clouds. Issue 1 (23rd April 2021)

• Record Type: Journal Article
• Authors: Arnold, Nicholas; Angelov, Plamen; Viney, Tim; Atkinson, Peter
• Is Part Of: Journal of computer applications in archaeology. Volume 4:Issue 1(2021)
• Page Start: 79
• Page End: 93
• Publication Date: 2021-04-23
• Subjects: 3D -- Point Cloud -- Transfer Learning -- Cultural Heritage Management -- Object Extraction; 930.10285
• DOI: 10.5334/jcaa.66
• Languages: English
• ISSNs: 2514-8362

Abstract

This research addresses the problem of automatic extraction of memorial objects from cultural heritage sites represented as scenes of 3D point clouds. Point clouds provide a fine spatial resolution and accurate proxy of the real world. However, how to use them directly is not always obvious. This is especially true for applications where extensive training data or computational resources are not available. In this paper, we present a methodology for automatic segmentation and labelling of cultural heritage objects from 3D point cloud scenes. The proposed methodology is based on machine learning techniques and, in particular, makes use of the concept of transfer learning. Memorial objects are segmented from the scene based on their geometric shape characteristic through a conditional multi-scale partitioning scheme. Then, high-level latent feature descriptors are extracted by a convolutional neural network pre-trained on different 3D object models from a standard dataset (e.g., ModelNet). Based on these descriptors, a classification model (multilayer perceptron) is trained and applied to obtain semantic labels. Experiments demonstrated that the proposed methodology is effective for the extraction and labelling of grave marker objects from cultural heritage sites.