Deployment of a deep-learning based multi-view stereo approach for measurement of ship shell plates. (15th September 2022)

• Record Type: Journal Article
• Authors: He, Pengpeng; Hu, Delin; Hu, Yong
• Is Part Of: Ocean engineering. Volume 260(2022)
• Publication Date: 2022-09-15
• Subjects: Ship shell plates -- Vision measurement -- Deep learning -- Multi-view stereo -- 3D reconstruction; Ocean engineering -- Periodicals; Ocean engineering; Periodicals; 620.4162
• DOI: 10.1016/j.oceaneng.2022.111968
• Languages: English
• ISSNs: 0029-8018

Abstract

Abstract: In this work, a measurement system integrated with a deep-learning based multi-view stereo (MVS) approach is developed to measure ship shell plates. Specifically, a deep learning architecture of CasMVSNet is deployed for depth map inference from multi-view images, which can remarkably decrease the dense reconstruction time and GPU memory consumption. This is the first report that a learned MVS architecture is deployed to three-dimensional (3D) reconstruction of ship shell plates. Measurement experiments are then performed for three typical hull plates to evaluate the accuracy, efficiency and completeness of the proposed measurement method. The results suggest that the complete point cloud data of the curved hull plates can be reconstructed in about 3 min with the average of errors less than 1 mm, which fulfills the requirements of precision and efficiency in shipbuilding production. Compared with traditional wooden templates, the proposed measurement method is more accurate, efficient and inexpensive. The developed measurement system with quantitative data can also be readily integrated with the 3D computer numerical control (CNC) plate bending machine. Moreover, the robustness and flexibility of the proposed measurement method have been verified by comparison with the measurement method based on active binocular stereovision. Highlights: A deep-learning based multi-view stereo (MVS) method is first applied to 3D reconstruction of curved hull plates. A measurement system in combination with a deep-learning based MVS approach is developed to measure ship shell plates. Measurement experiments are performed for three hull plates to evaluate the measuring accuracy, efficiency and completeness.