A novel three-dimensional surface reconstruction method for the complex fabrics based on the MVS. (November 2020)

• Record Type: Journal Article
• Authors: Wang, Yiliang; Deng, Na; Xin, Binjie; Wang, Wenzhen; Xing, Wenyu; Lu, Shuaigang
• Is Part Of: Optics & laser technology. Volume 131(2020)
• Publication Date: 2020-11
• Subjects: 3-D reconstruction -- Fabric characterization -- PSO -- MVS; Optics -- Periodicals; Lasers -- Periodicals; Electronic journals; 621.366
• DOI: 10.1016/j.optlastec.2020.106415
• Languages: English
• ISSNs: 0030-3992

Abstract

Highlights: Accurate 3D model of fabric surface was generated based on the multi-view stereo principle. The optimal camera's pose was sought out by the nonlinear optimization algorithm. The particle swarm optimization algorithm was adopted to find the optimal patches. Abstract: To solve the existing problems occurring in the field of digital fabric appearance analysis, such as information loss, visual expression difficulty and low accuracy, a novel three-dimensional (3-D) surface reconstruction method based on the multi-view stereo (MVS) technology was proposed for the appearance evaluation of complex fabrics in this paper. Initially, the fabric images were captured by the self-developed multiple image acquisition system. Subsequently, the dense point cloud of fabric surface could be obtained by the operations of feature point detection and matching, camera intrinsic and extrinsic parameter calculation, image pre-processing, sparse point cloud generation, patch expansion and patch filtering. For the sake of acquiring the high accuracy and great completeness of dense point cloud, planar patches with different scales were used to fit the fabric surface, the normalized cross correlation (NCC) algorithm was adopted to improve the accuracy of photo-consistency measurement, and besides, a derivative-free particle swarm optimization (PSO) method was applied to obtain the optimal patches. Our experimental results show that the fabric surface model could be reconstructed by this method accurately, which can be used to characterize the surface texture and 3D weaving profile of woven fabrics. The reconstructed 3D fabric surface model with high precision can be used not only for three-dimensional illustration or rendering but also for structural analysis, quality evaluation of fabric appearance and etc., it provides a useful solution for artificial intelligence production in the textile industry.