A method for generating 3D thermal models with decoupled acquisition. (November 2017)

• Record Type: Journal Article
• Authors: Krefer, Andriy Guilherme; Lie, Maiko Min Ian; Borba, Gustavo Benvenutti; Gamba, Humberto Remigio; Lavarda, Marcos Dinís; Abreu de Souza, Mauren
• Is Part Of: Computer methods and programs in biomedicine. Volume 151(2017)
• Page Start: 79
• Page End: 90
• Publication Date: 2017-11
• Subjects: Multi-modality imaging -- 3D thermography -- Structure from Motion -- Scale Invariant Feature Transform; Medicine -- Computer programs -- Periodicals; Biology -- Computer programs -- Periodicals; Computers -- Periodicals; Medicine -- Periodicals; Médecine -- Logiciels -- Périodiques; Biologie -- Logiciels -- Périodiques; Biology -- Computer programs; Medicine -- Computer programs; Periodicals; Electronic journals; 610.28
• DOI: 10.1016/j.cmpb.2017.08.009
• Languages: English
• ISSNs: 0169-2607

Abstract

Highlights: A method for generation of 3D thermal models that allows combination of separately acquired 3D mesh and thermal images. An intensity transformation approach that allows effective interest point detection on thermal images. Design and implementation of a test object, called HTTO (Heat Texture Test Object), for 3D model and 2D thermogram fusion methods based on interest point detection. Quantitative evaluation on human subjects: becoming possible the 3D thermography for medical applications under decoupled acquisition scenarios. Abstract: Background and Objective: Both thermal imaging and 3D scanning offer convenient advantages for medical applications, namely, being contactless, non-invasive and fast. Consequently, many approaches have been proposed to combine both sensing modalities in order to acquire 3D thermal models. The predominant approach is to affix a 3D scanner and a thermal camera in the same support and calibrate them together. While this approach allows straightforward projection of thermal images over the 3D mesh, it requires their simultaneous acquisition. In this work, a method for generation of 3D thermal models that allows combination of separately acquired 3D mesh and thermal images is presented. Among the advantages of this decoupled acquisition are increased modularity of acquisition procedures and reuse of legacy equipment and data. Methods: The proposed method is based on the projection of thermal images over a 3D mesh. Unlike previous methods, it is considered that the 3D mesh and the thermal images are acquired separately, so camera pose estimation is required to determine the correct spatial positioning from which to project the images. This is done using Structure from Motion, which requires a series of interest points correspondences between the images, for which the SIFT method was used. As thermal images of human skin are predominantly homogeneous, an intensity transformation is proposed to increase the efficacy of interest point detection and make the approach feasible. Before projection, the adequate alignment of the 3D mesh in space is determined using Particle Swarm Optimization. For validation of the method, the design and implementation of a test object is presented. It can be used to validate other methods and can be reproduced with common printed circuit board manufacturing processes. Results: The proposed approach is accurate, with an average displacement error of 1.41 mm ( s = 0.74 mm) with the validation test object and 4.58 mm ( s = 2.12 mm) with human subjects. Conclusions: The proposed method is able to combine separately a acquired 3D mesh and thermal images into an accurate 3D thermal model. The results with human subjects suggest that the method can be successfully employed in medical applications.