Image completion using multispectral imaging. Issue 7 (1st July 2018)

• Record Type: Journal Article
• Authors: Bousefsaf, Frédéric; Tamaazousti, Mohamed; Said, Souheil Hadj; Michel, Rémi
• Is Part Of: IET image processing. Volume 12:Issue 7(2018)
• Page Start: 1164
• Page End: 1174
• Publication Date: 2018-07-01
• Subjects: cameras -- image enhancement -- image segmentation -- rendering (computer graphics); image completion -- multispectral imaging -- snapshot multispectral cameras -- breakthrough technology -- blue cameras -- green cameras -- red cameras -- ultracompact snapshot camera‐recorder -- spectral channels -- minimum enhancement -- scene segmentation -- exemplar‐based completion algorithm -- hyperspectral imaging -- computer vision communities -- spectral pre‐segmentation -- little structure variance -- numerical criteria -- perceptual evaluation -- rendering consistency; Image processing -- Periodicals; 621.36705
• DOI: 10.1049/iet-ipr.2017.1203
• Languages: English
• ISSNs: 1751-9659

Abstract

Abstract : Here, the authors explore the potential of multispectral imaging applied to image completion. Snapshot multispectral cameras correspond to breakthrough technologies that are suitable for everyday use. Therefore, they correspond to an interesting alternative to digital cameras. In their experiments, multispectral images are acquired using an ultracompact snapshot camera‐recorder that senses 16 different spectral channels in the visible spectrum. Direct exploitation of completion algorithms by extension of the spectral channels exhibits only minimum enhancement. A dedicated method that consists in a prior segmentation of the scene has been developed to address this issue. The segmentation derives from an analysis of the spectral data and is employed to constrain research area of exemplar‐based completion algorithms. The full processing chain takes benefit from standard methods that were developed by both hyperspectral imaging and computer vision communities. Results indicate that image completion constrained by spectral presegmentation ensures better consideration of the surrounding materials and simultaneously improves rendering consistency, in particular for completion of flat regions that present no clear gradients and little structure variance. The authors validate their method with a perceptual evaluation based on 20 volunteers. This study shows for the first time the potential of multispectral imaging applied to image completion.