Design and learn distinctive features from pore-scale facial keypoints. Issue 3 (March 2015)

• Record Type: Journal Article
• Authors: Li, Dong; Lam, Kin-Man
• Is Part Of: Pattern recognition. Volume 48:Issue 3(2015:Mar.)
• Page Start: 732
• Page End: 745
• Publication Date: 2015-03
• Subjects: Pore-scale facial feature -- Feature extraction -- Face matching -- Face reconstruction -- Face recognition; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2014.09.026
• Languages: English
• ISSNs: 0031-3203

Abstract

Abstract: Establishing correct correspondences between two faces with different viewpoints has played an important role in 3D face reconstruction and other computer-vision applications. Usually, face images are considered to lack sufficient distinctive features to establish a large number of correspondences on uncalibrated images. In this paper, we investigate pore-scale facial features, which are formed from pores, fine wrinkles, and hair. These features have many characteristics that make them suitable for matching facial images under different variations. Using both biological observation and computer-vision consideration, a new framework is devised for pore-scale facial-feature extraction and matching. The matching difficulty under various skin appearances of different subjects and imaging distortion is also analyzed. For further improving the matching performance and tackling distortions such as varying illuminations and unfocused blurring, a pore-to-pore correspondences dataset is established for training a more distinctive and compact descriptor. Experiments are conducted on a face database containing 105 subjects, and the results prove that the pore-scale features are highly distinctive; face images with a minimum resolution of 600×700 (0.4 mega) pixels contain sufficient details to perform a reliable matching in different poses. Generally, our algorithm can establish between 500 and 2000 correct correspondences on a pair of uncalibrated face images of the same person. Furthermore, the proposed methods can be applied to face recognition, 3D reconstruction, etc. Abstract : Highlights: A new framework for pore-scale feature-extraction and description is proposed. A pore-to-pore correspondences dataset is established. A learning-based pore-scale facial-feature method is proposed. The proposed method can be applied to face recognition, 3D reconstruction, etc.