Super-resolution for biometrics: A comprehensive survey. (June 2018)

• Record Type: Journal Article
• Authors: Nguyen, Kien; Fookes, Clinton; Sridharan, Sridha; Tistarelli, Massimo; Nixon, Mark
• Is Part Of: Pattern recognition. Volume 78(2018:Jun.)
• Page Start: 23
• Page End: 42
• Publication Date: 2018-06
• Subjects: Super-resolution -- Biometrics -- Face recognition -- Iris recognition -- Gait recognition -- Fingerprint recognition -- Non-ideal biometrics -- Human identification at a distance -- Deep learning; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2018.01.002
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: Discuss the significance of super-resolution in the context of biometrics and how it is different from the general super-resolution. Present a background knowledge in general super-resolution approaches. Provide a comprehensive review of existing super-resolution approaches for biometric modalities, including face (2D and 3D), iris, gait and latent prints (fingerprint and palmprint) and other emerging modalities. Highlight and discuss current challenges and recommendations for future research in Super-resolution for biometrics. Abstract: The lack of resolution of imaging systems has critically adverse impacts on the recognition and performance of biometric systems, especially in the case of long range biometrics and surveillance such as face recognition at a distance, iris recognition and gait recognition. Super-resolution, as one of the core innovations in computer vision, has been an attractive but challenging solution to address this problem in both general imaging systems and biometric systems. However, a fundamental difference exists between conventional super-resolution motivations and those required for biometrics. The former aims to enhance the visual clarity of the scene while the latter, more significantly, aims to improve the recognition accuracy of classifiers by exploiting specific characteristics of the observed biometric traits. This paper comprehensively surveys the state-of-the-art super-resolution approaches proposed for four major biometric modalities: face (2D+3D), iris, fingerprint and gait. We approach the super-resolution problem in biometrics from several different perspectives, including from the spatial and frequency domains, single and multiple input images, learning-based and reconstruction-based approaches. Especially, we highlight two special categories: feature-domain super-resolution which performs super-resolution directly on the feature space to purposely improve the recognition performance, and deep-learning super-resolution which discusses the most recent advances in deep learning for the super-resolution task. Finally, we discuss the current and open research challenges and provide recommendations into the future for the improved use of super-resolution with biometrics.