Fusion loss and inter-class data augmentation for deep finger vein feature learning. (1st June 2021)

• Record Type: Journal Article
• Authors: Ou, Wei-Feng; Po, Lai-Man; Zhou, Chang; Rehman, Yasar Abbas Ur; Xian, Peng-Fei; Zhang, Yu-Jia
• Is Part Of: Expert systems with applications. Volume 171(2021)
• Publication Date: 2021-06-01
• Subjects: Finger vein recognition -- Deep learning -- Fusion loss -- Data augmentation -- Open-set; Expert systems (Computer science) -- Periodicals; Systèmes experts (Informatique) -- Périodiques; Electronic journals; 006.33
• DOI: 10.1016/j.eswa.2021.114584
• Languages: English
• ISSNs: 0957-4174

Abstract

Highlights: Classification loss and metric learning loss have different discrimination ability. Fusion loss improves the generalization of learned features. Inter-class data augmentation enhances diversity with new finger vein classes. Intra-class and inter-class data augmentation resolve data shortage problem. Real-time verification system shows high efficiency and reliability. Abstract: Finger vein recognition (FVR) based on deep learning (DL) has gained rising attention in recent years. However, the performance of FVR is limited by the insufficient amount of finger vein training data and the weak generalization of learned features. To address these limitations and improve the performance, we propose a simple framework by jointly considering intensive data augmentation, loss function design and network architecture selection. Firstly, we propose a simple inter-class data augmentation technique that can double the number of finger vein training classes with new vein patterns via vertical flipping. Then, we combine it with conventional intra-class data augmentation methods to achieve highly diversified expansion, thereby effectively resolving the data shortage problem. In order to enhance the discrimination of deep features, we design a fusion loss by incorporating the classification loss and the metric learning loss. We find that the fusion of these two penalty signals will lead to a good trade-off between the intra-class similarity and inter-class separability, thereby greatly improving the generalization ability of learned features. We also investigate various network architectures for FVR application in terms of performances and model complexities. To examine the reliability and efficiency of our proposed framework, we implement a real-time FVR system to perform end-to-end verification in a near-realworld working condition. In challenging open-set evaluation protocol, extensive experiments conducted on three public finger vein databases and an in-house database confirm the effectiveness of the proposed method.