Learning features for offline handwritten signature verification using deep convolutional neural networks. (October 2017)

• Record Type: Journal Article
• Authors: Hafemann, Luiz G.; Sabourin, Robert; Oliveira, Luiz S.
• Is Part Of: Pattern recognition. Volume 70(2017:Oct.)
• Page Start: 163
• Page End: 176
• Publication Date: 2017-10
• Subjects: Signature verification -- Convolutional Neural Networks -- Feature learning -- Deep learning; Pattern perception -- Periodicals; Perception des structures -- Périodiques; Patroonherkenning; 006.4
• DOI: 10.1016/j.patcog.2017.05.012
• Languages: English
• ISSNs: 0031-3203

Abstract

Highlights: We propose formulations for learning features for Offline Signature Verification. A novel method that uses knowledge of forgeries from a subset of users is proposed. Learned features are used to train classifiers for other users (without forgeries). Experiments on GPDS-960 show a large improvement in state-of-the-art. Results in other 3 datasets show that the features generalize without fine-tuning. Abstract: Verifying the identity of a person using handwritten signatures is challenging in the presence of skilled forgeries, where a forger has access to a person's signature and deliberately attempt to imitate it. In offline (static) signature verification, the dynamic information of the signature writing process is lost, and it is difficult to design good feature extractors that can distinguish genuine signatures and skilled forgeries. This reflects in a relatively poor performance, with verification errors around 7% in the best systems in the literature. To address both the difficulty of obtaining good features, as well as improve system performance, we propose learning the representations from signature images, in a Writer-Independent format, using Convolutional Neural Networks. In particular, we propose a novel formulation of the problem that includes knowledge of skilled forgeries from a subset of users in the feature learning process, that aims to capture visual cues that distinguish genuine signatures and forgeries regardless of the user. Extensive experiments were conducted on four datasets: GPDS, MCYT, CEDAR and Brazilian PUC-PR datasets. On GPDS-160, we obtained a large improvement in state-of-the-art performance, achieving 1.72% Equal Error Rate, compared to 6.97% in the literature. We also verified that the features generalize beyond the GPDS dataset, surpassing the state-of-the-art performance in the other datasets, without requiring the representation to be fine-tuned to each particular dataset.