Dataset bias exposed in face verification. Issue 4 (20th February 2019)

• Record Type: Journal Article
• Authors: López‐López, Eric; Pardo, Xosé M.; Regueiro, Carlos V.; Iglesias, Roberto; Casado, Fernando E.
• Is Part Of: IET biometrics. Volume 8:Issue 4(2019)
• Page Start: 249
• Page End: 258
• Publication Date: 2019-02-20
• Subjects: face recognition -- learning (artificial intelligence); mobile devices -- facial images -- public available datasets -- face verification -- facial verification methods -- target domain -- source domain; Biometric identification -- Periodicals; 570.15195
• DOI: 10.1049/iet-bmt.2018.5224
• Languages: English
• ISSNs: 2047-4938

Abstract

Abstract : Most facial verification methods assume that training and testing sets contain independent and identically distributed samples, although, in many real applications, this assumption does not hold. Whenever gathering a representative dataset in the target domain is unfeasible, it is necessary to choose one of the already available (source domain) datasets. Here, a study was performed over the differences among six public datasets, and how this impacts on the performance of the learned methods. In the considered scenario of mobile devices, the individual of interest is enrolled using a few facial images taken in the operational domain, while training impostors are drawn from one of the public available datasets. This work tried to shed light on the inherent differences among the datasets, and potential harms that should be considered when they are combined for training and testing. Results indicate that a drop in performance occurs whenever training and testing are done on different datasets compared to the case of using the same dataset in both phases. However, the decay strongly depends on the kind of features. Besides, the representation of samples in the feature space reveals insights into what extent bias is an endogenous or an exogenous factor.