Energy-based domain generalization for face anti-spoofing

Z Du, J Li, L Zuo, L Zhu, K Lu - Proceedings of the 30th ACM international …, 2022 - dl.acm.org
Z Du, J Li, L Zuo, L Zhu, K Lu
Proceedings of the 30th ACM international conference on multimedia, 2022dl.acm.org
With various unforeseeable face presentation attacks (PA) springing up, face anti-spoofing
(FAS) urgently needs to generalize to unseen scenarios. Research on generalizable FAS
has lately attracted growing attention. Existing methods cast FAS as a vanilla binary
classification problem and address it by a standard discriminative classifier p (y| x) under a
domain generalization framework. However, discriminative models are unreliable for
samples far away from the training distribution. In this paper, we resort to an energy-based …
With various unforeseeable face presentation attacks (PA) springing up, face anti-spoofing (FAS) urgently needs to generalize to unseen scenarios. Research on generalizable FAS has lately attracted growing attention. Existing methods cast FAS as a vanilla binary classification problem and address it by a standard discriminative classifier p(y|x) under a domain generalization framework. However, discriminative models are unreliable for samples far away from the training distribution. In this paper, we resort to an energy-based model (EBM) to tackle FAS in a generative perspective. Our motivation is to model the joint density p(x,y), which allows to compute not only p(y|x) but also p(x). Due to the intractability of direct modeling, we use EBMs as an alternative to probabilistic estimation. With energy-based training, real faces are encouraged to get low free energy associated with the marginal probability p(x) of real faces, and all samples with high free energy are regarded as fake faces, thus rejecting any kind of PA out of the distribution of real faces. To learn to generalize to unseen domains, we generate diverse and novel populations in feature space under the guidance of energy model. Our model is updated in a meta-learning schema, where the original source samples are utilized for meta-training and the generated ones for meta-testing. We validate our method on four widely used FAS datasets. Comprehensive experimental results demonstrate the effectiveness of our method compared with state-of-the-arts.
ACM Digital Library