Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3503161.3548073acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Energy-Based Domain Generalization for Face Anti-Spoofing

Published: 10 October 2022 Publication History

Abstract

With various unforeseeable face presentation attacks (PA) springing up, face anti-spoofing (FAS) urgently needs to generalize to unseen scenarios. Research on generalizable FAS has lately attracted growing attention. Existing methods cast FAS as a vanilla binary classification problem and address it by a standard discriminative classifier p(y|x) under a domain generalization framework. However, discriminative models are unreliable for samples far away from the training distribution. In this paper, we resort to an energy-based model (EBM) to tackle FAS in a generative perspective. Our motivation is to model the joint density p(x,y), which allows to compute not only p(y|x) but also p(x). Due to the intractability of direct modeling, we use EBMs as an alternative to probabilistic estimation. With energy-based training, real faces are encouraged to get low free energy associated with the marginal probability p(x) of real faces, and all samples with high free energy are regarded as fake faces, thus rejecting any kind of PA out of the distribution of real faces. To learn to generalize to unseen domains, we generate diverse and novel populations in feature space under the guidance of energy model. Our model is updated in a meta-learning schema, where the original source samples are utilized for meta-training and the generated ones for meta-testing. We validate our method on four widely used FAS datasets. Comprehensive experimental results demonstrate the effectiveness of our method compared with state-of-the-arts.

Supplementary Material

MP4 File (MM22-fp1345.mp4)
Presentation Video.

References

[1]
Yousef Atoum, Yaojie Liu, Amin Jourabloo, and Xiaoming Liu. 2017. Face antispoofing using patch and depth-based CNNs. In IJCB. IEEE, 319--328.
[2]
Zinelabidine Boulkenafet, Jukka Komulainen, and Abdenour Hadid. 2015. Face anti-spoofing based on color texture analysis. In ICIP. 2636--2640.
[3]
Zinelabidine Boulkenafet, Jukka Komulainen, and Abdenour Hadid. 2016. Face spoofing detection using colour texture analysis. TIFS 11, 8 (2016), 1818--1830.
[4]
Zinelabinde Boulkenafet, Jukka Komulainen, Lei Li, Xiaoyi Feng, and Abdenour Hadid. 2017. OULU-NPU: A mobile face presentation attack database with realworld variations. In 2017 12th IEEE international conference on automatic face & gesture recognition (FG 2017). IEEE, 612--618.
[5]
Zhihong Chen, Taiping Yao, Kekai Sheng, Shouhong Ding, Ying Tai, Jilin Li, Feiyue Huang, and Xinyu Jin. 2021. Generalizable representation learning for mixture domain face anti-spoofing. In AAAI.
[6]
Ivana Chingovska, André Anjos, and Sébastien Marcel. 2012. On the effectiveness of local binary patterns in face anti-spoofing. In BIOSIG. IEEE, 1--7.
[7]
H. Cui, L. Zhu, J. Li, Y. Yang, and L. Nie. 2020. Scalable Deep Hashing for Large- Scale Social Image Retrieval. IEEE Transactions on Image Processing 29 (2020), 1271--1284.
[8]
Xin Dong, Hao Liu, Weiwei Cai, Pengyuan Lv, and Zekuan Yu. 2021. Open Set Face Anti-Spoofing in Unseen Attacks. In ACMMM. 4082--4090.
[9]
Alexey Dosovitskiy and Thomas Brox. 2016. Generating images with perceptual similarity metrics based on deep networks. NIPS 29 (2016).
[10]
Zhekai Du, Jingjing Li, Ke Lu, Lei Zhu, and Zi Huang. 2021. Learning Transferrable and Interpretable Representations for Domain Generalization. In Proceedings of the 29th ACM International Conference on Multimedia. 3340--3349.
[11]
Zhekai Du, Jingjing Li, Hongzu Su, Lei Zhu, and Ke Lu. 2021. Cross-domain gradient discrepancy minimization for unsupervised domain adaptation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 3937--3946.
[12]
Yao Feng, Fan Wu, Xiaohu Shao, Yanfeng Wang, and Xi Zhou. 2018. Joint 3d face reconstruction and dense alignment with position map regression network. In ECCV. 534--551.
[13]
Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-agnostic metalearning for fast adaptation of deep networks. In ICML. PMLR, 1126--1135.
[14]
Tiago de Freitas Pereira, André Anjos, José Mario De Martino, and Sébastien Marcel. 2012. LBP- TOP based countermeasure against face spoofing attacks. In ACCV. 121--132.
[15]
Tiago de Freitas Pereira, Jukka Komulainen, André Anjos, José Mario De Martino, Abdenour Hadid, Matti Pietikäinen, and Sébastien Marcel. 2014. Face liveness detection using dynamic texture. EURASIP Journal on Image and Video Processing 2014, 1 (2014), 1--15.
[16]
Will Grathwohl, Kuan-Chieh Wang, Jörn-Henrik Jacobsen, David Duvenaud, Mohammad Norouzi, and Kevin Swersky. 2019. Your classifier is secretly an energy based model and you should treat it like one. ICLR.
[17]
Seyedkooshan Hashemifard and Mohammad Akbari. 2021. A compact deep learning model for face spoofing detection. arXiv preprint arXiv:2101.04756 (2021).
[18]
Yunpei Jia, Jie Zhang, Shiguang Shan, and Xilin Chen. 2020. Single-side domain generalization for face anti-spoofing. In CVPR. 8484--8493.
[19]
Justin Johnson, Alexandre Alahi, and Li Fei-Fei. 2016. Perceptual losses for real-time style transfer and super-resolution. In ECCV. Springer, 694--711.
[20]
Jukka Komulainen, Abdenour Hadid, and Matti Pietikäinen. 2013. Context based face anti-spoofing. In BTAS. 1--8.
[21]
Huafeng Kuang, Rongrong Ji, Hong Liu, Shengchuan Zhang, Xiaoshuai Sun, Feiyue Huang, and Baochang Zhang. 2019. Multi-modal multi-layer fusion network with average binary center loss for face anti-spoofing. In ACMMM. 48--56.
[22]
Yann LeCun, Sumit Chopra, Raia Hadsell, M Ranzato, and F Huang. 2006. A tutorial on energy-based learning. Predicting structured data 1, 0 (2006).
[23]
Da Li, Yongxin Yang, Yi-Zhe Song, and Timothy M Hospedales. 2017. Deeper, broader and artier domain generalization. In CVPR. 5542--5550.
[24]
Haoliang Li, Sinno Jialin Pan, Shiqi Wang, and Alex C Kot. 2018. Domain generalization with adversarial feature learning. In CVPR. 5400--5409.
[25]
Jingjing Li, Erpeng Chen, Zhengming Ding, Lei Zhu, Ke Lu, and Heng Tao Shen. 2020. Maximum density divergence for domain adaptation. IEEE transactions on pattern analysis and machine intelligence 43, 11 (2020), 3918--3930.
[26]
Jingjing Li, Zhekai Du, Lei Zhu, Zhengming Ding, Ke Lu, and Heng Tao Shen. 2021. Divergence-agnostic unsupervised domain adaptation by adversarial attacks. IEEE Transactions on Pattern Analysis and Machine Intelligence (2021).
[27]
Jingjing Li, Ke Lu, Zi Huang, Lei Zhu, and Heng Tao Shen. 2018. Transfer independently together: A generalized framework for domain adaptation. IEEE transactions on cybernetics 49, 6 (2018), 2144--2155.
[28]
Lei Li, Xiaoyi Feng, Zinelabidine Boulkenafet, Zhaoqiang Xia, Mingming Li, and Abdenour Hadid. 2016. An original face anti-spoofing approach using partial convolutional neural network. In IPTA. IEEE, 1--6.
[29]
Sheng Li, Xun Zhu, Guorui Feng, Xinpeng Zhang, and Zhenxing Qian. 2021. Diffusing the Liveness Cues for Face Anti-spoofing. In ACMMM. 1636--1644.
[30]
Shubao Liu, Ke-Yue Zhang, Taiping Yao, Mingwei Bi, Shouhong Ding, Jilin Li, Feiyue Huang, and Lizhuang Ma. 2021. Adaptive normalized representation learning for generalizable face anti-spoofing. In ACMMM. 1469--1477.
[31]
Weitang Liu, Xiaoyun Wang, John Owens, and Yixuan Li. 2020. Energy-based out-of-distribution detection. NIPS 33, 21464--21475.
[32]
Yaojie Liu, Amin Jourabloo, and Xiaoming Liu. 2018. Learning deep models for face anti-spoofing: Binary or auxiliary supervision. In CVPR. 389--398.
[33]
Xu Lu, Lei Zhu, Zhiyong Cheng, Liqiang Nie, and Huaxiang Zhang. 2019. Online Multi-modal Hashing with Dynamic Query-adaption. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 715--724.
[34]
Jukka Määttä, Abdenour Hadid, and Matti Pietikäinen. 2011. Face spoofing detection from single images using micro-texture analysis. In IJCB. IEEE, 1--7.
[35]
Keyurkumar Patel, Hu Han, and Anil K Jain. 2016. Secure face unlock: Spoof detection on smartphones. TIFS 11, 10 (2016), 2268--2283.
[36]
Bruno Peixoto, Carolina Michelassi, and Anderson Rocha. 2011. Face liveness detection under bad illumination conditions. In ICIP. IEEE, 3557--3560.
[37]
Xingchao Peng, Zijun Huang, Ximeng Sun, and Kate Saenko. 2019. Domain agnostic learning with disentangled representations. In ICML. PMLR, 5102--5112.
[38]
Fengchun Qiao, Long Zhao, and Xi Peng. 2020. Learning to learn single domain generalization. In CVPR. 12556--12565.
[39]
Rui Shao, Xiangyuan Lan, Jiawei Li, and Pong C Yuen. 2019. Multi-adversarial discriminative deep domain generalization for face presentation attack detection. In CVPR. 10023--10031.
[40]
Rui Shao, Xiangyuan Lan, and Pong C Yuen. 2020. Regularized fine-grained meta face anti-spoofing. In AAAI. 11974--11981.
[41]
Lin Sun, Gang Pan, Zhaohui Wu, and Shihong Lao. 2007. Blinking-based live face detection using conditional random fields. In International Conference on Biometrics. Springer, 252--260.
[42]
Xiaoyang Tan, Yi Li, Jun Liu, and Lin Jiang. 2010. Face liveness detection from a single image with sparse low rank bilinear discriminative model. In ECCV. Springer, 504--517.
[43]
Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research 9, 11 (2008).
[44]
Riccardo Volpi, Hongseok Namkoong, Ozan Sener, John C Duchi, Vittorio Murino, and Silvio Savarese. 2018. Generalizing to unseen domains via adversarial data augmentation. NIPS 31 (2018).
[45]
Weitao Wan, Yuanyi Zhong, Tianpeng Li, and Jiansheng Chen. 2018. Rethinking feature distribution for loss functions in image classification. In CVPR. 9117--9126.
[46]
Guoqing Wang, Hu Han, Shiguang Shan, and Xilin Chen. 2020. Cross-domain face presentation attack detection via multi-domain disentangled representation learning. In CVPR. 6678--6687.
[47]
Jingjing Wang, Jingyi Zhang, Ying Bian, Youyi Cai, Chunmao Wang, and Shiliang Pu. 2021. Self-domain adaptation for face anti-spoofing. arXiv preprint arXiv:2102.12129 (2021).
[48]
Liting Wang, Xiaoqing Ding, and Chi Fang. 2009. Face live detection method based on physiological motion analysis. Tsinghua Science & Technology 14, 6 (2009), 685--690.
[49]
Zezheng Wang, Zitong Yu, Chenxu Zhao, Xiangyu Zhu, Yunxiao Qin, Qiusheng Zhou, Feng Zhou, and Zhen Lei. 2020. Deep spatial gradient and temporal depth learning for face anti-spoofing. In CVPR. 5042--5051.
[50]
DiWen, Hu Han, and Anil K Jain. 2015. Face spoof detection with image distortion analysis. TIFS 10, 4 (2015), 746--761.
[51]
Jianwen Xie, Yang Lu, Song-Chun Zhu, and Yingnian Wu. 2016. A theory of generative convnet. In ICML. PMLR, 2635--2644.
[52]
Zhenqi Xu, Shan Li, and Weihong Deng. 2015. Learning temporal features using LSTM-CNN architecture for face anti-spoofing. In ACPR. IEEE, 141--145.
[53]
Jianwei Yang, Zhen Lei, and Stan Z Li. 2014. Learn convolutional neural network for face anti-spoofing. arXiv preprint arXiv:1408.5601 (2014).
[54]
Jianwei Yang, Zhen Lei, Shengcai Liao, and Stan Z Li. 2013. Face liveness detection with component dependent descriptor. In ICB. 1--6.
[55]
Xiao Yang, Wenhan Luo, Linchao Bao, Yuan Gao, Dihong Gong, Shibao Zheng, Zhifeng Li, and Wei Liu. 2019. Face anti-spoofing: Model matters, so does data. In CVPR. 3507--3516.
[56]
Zhiwei Zhang, Junjie Yan, Sifei Liu, Zhen Lei, Dong Yi, and Stan Z Li. 2012. A face antispoofing database with diverse attacks. In ICB. IEEE, 26--31.
[57]
Wenyi Zhao, Rama Chellappa, P Jonathon Phillips, and Azriel Rosenfeld. 2003. Face recognition: A literature survey. CSUR 35, 4 (2003), 399--458.
[58]
Lei Zhu, Xu Lu, Zhiyong Cheng, Jingjing Li, and Huaxiang Zhang. 2020. Deep Collaborative Multi-View Hashing for Large-Scale Image Search. IEEE Transactions on Image Processing 29 (2020), 4643--4655.

Cited By

View all
  • (2024)Adversarial-Enhanced Causal Multi-Task Framework for Debiasing Post-Click Conversion Rate EstimationProceedings of the ACM Web Conference 202410.1145/3589334.3645379(3287-3296)Online publication date: 13-May-2024
  • (2024)Cross-Scenario Unknown-Aware Face Anti-Spoofing With Evidential Semantic Consistency LearningIEEE Transactions on Information Forensics and Security10.1109/TIFS.2024.335623419(3093-3108)Online publication date: 19-Jan-2024
  • (2024)FAMIM: A Novel Frequency-Domain Augmentation Masked Image Model Framework for Domain Generalizable Face Anti-SpoofingICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10448479(4470-4474)Online publication date: 14-Apr-2024
  • Show More Cited By

Index Terms

  1. Energy-Based Domain Generalization for Face Anti-Spoofing

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '22: Proceedings of the 30th ACM International Conference on Multimedia
    October 2022
    7537 pages
    ISBN:9781450392037
    DOI:10.1145/3503161
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 10 October 2022

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. domain generalization
    2. energy-based model
    3. face anti-spoofing

    Qualifiers

    • Research-article

    Funding Sources

    Conference

    MM '22
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 995 of 4,171 submissions, 24%

    Upcoming Conference

    MM '24
    The 32nd ACM International Conference on Multimedia
    October 28 - November 1, 2024
    Melbourne , VIC , Australia

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)78
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 10 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Adversarial-Enhanced Causal Multi-Task Framework for Debiasing Post-Click Conversion Rate EstimationProceedings of the ACM Web Conference 202410.1145/3589334.3645379(3287-3296)Online publication date: 13-May-2024
    • (2024)Cross-Scenario Unknown-Aware Face Anti-Spoofing With Evidential Semantic Consistency LearningIEEE Transactions on Information Forensics and Security10.1109/TIFS.2024.335623419(3093-3108)Online publication date: 19-Jan-2024
    • (2024)FAMIM: A Novel Frequency-Domain Augmentation Masked Image Model Framework for Domain Generalizable Face Anti-SpoofingICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10448479(4470-4474)Online publication date: 14-Apr-2024
    • (2024)A Novel High-Performance Face Anti-Spoofing Detection MethodIEEE Access10.1109/ACCESS.2024.340028512(67379-67391)Online publication date: 2024
    • (2024)Face anti-spoofing with cross-stage relation enhancement and spoof material perceptionNeural Networks10.1016/j.neunet.2024.106275175(106275)Online publication date: Jul-2024
    • (2024)Open-Set Single-Domain Generalization for Robust Face Anti-SpoofingInternational Journal of Computer Vision10.1007/s11263-024-02129-0Online publication date: 3-Jun-2024
    • (2024)ApplicationsUnsupervised Domain Adaptation10.1007/978-981-97-1025-6_8(213-218)Online publication date: 16-Feb-2024
    • (2023)Instance-Aware Domain Generalization for Face Anti-Spoofing2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01959(20453-20463)Online publication date: Jun-2023

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media