Abstract
With the advancement of Generative Adversarial Networks (GANs), generated face images by models like AttGAN have become more realistic, posing challenges in detecting fake faces from real ones. In this paper, we explore the transferability of pretrained Convolutional Neural Networks (CNNs) for the task of detecting fake face images generated by the AttGAN model. In this study, we investigate the effectiveness of pretrained ResNet-50 and VGG-19 models trained on ImageNet and VGG face dataset in extracting useful features to be used for classifying whether a given face image is genuine or fake face images. In particular, the performance of pretrained models is evaluated in terms of accuracy, precision and recall. Our experimental results demonstrate the potential of pretrained ResNet-50 model with ImageNet weights for detecting fake face images generated by AttGAN and highlight their transferability for this challenging task. That is, a unified model based on the pretrained ResNet-50 model with ImageNet weights designed to detect fake face images with various attribute modifications achieved an average precision of 96.9% and a recall rate of 97.2%. In comparison, the model developed specifically for detecting fake face images with a single attribute modification achieved a precision of 96.7% and a recall rate of 96.9% on LFW dataset. The study demonstrates that employing a unified model for attribute detection in facial analysis tasks yields promising results, showcasing its potential as a simpler and more efficient alternative to developing separate models for individual attributes.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data Availability
The datasets generated during and/or analysed during the current study are available at http://vis-www.cs.umass.edu/lfw/ for LFW dataset and https://mmlab.ie.cuhk.edu.hk/projects/CelebA.html for CelebA dataset
References
Agarap AF (2018) Deep learning using rectified linear units (relu). arXiv:1803.08375
Cao Q, Shen L, Xie W, Parkhi OM, Zisserman A (2018) Vggface2: a dataset for recognising faces across pose and age. In: 2018 13th IEEE international conference on automatic face & gesture recognition (FG 2018). IEEE, pp 67–74
Creswell A, White T, Dumoulin V, Arulkumaran K, Sengupta B, Bharath AA (2018) Generative adversarial networks: an overview. IEEE Signal Proc Mag 35(1):53–65
Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition. IEEE, pp 248–255
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2020) Generative adversarial networks. Commun of the ACM 63(11):139–144
Guarnera L, Giudice O, Battiato S (2020) Deepfake detection by analyzing convolutional traces. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pp 666–667
He Z, Zuo W, Kan M, Shan S, Chen X (2019) Attgan: facial attribute editing by only changing what you want. IEEE Trans Image Process 28(11):5464–5478
Huang GB, Mattar M, Berg T, Learned-Miller E (2008) Labeled faces in the wild: a database forstudying face recognition in unconstrained environments. In: Workshop on faces in‘Real-Life’Images: detection, alignment, and recognition
Learned-Miller E, Huang GB, RoyChowdhury A, Li H, Hua G (2016) Labeled faces in the wild: a survey. Advances in face detection and facial image analysis, pp 189–248
Liu Z, Luo P, Wang X, Tang X (2018) Large-scale celebfaces attributes (celeba) dataset. Retrieved August 15(2018):11
Mo H, Chen B, Luo W (2018) Fake faces identification via convolutional neural network. In: Proceedings of the 6th ACM workshop on information hiding and multimedia security, pp 43–47
Mridha MF, Keya AJ, Hamid MA, Monowar MM, Rahman MS (2021) A comprehensive review on fake news detection with deep learning. IEEE Access 9:156151–156170
Murtagh F (1991) Multilayer perceptrons for classification and regression. Neurocomputing 2(5–6):183–197
Pasquini C, Laiti F, Lobba D, Ambrosi G, Boato G, De Natale F (2023) Identifying synthetic faces through gan inversion and biometric traits analysis. Appl Sci 13(2):816
Patel Y, Tanwar S, Bhattacharya P, Gupta R, Alsuwian T, Davidson IE, Mazibuko TF (2023) An improved dense cnn architecture for deepfake image detection. IEEE Access 11:22081–22095
Peng H, Li J, Song Y, Liu Y (2017) Incrementally learning the hierarchical softmax function for neural language models. In: Proceedings of the AAAI conference on artificial intelligence, vol 31
Radford A, Metz L, Chintala S (2015) Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv:1511.06434
Ranjan R, Sankaranarayanan S, Castillo CD, Chellappa R (2017) An all-in-one convolutional neural network for face analysis. In: 2017 12th IEEE international conference on automatic face & gesture recognition (FG 2017), IEEE, pp 17–24
Raza A, Munir K, Almutairi M (2022) A novel deep learning approach for deepfake image detection. Appl Sci 12(19):9820
Tang Z, Yang J, Pei Z, Song X, Ge B (2019) Multi-process training gan for identity-preserving face synthesis. IEEE Access 7:97641–97652
Wang X, Guo H, Hu S, Chang MC, Lyu S (2022) Gan-generated faces detection: a survey and new perspectives. arXiv:2202.07145
Yu Y, Ni R, Li W, Zhao Y (2022) Detection of ai-manipulated fake faces via mining generalized features. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 18(4):1–23
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Aieprasert, T., Mahdlang, Y., Pansiri, C. et al. Transferability of CNN models for GAN-generated face detection. Multimed Tools Appl 83, 79815–79831 (2024). https://doi.org/10.1007/s11042-024-18664-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-024-18664-4