Abstract
Face recognition is a prevalent identity verification method, but it requires a liveness detection system to guard against face fraud from printed images and mobile phone photographs. It is challenging to guarantee low complexity and high accuracy of the face anti-spoofing model applied on the Android development board at the same time in existing research. On the Android development board, we construct a liveness detection system that is resistant to attacks from printed images and photographs of electronic devices such as tablets. In conjunction with the actual circumstance, we create a lightweight liveness detection algorithm based on near-infrared images. We utilize MTCNN to clip the near-infrared images in order to preserve the facial portions and reduce the calculated cost. After applying Gamma correction to weaken the impact of illumination on the faces, the facial images are subsequently incorporated into the enhanced ShuffleNet V2 model based on the MBConv and squeeze-excitation (SE) modules for secondary classification. We evaluate the performance of the enhanced model on the CBSR NIR Face Dataset, CASIA NIR-VIS 2.0 Face Database and Oulu-CASIA, achieving 98.50%, 99.87% and 100% accuracy, which is superior to the performance of the original ShuffleNet V2 model and state-of-the-art methods. Our model’s FLOPs and Params are 0.28 G and 2.17 M, respectively. Meanwhile, the liveness detection system based on Android has an exceptionally high level of security performance
Similar content being viewed by others
References
Zhang, Z., Yan, J., Liu, S., Lei, Z., Yi, D., Li, S.: A face antispoofing database with diverse attacks. Paper presented at the 2012 5th IAPR International Conference on Biometrics, New Delhi, India, 29 March–01 April 2012 (2012)
Zhang, Y., Yin, Z., Yin, G., Yan, J., Shao, J., Liu, Z.: Celeba-spoof: large-scale face anti-spoofing dataset with rich annotations. Paper presented at the 16th European Conference on Computer Vision, Glasgow, UK, 23–28 August 2020 (2020)
Wu, X., Zhou, J., Liu, J., Ni, F., Fan, H.: Single-shot face antispoofing for dual pixel camera. IEEE Trans. Inf. Forensics Secur. 16, 1440–1451 (2021)
Boulkenafet, Z., Komulainen, J., Hadid, A.: Face anti-spoofing based on color texture analysis. Paper presented at the IEEE International Conference on Image Processing, Quebec City, Canada, 27–30 September 2015 (2015)
Boulkenafet, Z., Komulainen, J., Hadid, A.: Face antispoofing using speeded-up robust features and fisher vector encoding. IEEE Signal Process. Lett. 24(2), 141–145 (2017)
Xu, Y., Wu, L., Liu, Y., Wang, Z.: Embedding fast temporal information model to improve face anti-spoofing. Paper presented at the 15th Chinese Conference on Biometric Recognition, Shanghai, China, 10–12 September 2021 (2021)
Ma, N., Zhang, X., Zheng, H., Sun, J.: ShuffleNet V2: practical guidelines for efficient CNN architecture design. Paper presented at the 15th European Conference on Computer Vision, Munich, Germany, 08–14 September 2018 (2018)
Tan, M., Le, Q.V.: EfficientNet: rethinking model scaling for convolutional neural networks. Paper presented at the 36th International Conference on Machine Learning, Long Beach, CA, 09–15 June 2019 (2019)
Woo, S., Park, J., Lee, J.Y., Kweon, I.S.: Cbam: Convolutional block attention module. Paper presented at the 15th European Conference on Computer Vision, Munich, Germany, 08–14 September 2018 (2018)
Zhang, K., Zhang, Z., Li, Z., Qiao, Y.: Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Process. Lett. 23(10), 1499–1503 (2016)
Wen, D., Han, H., Jain, A.: Face spoof detection with image distortion analysis. IEEE Trans. Inf. Forensics Secur. 10(4), 746–761 (2015)
Komulainen, J., Hadid, A., Pietikäinen, M.: Context based face anti-spoofing. Paper presented at the IEEE 6th International Conference on Biometrics - Theory, Applications and Systems, Washington, DC, 29 Sept–02 Oct 2013 (2013)
Peixoto, B., Michelassi, C., Rocha, A.: Face liveness detection under bad illumination conditions. Paper presented at the 18th IEEE International Conference on Image Processing, Brussels, Belgium, 11–14 Sept 2011 (2011)
Liu, W., Wei, X., Lei, T., Wang, X., Meng, H., Nandi, A.K.: Data-fusion-based two-stage cascade framework for multimodality face anti-spoofing. IEEE Trans. Cognitive Develop. Syst. 14(2), 672–683 (2022)
Wu, H., Zeng, D., Hu, Y., Shi, H., Mei, T.: Dual spoof disentanglement generation for face anti-spoofing with depth uncertainty learning. IEEE Trans. Circuits Syst. Video Technol. 32(7), 4626–4638 (2022)
Qin, Y., Yu, Z., Yan, L., Wang, Z., Zhao, C., Lei, Z.: Meta-teacher for face anti-spoofing. IEEE Trans. Pattern Anal. Mach. Intell. 44(10), 6311–6326 (2022)
Wang, W., Wen, F., Zheng, H., Ying, R., Liu, P.: Conv-mlp: a convolution and mlp mixed model for multimodal face anti-spoofing. IEEE Trans. Inf. Forensics Secur. 17, 2284–2297 (2022)
Yan, W., Zeng, Y., Hu, H.: Domain adversarial disentanglement network with cross-domain synthesis for generalized face anti-spoofing. IEEE Trans. Circuits Syst. Video Technol. 32(10), 7033–7046 (2022)
Liu, Y., Liu, X.: Spoof trace disentanglement for generic face anti-spoofing. IEEE Trans, Pattern Analys Machine Intell (2022)
Lin, J.D., Lin, H.H., Dy, J., Chen, J.C., Tanveer, M., Razzak, I., Hua, K.L.: Lightweight face anti-spoofing network for telehealth applications. IEEE J. Biomed. Health Inform. 26(5), 1987–1996 (2021)
He, D., He, X., Yuan, R., Li, Y., Shen, C.: Lightweight network-based multi-modal feature fusion for face anti-spoofing. Vis. Comput., 1–13 (2022)
Hu, J., Shen, L., Albanie, S., Sun, G., Wu, E.: Squeeze-and-excitation networks. IEEE Trans. Pattern Anal. Mach. Intell. 42(8), 2011–2023 (2020)
Li, S., Chu, R., Liao, S., Zhang, L.: Illumination invariant face recognition using near-infrared images. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 627–639 (2007)
Li, S., Yi, D., Lei, Z., Liao, S.: The CASIA NIR-VIS 2.0 face database. Paper presented at the 26th IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, 23–28 June 2013 (2013)
Zhao, G., Huang, X., Taini, M., Li, S.Z., PietikäInen, M.: Facial expression recognition from near-infrared videos. Image Vis. Comput. 29(9), 607–619 (2011)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. Comput, Sci (2014)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. Paper presented at the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 27–30 June 2016 (2016)
Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.A.: Inception-v4, Inception-ResNet and the impact of residual connections on learning. Paper presented at the 31st AAAI Conference on Artificial Intelligence, San Francisco, CA, 04–09 Feb 2017 (2017)
Funding
This work was supported by Science and Technology Planning Project of Guangdong Province under the grant 2018B010108001 and Key-Area Research and Development Program of Foshan City under the grant 2020001006812 and GuangDong Basic and Applied Basic Research Foundation under Grant 2022A1515110119.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Zhang, Y., Xie, W. & Yu, X. Design and implementation of liveness detection system based on improved shufflenet V2. SIViP 17, 3035–3043 (2023). https://doi.org/10.1007/s11760-023-02524-z
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-023-02524-z