Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3436369.3436490acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiccprConference Proceedingsconference-collections
research-article

Low-Resolution Face Recognition Method Combining Super-Resolution and Improved DCR Model

Published: 11 January 2021 Publication History

Abstract

Low-resolution face recognition is a challenging problem in the face recognition algorithm. Most face recognition algorithms have a significant reduction in recognition accuracy when facing low-resolution faces. In this paper, we propose a DCR(Deep Coupled ResNet) model based on super-resolution reconstruction, named SR-DCR model, to tackle this challenging. Firstly, we designed a super-resolution face reconstruction model based on the facial feature. The "perceptual loss + classification loss" is used as the loss function of the reconstructed network. And the facial feature is used to constrain the reconstruction process to make the reconstructed face more favorable for recognition. Then a series of improvements and adjustments were made to the DCR model. Improved the network structure of the main network, and its cross-layer connection method was changed to a close connection, which further promoted feature propagation in the network and enhanced feature reusability; The loss function of the main network is improved, and the improved "triplet loss" is used as a loss function to directly optimize the facial feature between high resolution and low-resolution, further enhancing the high and low resolution. The aggregation between facial features; at the same time, the training method of the DCR model is adjusted, and the steps of joint training between the main network and branch network are added to further optimize DCR network parameters. Finally, the super-resolution reconstruction and the improved DCR model are combined to recognize low-resolution faces. The performance of the proposed algorithm is compared with that of other advanced methods on LFW and SCFace datasets. Experimental results show that the algorithm improves the recognition rate by 3.5% based on DCR. Effectively improve the accuracy of face recognition at low resolution.

References

[1]
Chang, H.; Yeung, D.-Y.; Xiong, Y. Super-resolution through neighbor embedding. In Proceedings of Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004.; pp. I-I.
[2]
Ma, Y.; Lao, S.; Takikawa, E.; Kawade, M. Discriminant analysis in correlation similarity measure space. In Proceedings of Proceedings of the 24th international conference on Machine learning; pp. 577--584.
[3]
Yang, J.; Wang, Z.; Lin, Z.; Cohen, S.; Huang, T. Coupled dictionary training for image super-resolution. IEEE transactions on image processing 2012, 21, 3467--3478.
[4]
Cheng, H.; Liu, Z.; Yang, L.; Chen, X. Sparse representation and learning in visual recognition: Theory and applications. Signal Processing 2013, 93, 1408--1425.
[5]
Jiang, J.; Hu, R.; Liang, C.; Han, Z.; Zhang, C. Face image super-resolution through locality-induced support regression. Signal Processing 2014, 103, 168--183.
[6]
Villena, S.; Vega, M.; Babacan, S.D.; Molina, R.; Katsaggelos, A.K. Bayesian combination of sparse and non-sparse priors in image super resolution. Digital Signal Processing 2013, 23, 530--541.
[7]
Dong, C.; Loy, C.C.; He, K.; Tang, X. Learning a deep convolutional network for image super-resolution. In Proceedings of European conference on computer vision; pp. 184--199.
[8]
Yu, X.; Fernando, B.; Hartley, R.; Porikli, F. Super-resolving very low-resolution face images with supplementary attributes. In Proceedings of Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; pp. 908--917.
[9]
Li, P.; Prieto, L.; Mery, D.; Flynn, P.J. On Low-Resolution Face Recognition in the Wild: Comparisons and New Techniques. IEEE Transactions on Information Forensics and Security 2019, 14, 2000--2012.
[10]
Heinsohn, D.; Villalobos, E.; Prieto, L.; Mery, D. Face recognition in low-quality images using adaptive sparse representations. Image and Vision Computing 2019, 85, 46--58.
[11]
He, R.; Cao, J.; Song, L.; Sun, Z.; Tan, T. Cross-spectral face completion for nir-vis heterogeneous face recognition. arXiv preprint arXiv:1902.03565 2019.
[12]
Huang, H.; He, H.; Fan, X.; Zhang, J. Super-resolution of human face image using canonical correlation analysis. Pattern Recognition 2010, 43, 2532--2543.
[13]
Sun, T.; Chen, S.; Yang, J.; Shi, P. A novel method of combined feature extraction for recognition. In Proceedings of 2008 Eighth IEEE International Conference on Data Mining; pp. 1043--1048.
[14]
Sun, T.; Chen, S. Locality preserving CCA with applications to data visualization and pose estimation. Image and Vision Computing 2007, 25, 531--543.
[15]
Jiang, J.; Hu, R.; Wang, Z.; Cai, Z. CDMMA: Coupled discriminant multi-manifold analysis for matching low-resolution face images. Signal Processingthe 2016, 124, 162--172.
[16]
Xing, X.; Wang, K. Couple manifold discriminant analysis with bipartite graph embedding for low-resolution face recognition. Signal Processing 2016, 125, 329--335.
[17]
Mudunuri, S.P.; Biswas, S. Low resolution face recognition across variations in pose and illumination. IEEE transactions on pattern analysis and machine intelligence 2015, 38, 1034--1040.
[18]
Lu, Z.; Jiang, X.; Kot, A. Deep coupled resnet for low-resolution face recognition. IEEE Signal Processing Letters 2018, 25, 526--530.
[19]
Ledig, C.; Theis, L.; Huszár, F.; Caballero, J.; Cunningham, A.; Acosta, A.; Aitken, A.; Tejani, A.; Totz, J.; Wang, Z. Photo-realistic single image super-resolution using a generative adversarial network. In Proceedings of Proceedings of the IEEE conference on computer vision and pattern recognition; pp. 4681--4690.
[20]
Huang, G.; Liu, Z.; Van Der Maaten, L.; Weinberger, K.Q. Densely connected convolutional networks. In Proceedings of Proceedings of the IEEE conference on computer vision and pattern recognition; pp. 4700--4708.
[21]
Yi, D.; Lei, Z.; Liao, S.; Li, S.Z. Learning face representation from scratch. arXiv preprint arXiv:1411.7923 2014.
[22]
Huang, G.B.; Mattar, M.; Berg, T.; Learned-Miller, E. Labeled faces in the wild: A database forstudying face recognition in unconstrained environments.
[23]
Grgic, M.; Delac, K.; Grgic, S. SCface-surveillance cameras face database. Multimedia tools and applications 2011, 51, 863--879.
[24]
Simonyan, K.; Zisserman, A. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 2014.
[25]
Szegedy, C.; Ioffe, S.; Vanhoucke, V.; Alemi, A.A. Inception-v4, inception-resnet and the impact of residual connections on learning. In Proceedings of Thirty-First AAAI Conference on Artificial Intelligence.
[26]
He, K.; Zhang, X.; Ren, S.; Sun, J. Deep residual learning for image recognition. In Proceedings of Proceedings of the IEEE conference on computer vision and pattern recognition; pp. 770--778.
[27]
Szegedy, C.; Ioffe, S.; Vanhoucke, V.; Alemi, A.A. Inception-v4, inception-resnet and the impact of residual connections on learning. In Proceedings of Thirty-First AAAI Conference on Artificial Intelligence.
[28]
Schroff, F.; Kalenichenko, D.; Philbin, J. Facenet: A unified embedding for face recognition and clustering. In Proceedings of Proceedings of the IEEE conference on computer vision and pattern recognition; pp. 815--823.
[29]
Zou, W.W.; Yuen, P.C. Very low resolution face recognition problem. IEEE Transactions on image processing 2011, 21, 327--340.
[30]
Li, B.; Chang, H.; Shan, S.; Chen, X. Low-resolution face recognition via coupled locality preserving mappings. IEEE Signal processing letters 2009, 17, 20--23.
[31]
Huang, H.; He, H. Super-resolution method for face recognition using nonlinear mappings on coherent features. IEEE Transactions on Neural Networks 2010, 22, 121--130.
[32]
Biswas, S.; Bowyer, K.W.; Flynn, P.J. Multidimensional scaling for matching low-resolution face images. IEEE transactions on pattern analysis and machine intelligence 2011, 34, 2019--2030.
[33]
Yang, F.; Yang, W.; Gao, R.; Liao, Q. Discriminative multidimensional scaling for low-resolution face recognition. IEEE Signal Processing Letters 2017, 25, 388--392.

Cited By

View all
  • (2022)Towards Understanding Cross Resolution Feature Matching for Surveillance Face RecognitionProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548402(6706-6716)Online publication date: 10-Oct-2022

Index Terms

  1. Low-Resolution Face Recognition Method Combining Super-Resolution and Improved DCR Model

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICCPR '20: Proceedings of the 2020 9th International Conference on Computing and Pattern Recognition
    October 2020
    552 pages
    ISBN:9781450387835
    DOI:10.1145/3436369
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    • Beijing University of Technology

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 11 January 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Convolutional neural network
    2. DCR model
    3. Low-resolution face recognition
    4. Super-resolution reconstruction

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICCPR 2020

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)16
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 15 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Towards Understanding Cross Resolution Feature Matching for Surveillance Face RecognitionProceedings of the 30th ACM International Conference on Multimedia10.1145/3503161.3548402(6706-6716)Online publication date: 10-Oct-2022

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media