Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3441233.3441237acmotherconferencesArticle/Chapter ViewAbstractPublication PagesssipConference Proceedingsconference-collections
research-article

Multi-Resolution Face Recognition with Drones

Published: 06 March 2021 Publication History

Abstract

Smart cameras have recently seen a large diffusion and represent a low-cost solution for improving public security in many scenarios. Moreover, they are light enough to be lifted by a drone. Face recognition enabled by drones equipped with smart cameras has already been reported in the literature. However, the use of the drone generally imposes tighter constraints than other facial recognition scenarios. First, weather conditions, such as the presence of wind, pose a severe limit on image stability. Moreover, the distance the drones fly is typically much high than fixed ground cameras, which inevitably translates into a degraded resolution of the face images. Furthermore, the drones’ operational altitudes usually require the use of optical zoom, thus amplifying the harmful effects of their movements. For all these reasons, in drone scenarios, image degradation strongly affects the behavior of face detection and recognition systems. In this work, we studied the performance of deep neural networks for face re-identification specifically designed for low-quality images and applied them to a drone scenario using a publicly available dataset known as DroneSURF.

References

[1]
[n.d.]. dlib Histogram of Oriented Gradients (HOG) Face Detector. http://dlib.net/face_detector.py.html. [Online; accessed 05-June-2020].
[2]
2017. OpenCV-DNN Face Detector - SSD framework with ResNet-10 model. https://github.com/opencv/opencv/blob/3.4.0/samples/dnn/resnet_ssd_face_python.py. [Online; accessed 05-June-2020].
[3]
Giuseppe Amato, Fabio Carrara, Fabrizio Falchi, Claudio Gennaro, and Claudio Vairo. 2018. Facial-based Intrusion Detection System with Deep Learning in Embedded Devices. In 1st International Conference on Sensors, Signal and Image Processing (SSIP). ACM, 64–68.
[4]
Giuseppe Amato, Fabrizio Falchi, Claudio Gennaro, and Claudio Vairo. 2018. A Comparison of Face Verification with Facial Landmarks and Deep Features. In 10th International Conference on Advances in Multimedia (MMEDIA). 1–6.
[5]
Giuseppe Amato, Claudio Gennaro, Fabio Valerio Massoli, Nikoalos Passalis, Anastasios Tefas, Alessandro Trvillini, and Claudio Vairo. 2019. Face Verification and Recognition for Digital Forensics and Information Security. In IEEE 7th International Symposium on Digital Forensic and Security (ISDFS). IEEE, 1–6.
[6]
M. Barekatain, M. Martí, H.-F. Shih, S. Murray, K. Nakayama, Y. Matsuo, and H. Prendinger. 2017. Okutama-action: An aerial view video dataset for concurrent human action detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 28–35.
[7]
Q. Cao, L. Shen, W. Xie, O. M. Parkhi, and A. Zisserman. 2018. VGGFace2: A dataset for recognising faces across pose and age. In International Conference on Automatic Face and Gesture Recognition.
[8]
Erina Ferro, Claudio Gennaro, Alessandro Nordio, Fabio Paonessa, Claudio Vairo, Giuseppe Virone, Arturo Argentieri, Andrea Berton, and Andrea Bragagnini. 2020. 5G-Enabled Security Scenarios for UnmannedAircraft: Experimentation in Urban Environment. Drones 4, 2 (2020), 1–13.
[9]
Yandong Guo, Lei Zhang, Yuxiao Hu, Xiaodong He, and Jianfeng Gao. 2016. Ms-celeb-1m: A dataset and benchmark for large-scale face recognition. In European conference on computer vision. Springer, 87–102.
[10]
K. He, X. Zhang, S. Ren, and J. Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770–778.
[11]
Hwai-Jung Hsu and Kuan-Ta Chen. 2015. Face recognition on drones: Issues and limitations. In Proceedings of the First Workshop on Micro Aerial Vehicle Networks, Systems, and Applications for Civilian Use. 39–44.
[12]
Hwai-Jung Hsu and Kuan-Ta Chen. 2017. DroneFace: an open dataset for drone research. In Proceedings of 8th ACM on Multimedia Systems Conference. 187–192.
[13]
J. Hu, L. Shen, and G. Sun. 2017. Squeeze-and-excitation networks. arXiv:1709.01507 (2017).
[14]
Peiyun Hu and Deva Ramanan. 2017. Finding tiny faces. In Proceedings of the IEEE conference on computer vision and pattern recognition. 951–959.
[15]
Isha Kalra, Maneet Singh, Shruti Nagpal, Richa Singh, Mayank Vatsa, and PB Sujit. 2019. Dronesurf: Benchmark dataset for drone-based face recognition. In 2019 14th IEEE Intl. Conference on Automatic Face & Gesture Recognition. IEEE, 1–7.
[16]
Hanna Kavalionak, Claudio Gennaro, Giuseppe Amato, Claudio Vairo, Costantino Perciante, Carlo Meghini, and Fabrizio Falchi. 2019. Distributed Video Surveillance Using Smart Cameras. Journal of Grid Computing 17, 1 (2019), 59–77.
[17]
Fabio Valerio Massoli, Giuseppe Amato, and Fabrizio Falchi. 2020. Cross-resolution learning for Face Recognition. Image and Vision Computing(2020).
[18]
Fabio Valerio Massoli, Giuseppe Amato, Fabrizio Falchi, Claudio Gennaro, and Claudio Vairo. 2019. Improving Multi-scale Face Recognition Using VGGFace2. In International Conference on Image Analysis and Processing. Springer, 21–29.
[19]
Naser Hossein Motlagh, Miloud Bagaa, and Tarik Taleb. 2017. UAV-based IoT platform: A crowd surveillance use case. IEEE Communications Magazine 55, 2 (2017), 128–134.
[20]
Sarath Raj NS, Jerrin Thadathil Varghese, and Feni Pandya. 2019. Unmanned Aerial Vehicle for Human Tracking using Face Recognition System. In 2019 Advances in Science and Engineering Technology Intl Conferences (ASET). IEEE, 1–5.
[21]
Asanka G Perera, Yee Wei Law, and Javaan Chahl. 2019. Drone-Action: An Outdoor Recorded Drone Video Dataset for Action Recognition. Drones 3, 4 (2019), 82.
[22]
Paul Viola and Michael J Jones. 2004. Robust real-time face detection. International journal of computer vision 57, 2 (2004), 137–154.
[23]
Cameron Whitelam, Emma Taborsky, Austin Blanton, Brianna Maze, Jocelyn Adams, Tim Miller, Nathan Kalka, Anil K. Jain, James A. Duncan, Kristen Allen, Jordan Cheney, and Patrick Grother. 2017. IARPA Janus Benchmark-B Face Dataset. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops.
[24]
Kaipeng Zhang, Zhanpeng Zhang, Zhifeng Li, and Yu Qiao. 2016. Joint face detection and alignment using multitask cascaded convolutional networks. IEEE Signal Processing Letters 23, 10 (2016), 1499–1503.
[25]
Pengfei Zhu, Longyin Wen, Dawei Du, Xiao Bian, Qinghua Hu, and Haibin Ling. 2020. Vision Meets Drones: Past, Present and Future. arXiv preprint arXiv:2001.06303(2020).

Cited By

View all
  • (2024)Super-Resolution Reconstruction of UAV Images with GANs: Achievements and Challenges2024 International Conference on Cyber-Physical Social Intelligence (ICCSI)10.1109/ICCSI62669.2024.10799467(1-6)Online publication date: 8-Nov-2024
  • (2024)Multi-UAV Collaborative Face Recognition for Goods Receiver in Edge-Based Smart Delivery ServicesAlgorithms and Architectures for Parallel Processing10.1007/978-981-97-0859-8_13(217-235)Online publication date: 27-Feb-2024
  • (2024)An Unconstrained Dataset for Face Recognition Across Distance, Pose, and ResolutionPattern Recognition10.1007/978-3-031-78341-8_9(127-144)Online publication date: 2-Dec-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
SSIP '20: Proceedings of the 2020 3rd International Conference on Sensors, Signal and Image Processing
October 2020
95 pages
ISBN:9781450388283
DOI:10.1145/3441233
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 March 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Deep Learning
  2. Drones
  3. Face recognition
  4. Multi Resolution Images
  5. Surveillance

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

SSIP 2020

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)35
  • Downloads (Last 6 weeks)3
Reflects downloads up to 24 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Super-Resolution Reconstruction of UAV Images with GANs: Achievements and Challenges2024 International Conference on Cyber-Physical Social Intelligence (ICCSI)10.1109/ICCSI62669.2024.10799467(1-6)Online publication date: 8-Nov-2024
  • (2024)Multi-UAV Collaborative Face Recognition for Goods Receiver in Edge-Based Smart Delivery ServicesAlgorithms and Architectures for Parallel Processing10.1007/978-981-97-0859-8_13(217-235)Online publication date: 27-Feb-2024
  • (2024)An Unconstrained Dataset for Face Recognition Across Distance, Pose, and ResolutionPattern Recognition10.1007/978-3-031-78341-8_9(127-144)Online publication date: 2-Dec-2024
  • (2023)Empirical Comparison of Face Verification Algorithms from UAVs2023 International Conference on Software, Telecommunications and Computer Networks (SoftCOM)10.23919/SoftCOM58365.2023.10271666(1-6)Online publication date: 21-Sep-2023
  • (2023)Meet-in-the-middle: Multi-scale upsampling and matching for cross-resolution face recognition2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW)10.1109/WACVW58289.2023.00017(1-10)Online publication date: Jan-2023
  • (2023)SkyNet: Multi-Drone Cooperation for Real-Time Person Identification and LocalizationIEEE INFOCOM 2023 - IEEE Conference on Computer Communications10.1109/INFOCOM53939.2023.10228978(1-10)Online publication date: 17-May-2023
  • (2023)Hierarchically Organized Computer Vision in Support of Multi-Faceted Search for Missing Persons2023 IEEE 17th International Conference on Automatic Face and Gesture Recognition (FG)10.1109/FG57933.2023.10042698(1-7)Online publication date: 5-Jan-2023
  • (2023)Real Time Facial Recognition and Tracking System Using Drones2023 IEEE 20th Consumer Communications & Networking Conference (CCNC)10.1109/CCNC51644.2023.10059664(975-976)Online publication date: 8-Jan-2023
  • (2023)Study of image sensors for enhanced face recognition at a distance in the Smart City contextScientific Reports10.1038/s41598-023-40110-y13:1Online publication date: 7-Sep-2023
  • (2021)Impact of Super-Resolution and Human Identification in Drone Surveillance2021 IEEE International Workshop on Information Forensics and Security (WIFS)10.1109/WIFS53200.2021.9648399(1-6)Online publication date: 7-Dec-2021
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media