RaDro: Indoor Drone Tracking Using Millimeter Wave Radar
Authors: 
Heba Abdelnasser, Mohammad Heggo, Oscar Pang, Mirko Kovac, 
Julie A. McCannAuthors Info & Claims
Heba Abdelnasser, Mohammad Heggo, Oscar Pang, Mirko Kovac, Julie A. McCannAuthors Info & ClaimsArticle No.: 88, Pages 1 - 23
Abstract
Core to drone design is its ability to ascertain its location by utilizing onboard inertial sensors combined with GPS data. However, GPS is not always reachable, especially in challenging environments such as indoors. This paper proposes RaDro; a system that leverages millimeter-waves (mmWave) to precisely localize and track drones in indoor environments. Unlike commonly used alternative technologies, RaDro is cost-effective and can penetrate obstacles, a bonus in non-line-of-sight (NLoS) scenarios, which enhances its reliability for tracking objects in complex environments. It does this without the need for tags or anchors to be attached to the drone, achieving 3D tracking with just a single radar point, significantly streamlining the deployment process. Comprehensive experiments are conducted in different scenarios to evaluate RaDro's performance. These include employing different drone models with different sizes to execute a range of aerial manoeuvres across different flight arenas, each with its own settings and clutter, and encountering various LoS and NLoS scenarios in dynamic environments. The experiments aimed to assess the capabilities of the system to extract coarse-grained and fine-grained information for drone detection, motion recognition, and localization. The results showcase precise localization, achieving a 50% reduction in localization error compared to the conventional baseline. This localization accuracy remains resilient even when confronted with interference from other moving sources. The results also demonstrate the system's ability to accurately localize drones in NLoS scenarios where existing state-of-the-art optical technologies cannot work.
References
[1]
Heba Abdelnasser, Khaled A Harras, and Moustafa Youssef. 2015. UbiBreathe: A ubiquitous non-invasive WiFi-based breathing estimator. In Proceedings of the 16th ACM international symposium on mobile ad hoc networking and computing. 277--286.
[2]
Heba Abdelnasser and Julie A McCann. 2024. Drone Propeller Speed Measurement: Case Study using 5GHz RF and mmWave Radar. In IEEE 99th Vehicular Technology Conference: VTC2024-Spring.
[3]
Heba Abdelnasser, Moustafa Youssef, and Khaled A Harras. 2015. Wigest: A ubiquitous wifi-based gesture recognition system. In 2015 IEEE conference on computer communications (INFOCOM). IEEE, 1472--1480.
[4]
Ganesan Balamurugan, J Valarmathi, and VPS Naidu. 2016. Survey on UAV navigation in GPS denied environments. In 2016 International conference on signal processing, communication, power and embedded system (SCOPES). IEEE, 198--204.
[5]
Yaakov Bar-Shalom, Fred Daum, and Jim Huang. 2009. The probabilistic data association filter. IEEE Control Systems Magazine 29, 6 (2009), 82--100.
[6]
Jyoti Bhatia, Aveen Dayal, Ajit Jha, Santosh K Vishvakarma, J Soumya, MB Srinivas, Phaneendra K Yalavarthy, Abhinav Kumar, V Lalitha, Sagar Koorapati, et al. 2021. Object classification technique for mmWave FMCW radars using range-FFT features. In 2021 International Conference on COMmunication Systems & NETworkS (COMSNETS). IEEE, 111--115.
[7]
AB Bitcraze. 2022. Loco Positioning System. https://www.bitcraze.io/documentation/system/positioning/loco-positioning-system/.
[8]
Samuel S Blackman. 2004. Multiple hypothesis tracking for multiple target tracking. IEEE Aerospace and Electronic Systems Magazine 19, 1 (2004), 5--18.
[9]
M Caris, W Johannes, S Sieger, V Port, and S Stanko. 2017. Detection of small UAS with W-band radar. In 2017 18th International Radar Symposium (IRS). IEEE, 1--6.
[10]
Xianyu Chang, Chaoqun Yang, Junfeng Wu, Xiufang Shi, and Zhiguo Shi. 2018. A surveillance system for drone localization and tracking using acoustic arrays. In 2018 IEEE 10th Sensor Array and Multichannel Signal Processing Workshop (SAM). IEEE, 573--577.
[11]
Weiyan Chen, Hongliu Yang, Xiaoyang Bi, Rong Zheng, Fusang Zhang, Peng Bao, Zhaoxin Chang, Xujun Ma, and Daqing Zhang. 2023. Environment-aware Multi-person Tracking in Indoor Environments with MmWave Radars. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 3 (2023), 1--29.
[12]
Xinlei Chen, Aveek Purohit, Carlos Ruiz Dominguez, Stefano Carpin, and Pei Zhang. 2015. Drunkwalk: Collaborative and adaptive planning for navigation of micro-aerial sensor swarms. In Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems. 295--308.
[13]
Guoxuan Chi, Zheng Yang, Jingao Xu, Chenshu Wu, Jialin Zhang, Jianzhe Liang, and Yunhao Liu. 2022. Wi-drone: wi-fi-based 6-DoF tracking for indoor drone flight control. In Proceedings of the 20th Annual International Conference on Mobile Systems, Applications and Services. 56--68.
[14]
Han Cui and Naim Dahnoun. 2021. High precision human detection and tracking using millimeter-wave radars. IEEE Aerospace and Electronic Systems Magazine 36, 1 (2021), 22--32.
[15]
Guido De Croon and Christophe De Wagter. 2018. Challenges of autonomous flight in indoor environments. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 1003--1009.
[16]
Lei Ding, Murtaza Ali, Sujeet Patole, and Anand Dabak. 2016. Vibration parameter estimation using FMCW radar. In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2224--2228.
[17]
Mahanth Gowda, Justin Manweiler, Ashutosh Dhekne, Romit Roy Choudhury, and Justin D Weisz. 2016. Tracking drone orientation with multiple GPS receivers. In Proceedings of the 22nd annual international conference on mobile computing and networking. 280--293.
[18]
Ismail Güvenç, Ozgur Ozdemir, Yavuz Yapici, Hani Mehrpouyan, and David Matolak. 2017. Detection, localization, and tracking of unauthorized UAS and jammers. In 2017 IEEE/AIAA 36th Digital Avionics Systems Conference (DASC). IEEE, 1--10.
[19]
Nasser Gyagenda, Jasper V Hatilima, Hubert Roth, and Vadim Zhmud. 2022. A review of GNSS-independent UAV navigation techniques. Robotics and Autonomous Systems 152 (2022), 104069.
[20]
Mostafa Hassanalian and Abdessattar Abdelkefi. 2017. Classifications, applications, and design challenges of drones: A review. Progress in Aerospace Sciences 91 (2017), 99--131.
[21]
Yuan He, Jia Zhang, Rui Xi, Xin Na, Yimiao Sun, and Beibei Li. 2024. Detection and Identification of non-cooperative UAV using a COTS mmWave Radar. ACM Transactions on Sensor Networks 20, 2 (2024), 1--22.
[22]
Cesar Iovescu and Sandeep Rao. 2017. The fundamentals of millimeter wave sensors. Texas Instruments (2017), 1--8.
[23]
Chengkun Jiang, Junchen Guo, Yuan He, Meng Jin, Shuai Li, and Yunhao Liu. 2020. mmVib: micrometer-level vibration measurement with mmwave radar. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--13.
[24]
Wenjun Jiang, Chenglin Miao, Fenglong Ma, Shuochao Yao, Yaqing Wang, Ye Yuan, Hongfei Xue, Chen Song, Xin Ma, Dimitrios Koutsonikolas, et al. 2018. Towards environment independent device free human activity recognition. In Proceedings of the 24th annual international conference on mobile computing and networking. 289--304.
[25]
Rudolph Emil Kalman. 1960. A new approach to linear filtering and prediction problems. (1960).
[26]
Byeong Hak Kim, Danish Khan, Ciril Bohak, Wonju Choi, Hyun Jeong Lee, and Min Young Kim. 2018. V-RBNN based small drone detection in augmented datasets for 3D LADAR system. Sensors 18, 11 (2018), 3825.
[27]
Eugene F Knott, John F Schaeffer, and Michael T Tulley. 2004. Radar cross section. SciTech Publishing.
[28]
Harold W Kuhn. 1955. The Hungarian method for the assignment problem. Naval research logistics quarterly 2, 1--2 (1955), 83--97.
[29]
Sungjae Lee and Yosoon Choi. 2016. Reviews of unmanned aerial vehicle (drone) technology trends and its applications in the mining industry. Geosystem Engineering 19, 4 (2016), 197--204.
[30]
Jaime Lien, Nicholas Gillian, M Emre Karagozler, Patrick Amihood, Carsten Schwesig, Erik Olson, Hakim Raja, and Ivan Poupyrev. 2016. Soli: Ubiquitous gesture sensing with millimeter wave radar. ACM Transactions on Graphics (TOG) 35, 4 (2016), 1--19.
[31]
Kristijan Mirceta, Ciril Bohak, Byeong Hak Kim, Min Young Kim, and Matija Marolt. 2018. Drone segmentation and tracking in grounded sensor scanned LiDAR datasets. In Proceedings of the Zbornik sedemindvajsete mednarodne Elektrotehniške in racunalniške konference ERK. 384--387.
[32]
Balmukund Mishra, Deepak Garg, Pratik Narang, and Vipul Mishra. 2020. Drone-surveillance for search and rescue in natural disaster. Computer Communications 156 (2020), 1--10.
[33]
Peter Joseph Basil Morris and KVS Hari. 2021. Detection and localization of unmanned aircraft systems using millimeter-wave automotive radar sensors. IEEE Sensors Letters 5, 6 (2021), 1--4.
[34]
Phuc Nguyen, Vimal Kakaraparthi, Nam Bui, Nikshep Umamahesh, Nhat Pham, Hoang Truong, Yeswanth Guddeti, Dinesh Bharadia, Richard Han, Eric Frew, et al. 2020. DroneScale: drone load estimation via remote passive RF sensing. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 326--339.
[35]
Jacopo Pegoraro, Francesca Meneghello, and Michele Rossi. 2020. Multiperson continuous tracking and identification from mm-wave micro-Doppler signatures. IEEE Transactions on Geoscience and Remote Sensing 59, 4 (2020), 2994--3009.
[36]
Jacopo Pegoraro and Michele Rossi. 2022. Human tracking with mmWave radars: A deep learning approach with uncertainty estimation. In 2022 IEEE 23rd International Workshop on Signal Processing Advances in Wireless Communication (SPAWC). IEEE, 1--5.
[37]
Jacopo Pegoraro, Domenico Solimini, Federico Matteo, Enver Bashirov, Francesca Meneghello, and Michele Rossi. 2020. Deep learning for accurate indoor human tracking with a mm-wave radar. In 2020 IEEE Radar Conference (RadarConf20). IEEE, 1--6.
[38]
Aveek Purohit, Zheng Sun, Frank Mokaya, and Pei Zhang. 2011. SensorFly: Controlled-mobile sensing platform for indoor emergency response applications. In Proceedings of the 10th ACM/IEEE International Conference on Information Processing in Sensor Networks. IEEE, 223--234.
[39]
Quan Quan. 2017. Introduction to multicopter design and control. Springer.
[40]
Jorge Peña Queralta, Carmen Martínez Almansa, Fabrizio Schiano, Dario Floreano, and Tomi Westerlund. 2020. Uwb-based system for uav localization in gnss-denied environments: Characterization and dataset. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 4521--4528.
[41]
Prabhat Kumar Rai, Henning Idsøe, Rajesh Reddy Yakkati, Abhinav Kumar, Mohammed Zafar Ali Khan, Phaneendra K Yalavarthy, and Linga Reddy Cenkeramaddi. 2021. Localization and activity classification of unmanned aerial vehicle using mmWave FMCW radars. IEEE Sensors Journal 21, 14 (2021), 16043--16053.
[42]
Maria Isabel Ribeiro. 2004. Kalman and extended kalman filters: Concept, derivation and properties. Institute for Systems and Robotics 43, 46 (2004), 3736--3741.
[43]
Marvelmind robotics. 2020. PRECISE INDOOR POSITIONING SYSTEM for autonomous robots, drones, vehicles and humans. https://marvelmind.com.
[44]
Carlos Ruiz, Shijia Pan, Adeola Bannis, Xinlei Chen, Carlee Joe-Wong, Hae Young Noh, and Pei Zhang. 2018. Idrone: Robust drone identification through motion actuation feedback. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 1--22.
[45]
Sylvain Sardy, Paul Tseng, and Andrew Bruce. 2001. Robust wavelet denoising. IEEE Transactions on Signal Processing 49, 6 (2001), 1146--1152.
[46]
Anish Shastri, Neharika Valecha, Enver Bashirov, Harsh Tataria, Michael Lentmaier, Fredrik Tufvesson, Michele Rossi, and Paolo Casari. 2022. A review of millimeter wave device-based localization and device-free sensing technologies and applications. IEEE Communications Surveys & Tutorials 24, 3 (2022), 1708--1749.
[47]
Suhare Solaiman, Emad Alsuwat, and Rajwa Alharthi. 2023. Simultaneous Tracking and Recognizing Drone Targets with Millimeter-Wave Radar and Convolutional Neural Network. Applied System Innovation 6, 4 (2023), 68.
[48]
Yimiao Sun, Weiguo Wang, Luca Mottola, Ruijin Wang, and Yuan He. 2022. AIM: Acoustic Inertial Measurement for Indoor Drone Localization and Tracking. In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems. 476--488.
[49]
D Sundararajan. 2016. Discrete wavelet transform: a signal processing approach. John Wiley & Sons.
[50]
Arnaud Taffanel, Barbara Rousselot, Jonas Danielsson, Kimberly McGuire, Kristoffer Richardsson, Marcus Eliasson, Tobias Antonsson, and Wolfgang Hönig. 2021. Lighthouse positioning system: dataset, accuracy, and precision for UAV research. arXiv preprint arXiv:2104.11523 (2021).
[51]
Arthur Venon, Yohan Dupuis, Pascal Vasseur, and Pierre Merriaux. 2022. Millimeter wave FMCW radars for perception, recognition and localization in automotive applications: A survey. IEEE Transactions on Intelligent Vehicles 7, 3 (2022), 533--555.
[52]
John Wang and Edwin Olson. 2016. AprilTag 2: Efficient and robust fiducial detection. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 4193--4198.
[53]
Lukas Wawrla, Omid Maghazei, and Torbjørn Netland. 2019. Applications of drones in warehouse operations. Whitepaper. ETH Zurich, D-MTEC (2019).
[54]
Guohua Wei, Yuxiang Zhou, and Siliang Wu. 2008. Detection and localization of high speed moving targets using a short-range UWB impulse radar. In 2008 IEEE Radar Conference. IEEE, 1--4.
[55]
Teng Wei and Xinyu Zhang. 2015. mtrack: High-precision passive tracking using millimeter wave radios. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. 117--129.
[56]
Chenshu Wu, Feng Zhang, Beibei Wang, and KJ Ray Liu. 2020. mmTrack: Passive multi-person localization using commodity millimeter wave radio. In IEEE INFOCOM 2020-IEEE Conference on Computer Communications. IEEE, 2400--2409.
[57]
Jiacheng Wu, Han Cui, and Naim Dahnoun. 2021. A novel high performance human detection, tracking and alarm system based on millimeter-wave radar. In 2021 10th Mediterranean Conference on Embedded Computing (MECO). IEEE, 1--4.
[58]
Zhicheng Yang, Parth H Pathak, Yunze Zeng, Xixi Liran, and Prasant Mohapatra. 2017. Vital sign and sleep monitoring using millimeter wave. ACM Transactions on Sensor Networks (TOSN) 13, 2 (2017), 1--32.
[59]
Jia Zhang, Yinian Zhou, Rui Xi, Shuai Li, Junchen Guo, and Yuan He. 2022. Ambiear: Mmwave based voice recognition in nlos scenarios. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1--25.
[60]
Peijun Zhao, Chris Xiaoxuan Lu, Bing Wang, Niki Trigoni, and Andrew Markham. 2021. 3d motion capture of an unmodified drone with single-chip millimeter wave radar. In 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 5186--5192.
[61]
Peijun Zhao, Chris Xiaoxuan Lu, Jianan Wang, Changhao Chen, Wei Wang, Niki Trigoni, and Andrew Markham. 2021. Human tracking and identification through a millimeter wave radar. Ad Hoc Networks 116 (2021), 102475.
Index Terms
- RaDro: Indoor Drone Tracking Using Millimeter Wave Radar
Recommendations
A Gaussian Process model for UAV localization using millimetre wave radar
AbstractThe detection and positioning of unmanned aerial vehicles has become essential for both automation and surveillance tasks, in recent years. The design of accurate drone localization systems is challenging, especially in cluttered ...
Highlights- A new UAV localization system is presented, based on millimetre wave radar data.
Range-free localization algorithm using a customary drone: Towards a realistic scenario
AbstractThe localization of devices is a key ingredient of Internet of Things (IoT) which may requireextra cost for deploying anchor nodes aware of their position. In this work, we propose a range-free localization algorithm, called Drone ...
Drone Indoor Self-Localization
DroNet '15: Proceedings of the First Workshop on Micro Aerial Vehicle Networks, Systems, and Applications for Civilian UseDrones are becoming more and more popular for their possible use in different scenarios, not only outdoor, but even indoor. In this context, indoor self-localization may become crucial and, clearly, GPS is not an option. In this poster we discuss a ...
Comments
Information & Contributors
Information
Published In
Copyright © 2024 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 09 September 2024
Published in IMWUT Volume 8, Issue 3
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 767Total Downloads
- Downloads (Last 12 months)767
- Downloads (Last 6 weeks)151
Reflects downloads up to 01 Feb 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in