Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

RFBoost: Understanding and Boosting Deep WiFi Sensing via Physical Data Augmentation

Published: 15 May 2024 Publication History

Abstract

Deep learning shows promising performance in wireless sensing. However, deep wireless sensing (DWS) heavily relies on large datasets. Unfortunately, building comprehensive datasets for DWS is difficult and costly, because wireless data depends on environmental factors and cannot be labeled offline. Despite recent advances in few-shot/cross-domain learning, DWS is still facing data scarcity issues. In this paper, we investigate a distinct perspective of radio data augmentation (RDA) for WiFi sensing and present a data-space solution. Our key insight is that wireless signals inherently exhibit data diversity, contributing more information to be extracted for DWS. We present RFBoost, a simple and effective RDA framework encompassing novel physical data augmentation techniques. We implement RFBoost as a plug-and-play module integrated with existing deep models and evaluate it on multiple datasets. Experimental results demonstrate that RFBoost achieves remarkable average accuracy improvements of 5.4% on existing models without additional data collection or model modifications, and the best-boosted performance outperforms 11 state-of-the-art baseline models without RDA. RFBoost pioneers the study of RDA, an important yet currently underexplored building block for DWS, which we expect to become a standard DWS component of WiFi sensing and beyond. RFBoost is released at https://github.com/aiot-lab/RFBoost.

References

[1]
Karan Ahuja, Yue Jiang, Mayank Goel, and Chris Harrison. 2021. Vid2Doppler: synthesizing Doppler radar data from videos for training privacy-preserving activity recognition. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1--10.
[2]
Sejal Bhalla, Mayank Goel, and Rushil Khurana. 2021. IMU2Doppler: Cross-Modal Domain Adaptation for Doppler-based Activity Recognition Using IMU Data. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 4 (2021), 1--20.
[3]
Mohammud Junaid Bocus, Wenda Li, Shelly Vishwakarma, Roget Kou, Chong Tang, Karl Woodbridge, Ian Craddock, Ryan McConville, Raúl Santos-Rodríguez, Kevin Chetty, and Robert J. Piechocki. 2022. OPERAnet, a multimodal activity recognition dataset acquired from radio frequency and vision-based sensors. Scientific Data 9 (2022).
[4]
Hong Cai, Belal Korany, Chitra R Karanam, and Yasamin Mostofi. 2020. Teaching rf to sense without rf training measurements. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1--22.
[5]
Zhe Chen, Tianyue Zheng, Chao Cai, and Jun Luo. 2021. MoVi-Fi: Motion-robust vital signs waveform recovery via deep interpreted RF sensing. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. 392--405.
[6]
Guoxuan Chi, Zheng Yang, Chenshu Wu, Jingao Xu, Yuchong Gao, and Tony Xiao Liu, Yunhao Han. 2024. RF-Diffusion: Radio Signal Generation via Time-Frequency Diffusion. In The 30th Annual International Conference on Mobile Computing and Networking (ACM MobiCom'24). ACM.
[7]
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition. Ieee, 248--255.
[8]
Shuya Ding, Zhe Chen, Tianyue Zheng, and Jun Luo. 2020. RF-net: A unified meta-learning framework for RF-enabled one-shot human activity recognition. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 517--530.
[9]
F. Dornaika, D. Sun, K. Hammoudi, J. Charafeddine, A. Cabani, and C. Zhang. 2023. Object-centric Contour-aware Data Augmentation Using Superpixels of Varying Granularity. Pattern Recognition 139 (2023), 109481. https://doi.org/10.1016/j.patcog.2023.109481
[10]
Chao Feng, Nan Wang, Yicheng Jiang, Xia Zheng, Kang Li, Zheng Wang, and Xiaojiang Chen. 2022. Wi-Learner: Towards One-Shot Learning for Cross-Domain Wi-Fi Based Gesture Recognition. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 3, Article 114 (sep 2022), 27 pages. https://doi.org/10.1145/3550318
[11]
Yuda Feng, Yaxiong Xie, Deepak Ganesan, and Jie Xiong. 2021. LTE-based Pervasive Sensing Across Indoor and Outdoor. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. 138--151.
[12]
Raphael Gontijo-Lopes, Sylvia Smullin, Ekin Dogus Cubuk, and Ethan Dyer. 2020. Tradeoffs in data augmentation: An empirical study. In Proceedings of International Conference on Learning Representations.
[13]
Yu Gu, Huan Yan, Mianxiong Dong, Meng Wang, Xiang Zhang, Zhi Liu, and Fuji Ren. 2021. Wione: One-shot learning for environment-robust device-free user authentication via commodity wi-fi in man-machine system. IEEE Transactions on Computational Social Systems 8, 3 (2021), 630--642.
[14]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.
[15]
Tsung-Yu Hsieh, Suhang Wang, Yiwei Sun, and Vasant Honavar. 2021. Explainable multivariate time series classification: a deep neural network which learns to attend to important variables as well as time intervals. In Proceedings of the 14th ACM international conference on web search and data mining. 607--615.
[16]
Yuqian Hu, Feng Zhang, Chenshu Wu, Beibei Wang, and KJ Ray Liu. 2021. DeFall: Environment-Independent Passive Fall Detection using WiFi. IEEE Internet of Things Journal (2021).
[17]
Chengkun Jiang, Junchen Guo, Yuan He, Meng Jin, Shuai Li, and Yunhao Liu. 2020. mmVib: micrometer-level vibration measurement with mmwave radar. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--13.
[18]
Dehao Jiang, Mingqi Li, and Chunling Xu. 2020. Wigan: A wifi based gesture recognition system with gans. Sensors 20, 17 (2020), 4757.
[19]
Wenjun Jiang, Chenglin Miao, Fenglong Ma, Shuochao Yao, Yaqing Wang, Ye Yuan, Hongfei Xue, Chen Song, Xin Ma, Dimitrios Koutsonikolas, et al. 2018. Towards environment independent device free human activity recognition. In Proceedings of the 24th annual international conference on mobile computing and networking. 289--304.
[20]
Wenjun Jiang, Hongfei Xue, Chenglin Miao, Shiyang Wang, Sen Lin, Chong Tian, Srinivasan Murali, Haochen Hu, Zhi Sun, and Lu Su. 2020. Towards 3D human pose construction using WiFi. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--14.
[21]
Belal Korany, Chitra R Karanam, Hong Cai, and Yasamin Mostofi. 2019. XModal-ID: Using WiFi for through-wall person identification from candidate video footage. In The 25th Annual International Conference on Mobile Computing and Networking. 1--15.
[22]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems 25 (2012).
[23]
Bing Li, Wei Cui, Wei Wang, Le Zhang, Zhenghua Chen, and Min Wu. 2021. Two-stream convolution augmented transformer for human activity recognition. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 286--293.
[24]
Chenning Li, Zheng Liu, Yuguang Yao, Zhichao Cao, Mi Zhang, and Yunhao Liu. 2020. Wi-fi see it all: generative adversarial network-augmented versatile wi-fi imaging. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 436--448.
[25]
Shuheng Li, Ranak Roy Chowdhury, Jingbo Shang, Rajesh K Gupta, and Dezhi Hong. 2021. UniTS: Short-Time Fourier Inspired Neural Networks for Sensory Time Series Classification. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. 234--247.
[26]
Xinyi Li, Liqiong Chang, Fangfang Song, Ju Wang, Xiaojiang Chen, Zhanyong Tang, and Zheng Wang. 2021. CrossGR: Accurate and Low-cost Cross-target Gesture Recognition Using Wi-Fi. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (March 2021), 1--23. https://doi.org/10.1145/3448100
[27]
Xuefeng Liu, Jiannong Cao, Shaojie Tang, and Jiaqi Wen. 2014. Wi-sleep: Contactless sleep monitoring via wifi signals. In 2014 IEEE Real-Time Systems Symposium. IEEE, 346--355.
[28]
Yongsen Ma, Gang Zhou, and Shuangquan Wang. 2019. WiFi sensing with channel state information: A survey. ACM Computing Surveys (CSUR) 52, 3 (2019), 1--36.
[29]
Yongsen Ma, Gang Zhou, Shuangquan Wang, Hongyang Zhao, and Woosub Jung. 2018. SignFi: Sign language recognition using WiFi. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1 (2018), 1--21.
[30]
Muhammed Zahid Ozturk, Chenshu Wu, Beibei Wang, and KJ Ray Liu. 2021. GaitCube: Deep data cube learning for human recognition with millimeter-wave radio. IEEE Internet of Things Journal 9, 1 (2021), 546--557.
[31]
Muhammed Zahid Ozturk, Chenshu Wu, Beibei Wang, and KJ Ray Liu. 2022. Toward mmWave-Based Sound Enhancement and Separation. In ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 6852--6856.
[32]
Sameera Palipana, David Rojas, Piyush Agrawal, and Dirk Pesch. 2018. FallDeFi: Ubiquitous fall detection using commodity Wi-Fi devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 1--25.
[33]
Daniel S. Park, William Chan, Yu Zhang, Chung-Cheng Chiu, Barret Zoph, Ekin D. Cubuk, and Quoc V. Le. 2019. SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition. In Proceedings of Interspeech 2019. 2613--2617.
[34]
PyTorch. 2023. PyTorch ResNet. https://pytorch.org/hub/pytorch_vision_resnet/. Accessed: Aug 2023.
[35]
Kun Qian, Chenshu Wu, Yi Zhang, Guidong Zhang, Zheng Yang, and Yunhao Liu. 2018. Widar2. 0: Passive human tracking with a single Wi-Fi link. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. 350--361.
[36]
Valentin Radu, Catherine Tong, Sourav Bhattacharya, Nicholas D Lane, Cecilia Mascolo, Mahesh K Marina, and Fahim Kawsar. 2018. Multimodal deep learning for activity and context recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 1--27.
[37]
Divya Shanmugam, Davis Blalock, Guha Balakrishnan, and John Guttag. 2021. Better aggregation in test-time augmentation. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 1214--1223.
[38]
Connor Shorten and Taghi M Khoshgoftaar. 2019. A survey on image data augmentation for deep learning. Journal of big data 6, 1 (2019), 1--48.
[39]
Shelly Vishwakarma, Wenda Li, Chong Tang, Karl Woodbridge, Raviraj Adve, and Kevin Chetty. 2021. SimHumalator: An Open-Source End-to-End Radar Simulator for Human Activity Recognition. IEEE Aerospace and Electronic Systems Magazine 37, 3 (2021), 6--22.
[40]
Fei Wang, Sanping Zhou, Stanislav Panev, Jinsong Han, and Dong Huang. 2019. Person-in-WiFi: Fine-grained person perception using WiFi. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 5452--5461.
[41]
Wei Wang, Alex X Liu, and Muhammad Shahzad. 2016. Gait recognition using wifi signals. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 363--373.
[42]
Wei Wang, Alex X Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2015. Understanding and modeling of wifi signal based human activity recognition. In Proceedings of the 21st annual international conference on mobile computing and networking. 65--76.
[43]
Yanwen Wang, Jiaxing Shen, and Yuanqing Zheng. 2020. Push the limit of acoustic gesture recognition. IEEE Transactions on Mobile Computing (2020).
[44]
Zhiguang Wang, Weizhong Yan, and Tim Oates. 2017. Time series classification from scratch with deep neural networks: A strong baseline. In 2017 International Joint Conference on Neural Networks (IJCNN). 1578--1585.
[45]
Chenshu Wu, Beibei Wang, Oscar C. Au, and K. J. Ray Liu. 2022. Wi-Fi Can Do More: Towards Ubiquitous Wireless Sensing. IEEE Communications Standards Magazine (2022).
[46]
Chenshu Wu, Zheng Yang, Zimu Zhou, Xuefeng Liu, Yunhao Liu, and Jiannong Cao. 2015. Non-invasive detection of moving and stationary human with WiFi. IEEE Journal on Selected Areas in Communications 33, 11 (2015), 2329--2342.
[47]
Chenshu Wu, Feng Zhang, Yuqian Hu, and KJ Ray Liu. 2020. GaitWay: Monitoring and recognizing gait speed through the walls. IEEE Transactions on Mobile Computing 20, 6 (2020), 2186--2199.
[48]
Chunjing Xiao, Daojun Han, Yongsen Ma, and Zhiguang Qin. 2019. CsiGAN: Robust Channel State Information-Based Activity Recognition With GANs. IEEE Internet of Things Journal 6 (2019), 10191--10204.
[49]
Rui Xiao, Jianwei Liu, Jinsong Han, and Kui Ren. 2021. OneFi: One-Shot Recognition for Unseen Gesture via COTS WiFi. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. 206--219.
[50]
Binbin Xie and Jie Xiong. 2020. Combating interference for long range LoRa sensing. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 69--81.
[51]
Hongfei Xue, Qiming Cao, Chenglin Miao, Yan Ju, Haochen Hu, Aidong Zhang, and Lu Su. 2023. Towards Generalized mmWave-based Human Pose Estimation through Signal Augmentation. In Proceedings of the 29th Annual International Conference on Mobile Computing and Networking. ACM, Madrid Spain, 1--15. https://doi.org/10.1145/3570361.3613302
[52]
Kun Yang, Xiaolong Zheng, Jie Xiong, L. Liu, and Huadong Ma. 2022. WiImg: Pushing the Limit of WiFi Sensing with Low Transmission Rates. 2022 19th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON) (2022), 1--9.
[53]
Qiang Yang and Yuanqing Zheng. 2022. DeepEar: Sound Localization with Binaural Microphones. In Proceedings of the IEEE INFOCOM.
[54]
Y. Yang, Yutong Zhang, Yue Lang, Beichen Li, Shisheng Guo, and Qi Tan. 2023. GAN-Based Radar Spectrogram Augmentation via Diversity Injection Strategy. IEEE Transactions on Instrumentation and Measurement 72 (2023), 1--12.
[55]
Zheng Yang, Yi Zhang, Kun Qian, and Chenshu Wu. 2023. SLNet: A Spectrogram Learning Neural Network for Deep Wireless Sensing. In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23). USENIX Association, Boston, MA, 1221--1236. https://www.usenix.org/conference/nsdi23/presentation/yang-zheng
[56]
Zheng Yang, Yi Zhang, and Qian Zhang. 2022. Rethinking Fall Detection With Wi-Fi. IEEE Transactions on Mobile Computing (2022).
[57]
Zheng Yang, Zimu Zhou, and Yunhao Liu. 2013. From RSSI to CSI: Indoor localization via channel response. ACM Computing Surveys (CSUR) 46, 2 (2013), 1--32.
[58]
Shuochao Yao, Shaohan Hu, Yiran Zhao, Aston Zhang, and Tarek Abdelzaher. 2017. Deepsense: A unified deep learning framework for time-series mobile sensing data processing. In Proceedings of the 26th ACM International Conference on World Wide Web. 351--360.
[59]
Shuochao Yao, Ailing Piao, Wenjun Jiang, Yiran Zhao, Huajie Shao, Shengzhong Liu, Dongxin Liu, Jinyang Li, Tianshi Wang, Shaohan Hu, et al. 2019. Stfnets: Learning sensing signals from the time-frequency perspective with short-time fourier neural networks. In The World Wide Web Conference. 2192--2202.
[60]
Feng Zhang, Chenshu Wu, Beibei Wang, Hung-Quoc Lai, Yi Han, and KJ Ray Liu. 2019. WiDetect: Robust motion detection with a statistical electromagnetic model. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1--24.
[61]
Feng Zhang, Chenshu Wu, Beibei Wang, Min Wu, Daniel Bugos, Hangfang Zhang, and KJ Ray Liu. 2019. SMARS: Sleep monitoring via ambient radio signals. IEEE Transactions on Mobile Computing 20, 1 (2019), 217--231.
[62]
Jie Zhang, Zhanyong Tang, Meng Li, Dingyi Fang, Petteri Nurmi, and Zheng Wang. 2018. CrossSense: Towards cross-site and large-scale WiFi sensing. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking. 305--320.
[63]
Jin Zhang, Fuxiang Wu, Bo Wei, Qieshi Zhang, Hui Huang, Syed W. Shah, and Jun Cheng. 2021. Data Augmentation and Dense-LSTM for Human Activity Recognition Using WiFi Signal. IEEE Internet of Things Journal 8, 6 (2021), 4628--4641. https://doi.org/10.1109/JIOT.2020.3026732
[64]
Xiaotong Zhang, Zhenjiang Li, and Jin Zhang. 2022. Synthesized Millimeter-Waves for Human Motion Sensing. (2022).
[65]
Yi Zhang, Yue Zheng, Kun Qian, Guidong Zhang, Yunhao Liu, Chenshu Wu, and Zheng Yang. 2021. Widar3.0: Zero-Effort Cross-Domain Gesture Recognition with Wi-Fi. IEEE transactions on pattern analysis and machine intelligence PP (2021).
[66]
Mingmin Zhao, Tianhong Li, Mohammad Abu Alsheikh, Yonglong Tian, Hang Zhao, Antonio Torralba, and Dina Katabi. 2018. Through-Wall Human Pose Estimation Using Radio Signals. In Proceedings of IEEE/CVF CVPR.
[67]
Mingmin Zhao, Yingcheng Liu, Aniruddh Raghu, Hang Zhao, Tianhong Li, Antonio Torralba, and Dina Katabi. 2019. Through-Wall Human Mesh Recovery Using Radio Signals. In Proceedings of IEEE/CVF ICCV.
[68]
Mingmin Zhao, Yonglong Tian, Hang Zhao, Mohammad Abu Alsheikh, Tianhong Li, Rumen Hristov, Zachary Kabelac, Dina Katabi, and Antonio Torralba. 2018. RF-Based 3D Skeletons. In Proceedings of ACM SIGCOMM.
[69]
Tianyue Zheng, Zhe Chen, Shuya Ding, and Jun Luo. 2021. Enhancing RF sensing with deep learning: A layered approach. IEEE Communications Magazine 59, 2 (2021), 70--76.
[70]
Tianyue Zheng, Zhe Chen, Shujie Zhang, Chao Cai, and Jun Luo. 2021. MoRe-Fi: Motion-robust and Fine-grained Respiration Monitoring via Deep-Learning UWB Radar. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. 111--124.
[71]
Yu Zheng, Zhi Zhang, Shen Yan, and Mi Zhang. 2022. Deep autoaugment. In Proceedings of International Conference on Learning Representations.
[72]
Zhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li, and Yi Yang. 2017. Random Erasing Data Augmentation. arXiv:1708.04896 [cs.CV]

Cited By

View all
  • (2024)Commodity Wi-Fi-Based Wireless Sensing Advancements over the Past Five YearsSensors10.3390/s2422719524:22(7195)Online publication date: 10-Nov-2024
  • (2024)Towards Robust mmWave-based Human Activity Recognition using Large Simulated Dataset for Model Pretraining2024 IEEE International Conference on Big Data (BigData)10.1109/BigData62323.2024.10825019(7332-7337)Online publication date: 15-Dec-2024

Index Terms

  1. RFBoost: Understanding and Boosting Deep WiFi Sensing via Physical Data Augmentation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
    Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 8, Issue 2
    June 2024
    1330 pages
    EISSN:2474-9567
    DOI:10.1145/3665317
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 May 2024
    Published in IMWUT Volume 8, Issue 2

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Data Augmentation
    2. Deep Learning
    3. Wireless Sensing

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    • Hong Kong RGC RIF
    • NSFC
    • Hong Kong RGC ECS

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)650
    • Downloads (Last 6 weeks)45
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Commodity Wi-Fi-Based Wireless Sensing Advancements over the Past Five YearsSensors10.3390/s2422719524:22(7195)Online publication date: 10-Nov-2024
    • (2024)Towards Robust mmWave-based Human Activity Recognition using Large Simulated Dataset for Model Pretraining2024 IEEE International Conference on Big Data (BigData)10.1109/BigData62323.2024.10825019(7332-7337)Online publication date: 15-Dec-2024

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media