Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3636534.3649350acmconferencesArticle/Chapter ViewAbstractPublication PagesmobicomConference Proceedingsconference-collections
research-article

MSense: Boosting Wireless Sensing Capability Under Motion Interference

Published: 29 May 2024 Publication History

Abstract

Wireless signals have been widely utilized for human sensing. However, wireless sensing systems face a fundamental limitation, i.e., the wireless device must keep static during the sensing process. Also, when sensing fine-grained human motions such as respiration, the human target is required to stay stationary. This is because wireless sensing relies on signal variations for sensing. When device is moving or human body is moving, the signal variation caused by the target area (e.g., chest for respiration sensing) is mixed with the signal variation induced by device or other body parts, failing wireless sensing. In this paper, we propose MSense, a general solution to deal with motion interference from wireless device and/or human body, moving wireless sensing one step forward towards real-life adoption. We establish the sensing model by taking both device motion and interfering body motion into consideration. By extracting the effect of body and device motions through pure signal processing, the motion interference can be removed to achieve accurate target sensing. Comprehensive experiments demonstrate the effectiveness of the proposed scheme. The achieved solution is general and can be applied to different sensing tasks involving both periodic and aperiodic motions.

References

[1]
2017. Respiration Monitor Belt logger sensor NUL-236. https://neulog.com/respiration-monitor-belt/.
[2]
2023. DCA1000EVM. https://www.ti.com/tool/DCA1000EVM.
[3]
2023. IWR1843BOOST. https://www.ti.com/product/IWR1843BOOST/part-details/IWR1843BOOST.
[4]
2023. MMWAVE-STUDIO. https://www.ti.com/tool/MMWAVE-STUDIO.
[5]
Fadel Adib, Chen-Yu Hsu, Hongzi Mao, Dina Katabi, and Frédo Durand. 2015. Capturing the human figure through a wall. ACM Transactions on Graphics (TOG) 34, 6 (2015), 1--13.
[6]
Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C Miller. 2014. 3D tracking via body radio reflections. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14). 317--329.
[7]
Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2015. Smart homes that monitor breathing and heart rate. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. 837--846.
[8]
Sayed Saad Afzal, Atsutse Kludze, Subhajit Karmakar, Ranveer Chandra, and Yasaman Ghasempour. 2023. AgriTera: Accurate Non-Invasive Fruit Ripeness Sensing via Sub-Terahertz Wireless Signals. In Proceedings of the 29th Annual International Conference on Mobile Computing and Networking. 1--15.
[9]
Adeel Ahmad, June Chul Roh, Dan Wang, and Aish Dubey. 2018. Vital signs monitoring of multiple people using a FMCW millimeter-wave sensor. In 2018 IEEE Radar Conference (RadarConf18). IEEE, 1450--1455.
[10]
Jack Capon. 1969. High-resolution frequency-wavenumber spectrum analysis. Proc. IEEE 57, 8 (1969), 1408--1418.
[11]
Zhaoxin Chang, Fusang Zhang, Jie Xiong, Junqi Ma, Beihong Jin, and Daqing Zhang. 2022. Sensor-free soil moisture sensing using lora signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 2 (2022), 1--27.
[12]
Lili Chen, Jie Xiong, Xiaojiang Chen, Sunghoon Ivan Lee, Kai Chen, Dianhe Han, Dingyi Fang, Zhanyong Tang, and Zheng Wang. 2019. WideSee: Towards wide-area contactless wireless sensing. In Proceedings of the 17th Conference on Embedded Networked Sensor Systems. 258--270.
[13]
Weiyan Chen, Kai Niu, Deng Zhao, Rong Zheng, Dan Wu, Wei Wang, Leye Wang, and Daqing Zhang. 2020. Robust dynamic hand gesture interaction using LTE terminals. In 2020 19th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). IEEE, 109--120.
[14]
Weiyan Chen, Hongliu Yang, Xiaoyang Bi, Rong Zheng, Fusang Zhang, Peng Bao, Zhaoxin Chang, Xujun Ma, and Daqing Zhang. 2023. Environment-aware Multi-person Tracking in Indoor Environments with MmWave Radars. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 3 (2023), 1--29.
[15]
Zhe Chen, Tianyue Zheng, Chao Cai, and Jun Luo. 2021. MoVi-Fi: Motion-robust vital signs waveform recovery via deep interpreted RF sensing. In Proceedings of the 27th annual international conference on mobile computing and networking. 392--405.
[16]
Zhe Chen, Tianyue Zheng, and Jun Luo. 2021. Octopus: a practical and versatile wideband MIMO sensing platform. In Proceedings of the 27th Annual International Conference on Mobile Computing and Networking. 601--614.
[17]
Reinhard Feger, Christoph Wagner, Stefan Schuster, Stefan Scheiblhofer, Herbert Jager, and Andreas Stelzer. 2009. A 77-GHz FMCW MIMO radar based on an SiGe single-chip transceiver. IEEE Transactions on Microwave theory and Techniques 57, 5 (2009), 1020--1035.
[18]
Yuda Feng, Yaxiong Xie, Deepak Ganesan, and Jie Xiong. 2021. Lte-based pervasive sensing across indoor and outdoor. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. 138--151.
[19]
Yuda Feng, Yaxiong Xie, Deepak Ganesan, and Jie Xiong. 2022. LTE-Based Low-Cost and Low-Power Soil Moisture Sensing. In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems. 421--434.
[20]
Jian Gong, Xinyu Zhang, Kaixin Lin, Ju Ren, Yaoxue Zhang, and Wenxun Qiu. 2021. RF vital sign sensing under free body movement. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1--22.
[21]
Unsoo Ha, Salah Assana, and Fadel Adib. 2020. Contactless seismocardiography via deep learning radars. In Proceedings of the 26th annual international conference on mobile computing and networking. 1--14.
[22]
Jingyang Hu, Hongbo Jiang, Daibo Liu, Zhu Xiao, Schahram Dustdar, Jiangchuan Liu, and Geyong Min. 2022. BlinkRadar: non-intrusive driver eye-blink detection with UWB radar. In 2022 IEEE 42nd International Conference on Distributed Computing Systems (ICDCS). IEEE, 1040--1050.
[23]
Chengkun Jiang, Junchen Guo, Yuan He, Meng Jin, Shuai Li, and Yunhao Liu. 2020. mmVib: micrometer-level vibration measurement with mmwave radar. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--13.
[24]
Sinan Kaplan, Mehmet Amac Guvensan, Ali Gokhan Yavuz, and Yasin Karalurt. 2015. Driver behavior analysis for safe driving: A survey. IEEE Transactions on Intelligent Transportation Systems 16, 6 (2015), 3017--3032.
[25]
Dong Li, Jialin Liu, Sunghoon Ivan Lee, and Jie Xiong. 2022. Lasense: Pushing the limits of fine-grained activity sensing using acoustic signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 1 (2022), 1--27.
[26]
Dong Li, Jialin Liu, Sunghoon Ivan Lee, and Jie Xiong. 2022. Room-Scale Hand Gesture Recognition Using Smart Speakers. In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems. 462--475.
[27]
Tianhong Li, Lijie Fan, Mingmin Zhao, Yingcheng Liu, and Dina Katabi. 2019. Making the invisible visible: Action recognition through walls and occlusions. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 872--881.
[28]
Yang Li, Dan Wu, Jie Zhang, Xuhai Xu, Yaxiong Xie, Tao Gu, and Daqing Zhang. 2022. Diversense: Maximizing Wi-Fi sensing range leveraging signal diversity. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 2 (2022), 1--28.
[29]
Kun Liang, Anfu Zhou, Zhan Zhang, Hao Zhou, Huadong Ma, and Chenshu Wu. 2023. mmStress: Distilling Human Stress from Daily Activities via Contact-less Millimeter-wave Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 3 (2023), 1--36.
[30]
Haipeng Liu, Yuheng Wang, Anfu Zhou, Hanyue He, Wei Wang, Kunpeng Wang, Peilin Pan, Yixuan Lu, Liang Liu, and Huadong Ma. 2020. Real-time arm gesture recognition in smart home scenarios via millimeter wave sensing. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 4, 4 (2020), 1--28.
[31]
Wenguang Mao, Mei Wang, Wei Sun, Lili Qiu, Swadhin Pradhan, and Yi-Chao Chen. 2019. Rnn-based room scale hand motion tracking. In The 25th Annual International Conference on Mobile Computing and Networking. 1--16.
[32]
Sameera Palipana, Dariush Salami, Luis A Leiva, and Stephan Sigg. 2021. Pantomime: Mid-air gesture recognition with sparse millimeter-wave radar point clouds. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 5, 1 (2021), 1--27.
[33]
Rui Peng, Yafei Tian, and Shengqian Han. 2023. ICI-Free Channel Estimation and Wireless Gesture Recognition Based on Cellular Signals. IEEE Wireless Communications Letters (2023).
[34]
Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel. 2013. Whole-home gesture recognition using wireless signals. In Proceedings of the 19th annual international conference on Mobile computing & networking. 27--38.
[35]
Kun Qian, Chenshu Wu, Yi Zhang, Guidong Zhang, Zheng Yang, and Yunhao Liu. 2018. Widar2. 0: Passive human tracking with a single Wi-Fi link. In Proceedings of the 16th annual international conference on mobile systems, applications, and services. 350--361.
[36]
Frank C Robey, Daniel R Fuhrmann, Edward J Kelly, and Ramon Nitzberg. 1992. A CFAR adaptive matched filter detector. IEEE Transactions on aerospace and electronic systems 28, 1 (1992), 208--216.
[37]
Xingzhe Song, Boyuan Yang, Ge Yang, Ruirong Chen, Erick Forno, Wei Chen, and Wei Gao. 2020. SpiroSonic: monitoring human lung function via acoustic sensing on commodity smartphones. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--14.
[38]
Guanlong Teng, Feng Hong, Yue Xu, Jianbo Qi, Ruobing Jiang, Chao Liu, and Zhongwen Guo. 2020. MobiFit: Contactless Fitness Assistant for Freehand Exercises Using Just One Cellular Signal Receiver. In 2020 16th International Conference on Mobility, Sensing and Networking (MSN). IEEE, 299--306.
[39]
Anran Wang, Jacob E Sunshine, and Shyamnath Gollakota. 2019. Contactless infant monitoring using white noise. In The 25th Annual International Conference on Mobile Computing and Networking. 1--16.
[40]
Chuyu Wang, Jian Liu, Yingying Chen, Hongbo Liu, Lei Xie, Wei Wang, Bingbing He, and Sanglu Lu. 2018. Multi-touch in the air: Device-free finger tracking and gesture recognition via cots rfid. In IEEE INFOCOM 2018-IEEE conference on computer communications. IEEE, 1691--1699.
[41]
Hao Wang, Daqing Zhang, Junyi Ma, Yasha Wang, Yuxiang Wang, Dan Wu, Tao Gu, and Bing Xie. 2016. Human respiration detection with commodity WiFi devices: Do user location and body orientation matter?. In Proceedings of the 2016 ACM international joint conference on pervasive and ubiquitous computing. 25--36.
[42]
Pei Wang, Xujun Ma, Rong Zheng, Luan Chen, Xiaolin Zhang, Djamal Zeghlache, and Daqing Zhang. 2023. SlpRoF: Improving the Temporal Coverage and Robustness of RF-based Vital Sign Monitoring during Sleep. IEEE Transactions on Mobile Computing (2023).
[43]
Wei Wang, Alex X Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2015. Understanding and modeling of wifi signal based human activity recognition. In Proceedings of the 21st annual international conference on mobile computing and networking. 65--76.
[44]
Wei Wang, Alex X Liu, and Ke Sun. 2016. Device-free gesture tracking using acoustic signals. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. 82--94.
[45]
Xuanzhi Wang, Kai Niu, Anlan Yu, Jie Xiong, Zhiyun Yao, Junzhe Wang, Wenwei Li, and Daqing Zhang. 2023. WiMeasure: Millimeter-level Object Size Measurement with Commodity WiFi Devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 2 (2023), 1--26.
[46]
Yanwen Wang, Jiaxing Shen, and Yuanqing Zheng. 2020. Push the limit of acoustic gesture recognition. IEEE Transactions on Mobile Computing 21, 5 (2020), 1798--1811.
[47]
Zhu Wang, Yifan Guo, Zhihui Ren, Wenchao Song, Zhuo Sun, Chao Chen, Bin Guo, and Zhiwen Yu. 2024. LiqDetector: Enabling Container-Independent Liquid Detection with mmWave Signals Based on a Dual-Reflection Model. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 4 (2024), 1--24.
[48]
Zhi Wang, Beihong Jin, Siheng Li, Fusang Zhang, and Wenbo Zhang. 2023. ECG-grained Cardiac Monitoring Using UWB Signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 4 (2023), 1--25.
[49]
Teng Wei and Xinyu Zhang. 2015. mtrack: High-precision passive tracking using millimeter wave radios. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. 117--129.
[50]
Chenhao Wu, Xuan Huang, Jun Huang, and Guoliang Xing. 2023. Enabling Ubiquitous WiFi Sensing with Beamforming Reports. In Proceedings of the ACM SIGCOMM 2023 Conference. 20--32.
[51]
Chenshu Wu, Feng Zhang, Beibei Wang, and KJ Ray Liu. 2020. mm-Track: Passive multi-person localization using commodity millimeter wave radio. In IEEE INFOCOM 2020-IEEE Conference on Computer Communications. IEEE, 2400--2409.
[52]
Binbin Xie, Minhao Cui, Deepak Ganesan, Xiangru Chen, and Jie Xiong. 2023. Boosting the Long Range Sensing Potential of LoRa. In Proceedings of the 21st Annual International Conference on Mobile Systems, Applications and Services. 177--190.
[53]
Binbin Xie, Jie Xiong, Xiaojiang Chen, and Dingyi Fang. 2020. Exploring commodity rfid for contactless sub-millimeter vibration sensing. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 15--27.
[54]
Jie Xiong and Kyle Jamieson. 2013. ArrayTrack: A Fine-Grained indoor location system. In 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). 71--84.
[55]
Xiangyu Xu, Jiadi Yu, Yingying Chen, Yanmin Zhu, Linghe Kong, and Minglu Li. 2019. Breathlistener: Fine-grained breathing monitoring in driving environments utilizing acoustic signals. In Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services. 54--66.
[56]
Yanni Yang, Jiannong Cao, Xiulong Liu, and Xuefeng Liu. 2019. Multibreath: Separate respiration monitoring for multiple persons with UWB radar. In 2019 IEEE 43rd Annual Computer Software and Applications Conference (COMPSAC), Vol. 1. IEEE, 840--849.
[57]
Yanni Yang, Huafeng Xu, Qianyi Chen, Jiannong Cao, and Yanwen Wang. 2023. Multi-Vib: Precise Multi-point Vibration Monitoring Using mmWave Radar. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 4 (2023), 1--26.
[58]
Shang Zeng, Haoran Wan, Shuyu Shi, and Wei Wang. 2023. mSilent: Towards General Corpus Silent Speech Recognition Using COTS mmWave Radar. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 1 (2023), 1--28.
[59]
Bo Zhang, Boyu Jiang, Rong Zheng, Xiaoping Zhang, Jun Li, and Qiang Xu. 2023. Pi-ViMo: Physiology-inspired Robust Vital Sign Monitoring using mmWave Radars. ACM Transactions on Internet of Things 4, 2 (2023), 1--27.
[60]
Bin-Bin Zhang, Dongheng Zhang, Ruiyuan Song, Binquan Wang, Yang Hu, and Yan Chen. 2023. RF-Search: Searching Unconscious Victim in Smoke Scenes with RF-enabled Drone. In Proceedings of the 29th Annual International Conference on Mobile Computing and Networking. 1--15.
[61]
Duo Zhang, Xusheng Zhang, Shengjie Li, Yaxiong Xie, Yang Li, Xuanzhi Wang, and Daqing Zhang. 2023. LT-Fall: The Design and Implementation of a Life-threatening Fall Detection and Alarming System. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 1 (2023), 1--24.
[62]
Fusang Zhang, Zhaoxin Chang, Kai Niu, Jie Xiong, Beihong Jin, Qin Lv, and Daqing Zhang. 2020. Exploring lora for long-range through-wall sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 2 (2020), 1--27.
[63]
Fusang Zhang, Zhaoxin Chang, Jie Xiong, Junqi Ma, Jiazhi Ni, Wenbo Zhang, Beihong Jin, and Daqing Zhang. 2023. Embracing Consumer-level UWB-equipped Devices for Fine-grained Wireless Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 4 (2023), 1--27.
[64]
Fusang Zhang, Zhaoxin Chang, Jie Xiong, Rong Zheng, Junqi Ma, Kai Niu, Beihong Jin, and Daqing Zhang. 2021. Unlocking the beamforming potential of LoRa for long-range multi-target respiration sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 2 (2021), 1--25.
[65]
Fusang Zhang, Jie Xiong, Zhaoxin Chang, Junqi Ma, and Daqing Zhang. 2022. Mobi2Sense: empowering wireless sensing with mobility. In Proceedings of the 28th Annual International Conference on Mobile Computing And Networking. 268--281.
[66]
Shigeng Zhang, Xuan Liu, Yangyang Liu, Bo Ding, Song Guo, and Jianxin Wang. 2020. Accurate respiration monitoring for mobile users with commercial RFID devices. IEEE Journal on Selected Areas in Communications 39, 2 (2020), 513--525.
[67]
Shigeng Zhang, Zijing Ma, Kaixuan Lu, Xuan Liu, Jia Liu, Song Guo, Albert Y Zomaya, Jian Zhang, and Jianxin Wang. 2022. Hearme: Accurate and real-time lip reading based on commercial rfid devices. IEEE Transactions on Mobile Computing (2022).
[68]
Xusheng Zhang, Duo Zhang, Yaxiong Xie, Dan Wu, Yang Li, and Daqing Zhang. 2024. Waffle: A Waterproof mmWave-based Human Sensing System inside Bathrooms with Running Water. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 4 (2024), 1--29.
[69]
Xi Zhang, Yu Zhang, Zhenguo Shi, and Tao Gu. 2023. mmFER: Millimetre-wave Radar based Facial Expression Recognition for Multimedia IoT Applications. In Proceedings of the 29th Annual International Conference on Mobile Computing and Networking. 1--15.
[70]
Cui Zhao, Zhenjiang Li, Han Ding, Ge Wang, Wei Xi, and Jizhong Zhao. 2022. RF-Wise: Pushing the Limit of RFID-based Sensing. In IEEE INFOCOM 2022-IEEE Conference on Computer Communications. IEEE, 1779--1788.
[71]
Tianyue Zheng, Zhe Chen, Shujie Zhang, Chao Cai, and Jun Luo. 2021. More-fi: Motion-robust and fine-grained respiration monitoring via deep-learning uwb radar. In Proceedings of the 19th ACM conference on embedded networked sensor systems. 111--124.
[72]
Juncen Zhu, Jiannong Cao, Yanni Yang, Wei Ren, and Huizi Han. 2023. mmDrive: Fine-Grained Fatigue Driving Detection Using mmWave Radar. ACM Transactions on Internet of Things (2023).

Index Terms

  1. MSense: Boosting Wireless Sensing Capability Under Motion Interference

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ACM MobiCom '24: Proceedings of the 30th Annual International Conference on Mobile Computing and Networking
    May 2024
    733 pages
    ISBN:9798400704895
    DOI:10.1145/3636534
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 May 2024

    Check for updates

    Author Tags

    1. wireless sensing
    2. motion interference cancellation
    3. body motion and device motion interference
    4. MmWave radar

    Qualifiers

    • Research-article

    Funding Sources

    • National Natural Science Foundation of China
    • Beijing Natural Science Foundation
    • Beijing Nova Program and the Youth Innovation Promotion Association, Chinese Academy of Sciences
    • Horizon EIC pathfinder challenge project SUSTAIN
    • EU Horizon 2020 research and innovation program IDEA-FAST

    Conference

    ACM MobiCom '24
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 440 of 2,972 submissions, 15%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 644
      Total Downloads
    • Downloads (Last 12 months)644
    • Downloads (Last 6 weeks)273
    Reflects downloads up to 15 Oct 2024

    Other Metrics

    Citations

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media