Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Waffle: A Waterproof mmWave-based Human Sensing System inside Bathrooms with Running Water

Published: 12 January 2024 Publication History

Abstract

The bathroom has consistently ranked among the most perilous rooms in households, with slip and fall incidents during showers posing a critical threat, particularly to the elders. To address this concern while ensuring privacy and accuracy, the mmWave-based sensing system has emerged as a promising solution. Capable of precisely detecting human activities and promptly triggering alarms in response to critical events, it has proved especially valuable within bathroom environments. However, deploying such a system in bathrooms faces a significant challenge: interference from running water. Similar to the human body, water droplets reflect substantial mmWave signals, presenting a major obstacle to accurate sensing. Through rigorous empirical study, we confirm that the interference caused by running water adheres to a Weibull distribution, offering insight into its behavior. Leveraging this understanding, we propose a customized Constant False Alarm Rate (CFAR) detector, specifically tailored to handle the interference from running water. This innovative detector effectively isolates human-generated signals, thus enabling accurate human detection even in the presence of running water interference. Our implementation of "Waffle" on a commercial off-the-shelf mmWave radar demonstrates exceptional sensing performance. It achieves median errors of 1.8cm and 6.9cm for human height estimation and tracking, respectively, even in the presence of running water. Furthermore, our fall detection system, built upon this technique, achieves remarkable performance (a recall of 97.2% and an accuracy of 97.8%), surpassing the state-of-the-art method.

References

[1]
Infineon Technologies AG. 2023. Infineon Official Website about mmWave radar sensors. https://www.infineon.com/cms/en/product/sensor/radar-sensors/ Accessed 6 May 2023.
[2]
Adeel Ahmad, June Chul Roh, Dan Wang, and Aish Dubey. 2018. Vital signs monitoring of multiple people using a FMCW millimeter-wave sensor. In 2018 IEEE Radar Conference (RadarConf18). IEEE, 1450--1455.
[3]
Jiaqiu Ai, Xuezhi Yang, Zhangyu Dong, Fang Zhou, Lu Jia, and Lili Hou. 2017. A new two parameter CFAR ship detector in Log-Normal clutter. In 2017 IEEE Radar Conference (RadarConf). IEEE, 0195--0199.
[4]
Sizhe An, Yin Li, and Umit Ogras. 2022. mri: Multi-modal 3d human pose estimation dataset using mmwave, rgb-d, and inertial sensors. Advances in Neural Information Processing Systems 35 (2022), 27414--27426.
[5]
Pingping Cai and Sanjib Sur. 2023. MilliPCD: Beyond Traditional Vision Indoor Point Cloud Generation via Handheld Millimeter-Wave Devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 4, Article 160 (jan 2023), 24 pages. https://doi.org/10.1145/3569497
[6]
Zhaoxin Chang, Fusang Zhang, Jie Xiong, Junqi Ma, Beihong Jin, and Daqing Zhang. 2022. Sensor-free soil moisture sensing using lora signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 2 (2022), 1--27.
[7]
Anjun Chen, Xiangyu Wang, Shaohao Zhu, Yanxu Li, Jiming Chen, and Qi Ye. 2022. mmBody benchmark: 3D body reconstruction dataset and analysis for millimeter wave radar. In Proceedings of the 30th ACM International Conference on Multimedia. 3501--3510.
[8]
Han Ding, Zhenbin Chen, Cui Zhao, Fei Wang, Ge Wang, Wei Xi, and Jizhong Zhao. 2023. MI-Mesh: 3D Human Mesh Construction by Fusing Image and Millimeter Wave. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 7, 1, Article 10 (mar 2023), 24 pages. https://doi.org/10.1145/3580861
[9]
Hao Ding, Jian Guan, Ningbo Liu, and Guoqing Wang. 2015. New spatial correlation models for sea clutter. IEEE Geoscience and Remote Sensing Letters 12, 9 (2015), 1833--1837.
[10]
Joris Domhof, Julian FP Kooij, and Dariu M Gavrila. 2021. A joint extrinsic calibration tool for radar, camera and LiDAR. IEEE Transactions on Intelligent Vehicles 6, 3 (2021), 571--582.
[11]
Shuqin Dong, Yuchen Li, Jingyun Lu, Zhi Zhang, Changzhan Gu, and Junfa Mao. 2022. Accurate detection of Doppler cardiograms with a parameterized respiratory filter technique using a K-band radar sensor. IEEE Transactions on Microwave Theory and Techniques 71, 1 (2022), 71--82.
[12]
Han Dongjuan, Tan Xiaomin, and Shi Pingyan. 2018. A cycle elimination TLM-CFAR detector for Weibull clutter. Opto-Electronic Engineering 45, 5 (2018), 170593--1.
[13]
Jerry Eaves and Edward Reedy. 2012. Principles of modern radar. Springer Science & Business Media.
[14]
Martin Ester, Hans-Peter Kriegel, Jörg Sander, Xiaowei Xu, et al. 1996. A density-based algorithm for discovering clusters in large spatial databases with noise. In kdd, Vol. 96. 226--231.
[15]
Centers for Disease Control and Prevention. 2011. Nonfatal Bathroom Injuries Among Persons Aged greater 15 Years -- United States, 2008. https://www.cdc.gov/mmwr/preview/mmwrhtml/mm6022a1.htm Accessed 9 August 2023.
[16]
Ruiyang Gao, Wenwei Li, Yaxiong Xie, Enze Yi, Leye Wang, Dan Wu, and Daqing Zhang. 2022. Towards Robust Gesture Recognition by Characterizing the Sensing Quality of WiFi Signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 1 (2022), 1--26.
[17]
Dale M Grimes and Trevor Owen Jones. 1974. Automotive radar: A brief review. Proc. IEEE 62, 6 (1974), 804--822.
[18]
Unsoo Ha, Salah Assana, and Fadel Adib. 2020. Contactless seismocardiography via deep learning radars. In Proceedings of the 26th annual international conference on mobile computing and networking. 1--14.
[19]
Marlene Harter, Tobias Mahler, Tom Schipper, Andreas Ziroff, and Thomas Zwick. 2013. 2-D antenna array geometries for MIMO radar imaging by Digital Beamforming. In 2013 European Microwave Conference. IEEE, 1695--1698.
[20]
Texas Instruments. 2023. Texas Instruments Website about mmWave Radar Sensors. https://www.ti.com/sensors/mmwave-radar/overview.html Accessed 6 May 2023.
[21]
E Jakeman and RJA Tough. 1987. Generalized K distribution: a statistical model for weak scattering. JOSA A 4, 9 (1987), 1764--1772.
[22]
Chengkun Jiang, Junchen Guo, Yuan He, Meng Jin, Shuai Li, and Yunhao Liu. 2020. mmVib: micrometer-level vibration measurement with mmwave radar. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--13.
[23]
Feng Jin, Arindam Sengupta, and Siyang Cao. 2020. mmfall: Fall detection using 4-d mmwave radar and a hybrid variational rnn autoencoder. IEEE Transactions on Automation Science and Engineering (2020).
[24]
Christina Katzlberger and DIM Gerstmair. 2018. Object Detection with Automotive Radar Sensors using CFAR Algorithms. In PhD. Disseration report. Johannes Kepler University Linz.
[25]
C Lacasse, S Karlsdóttir, G Larsen, H Soosalu, WI Rose, and GGJ Ernst. 2004. Weather radar observations of the Hekla 2000 eruption cloud, Iceland. Bulletin of Volcanology 66 (2004), 457--473.
[26]
Wanwu Li, Jixian Zhang, Lin Liu, Jiaxing Zhou, Qiaoli Sui, and Hang Li. 2021. CFAR Algorithm Based on Different Probability Models for Ocean Target Detection. IEEE Access 9 (2021), 154355--154367.
[27]
Yang Li, Dan Wu, Jie Zhang, Xuhai Xu, Yaxiong Xie, Tao Gu, and Daqing Zhang. 2022. DiverSense: Maximizing Wi-Fi Sensing Range Leveraging Signal Diversity. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 2 (2022), 1--28.
[28]
Haipeng Liu, Yuheng Wang, Anfu Zhou, Hanyue He, Wei Wang, Kunpeng Wang, Peilin Pan, Yixuan Lu, Liang Liu, and Huadong Ma. 2020. Real-time arm gesture recognition in smart home scenarios via millimeter wave sensing. Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies 4, 4 (2020), 1--28.
[29]
Haipeng Liu, Anfu Zhou, Zihe Dong, Yuyang Sun, Jiahe Zhang, Liang Liu, Huadong Ma, Jianhua Liu, and Ning Yang. 2021. M-gesture: Person-independent real-time in-air gesture recognition using commodity millimeter wave radar. IEEE Internet of Things Journal 9, 5 (2021), 3397--3415.
[30]
Feng Luo, Danting Zhang, and Bo Zhang. 2013. The fractal properties of sea clutter and their applications in maritime target detection. IEEE geoscience and remote sensing letters 10, 6 (2013), 1295--1299.
[31]
Gleb O Manokhin, Zhargal T Erdyneev, Andrey A Geltser, and Evgeny A Monastyrev. 2015. MUSIC-based algorithm for range-azimuth FMCW radar data processing without estimating number of targets. In 2015 IEEE 15th Mediterranean Microwave Symposium (MMS). IEEE, 1--4.
[32]
Frank J Massey Jr. 1951. The Kolmogorov-Smirnov test for goodness of fit. Journal of the American statistical Association 46, 253 (1951), 68--78.
[33]
Zhen Meng, Song Fu, Jie Yan, Hongyuan Liang, Anfu Zhou, Shilin Zhu, Huadong Ma, Jianhua Liu, and Ning Yang. 2020. Gait recognition for co-existing multiple people using millimeter wave sensing. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 849--856.
[34]
MV Menon. 1963. Estimation of the shape and scale parameters of the Weibull distribution. Technometrics 5, 2 (1963), 175--182.
[35]
Sameera Palipana, Dariush Salami, Luis A Leiva, and Stephan Sigg. 2021. Pantomime: Mid-air gesture recognition with sparse millimeter-wave radar point clouds. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (2021), 1--27.
[36]
Jacopo Pegoraro and Michele Rossi. 2021. Real-time people tracking and identification from sparse mm-wave radar point-clouds. IEEE Access 9 (2021), 78504--78520.
[37]
S Unnikrishna Pillai. 2012. Array signal processing. Springer Science & Business Media.
[38]
RAFI Ravid and NADAV Levanon. 1992. Maximum-likelihood CFAR for Weibull background. In IEE Proceedings F (Radar and Signal Processing), Vol. 139. IET, 256--264.
[39]
Yili Ren, Zi Wang, Sheng Tan, Yingying Chen, and Jie Yang. 2021. Winect: 3D human pose tracking for free-form activity using commodity WiFi. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 4 (2021), 1--29.
[40]
Mark A Richards. 2014. Fundamentals of radar signal processing. McGraw-Hill Education.
[41]
RE Rinehart and ET Garvey. 1978. Three-dimensional storm motion detection by conventional weather radar. Nature 273, 5660 (1978), 287--289.
[42]
Horst Rinne. 2008. The Weibull distribution: a handbook. CRC press.
[43]
Frank C Robey, Scott Coutts, Dennis Weikle, Jeffrey C McHarg, and Kevin Cuomo. 2004. MIMO radar theory and experimental results. In Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004., Vol. 1. IEEE, 300--304.
[44]
Laurence Z Rubenstein. 2006. Falls in older people: epidemiology, risk factors and strategies for prevention. Age and ageing 35, suppl_2 (2006), ii37--ii41.
[45]
Arindam Sengupta, Feng Jin, Renyuan Zhang, and Siyang Cao. 2020. mm-Pose: Real-time human skeletal posture estimation using mmWave radars and CNNs. IEEE Sensors Journal 20, 17 (2020), 10032--10044.
[46]
Muhammad Shahzad and Shaohu Zhang. 2018. Augmenting user identification with WiFi based gesture recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3 (2018), 1--27.
[47]
Akash Deep Singh, Sandeep Singh Sandha, Luis Garcia, and Mani Srivastava. 2019. Radhar: Human activity recognition from point clouds generated through a millimeter-wave radar. In Proceedings of the 3rd ACM Workshop on Millimeter-wave Networks and Sensing Systems. 51--56.
[48]
Judy A Stevens, Elizabeth N Haas, and Tadesse Haileyesus. 2011. Nonfatal Bathroom Injuries Among Persons Aged greater 15 Years---United States, 2008. Journal of safety research 42, 4 (2011), 311--315.
[49]
Shunqiao Sun, Athina P Petropulu, and H Vincent Poor. 2020. MIMO radar for advanced driver-assistance systems and autonomous driving: Advantages and challenges. IEEE Signal Processing Magazine 37, 4 (2020), 98--117.
[50]
Calterh Semiconductor Technology. 2017. Calterh Semiconductor Technology's Official Website. (2017). Accessed 12 May 2022. https://www.calterah.com/.
[51]
Yonglong Tian, Guang-He Lee, Hao He, Chen-Yu Hsu, and Dina Katabi. 2018. RF-based fall monitoring using convolutional neural networks. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3 (2018), 1--24.
[52]
Faruk Uysal and Sasanka Sanka. 2018. Mitigation of automotive radar interference. In 2018 IEEE Radar Conference (RadarConf18). IEEE, 0405--0410.
[53]
Harry L Van Trees. 2004. Detection, estimation, and modulation theory, part I: detection, estimation, and linear modulation theory. John Wiley & Sons.
[54]
Chuyu Wang, Jian Liu, Yingying Chen, Lei Xie, Hong Bo Liu, and Sanclu Lu. 2018. RF-Kinect: A Wearable RFID-Based Approach Towards 3D Body Movement Tracking. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2, 1, Article 41 (mar 2018), 28 pages. https://doi.org/10.1145/3191773
[55]
Chuyu Wang, Lei Xie, Yuancan Lin, Wei Wang, Yingying Chen, Yanling Bu, Kai Zhang, and Sanglu Lu. 2022. Thru-the-Wall Eavesdropping on Loudspeakers via RFID by Capturing Sub-Mm Level Vibration. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 4, Article 182 (dec 2022), 25 pages. https://doi.org/10.1145/3494975
[56]
Hao Wang, Daqing Zhang, Junyi Ma, Yasha Wang, Yuxiang Wang, Dan Wu, Tao Gu, and Bing Xie. 2016. Human respiration detection with commodity wifi devices: do user location and body orientation matter?. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 25--36.
[57]
Hao Wang, Daqing Zhang, Yasha Wang, Junyi Ma, Yuxiang Wang, and Shengjie Li. 2016. RT-Fall: A real-time and contactless fall detection system with commodity WiFi devices. IEEE Transactions on Mobile Computing 16, 2 (2016), 511--526.
[58]
Shuai Wang, Dongjiang Cao, Ruofeng Liu, Wenchao Jiang, Tianshun Yao, and Chris Xiaoxuan Lu. 2023. Human Parsing with Joint Learning for Dynamic mmWave Radar Point Cloud. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 1 (2023), 1--22.
[59]
Keith D Ward, Simon Watts, and Robert JA Tough. 2006. Sea clutter: scattering, the K distribution and radar performance. Vol. 20. IET.
[60]
Yaxiong Xie, Jie Xiong, Mo Li, and Kyle Jamieson. 2019. mD-Track: Leveraging multi-dimensionality for passive indoor Wi-Fi tracking. In The 25th Annual International Conference on Mobile Computing and Networking. 1--16.
[61]
Hongfei Xue, Yan Ju, Chenglin Miao, Yijiang Wang, Shiyang Wang, Aidong Zhang, and Lu Su. 2021. mmMesh: Towards 3D real-time dynamic human mesh construction using millimeter-wave. In Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services. 269--282.
[62]
Youwei Zeng, Jinyi Liu, Jie Xiong, Zhaopeng Liu, Dan Wu, and Daqing Zhang. 2021. Exploring multiple antennas for long-range WiFi sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 4 (2021), 1--30.
[63]
DT Zhang and F Luo. 2011. A new detecting method for weak targets in sea clutter based on multifractal properties. In Proceedings of 2011 IEEE CIE international conference on Radar, Vol. 1. IEEE, 446--449.
[64]
Duo Zhang, Xusheng Zhang, Shengjie Li, Yaxiong Xie, Yang Li, Xuanzhi Wang, and Daqing Zhang. 2023. LT-Fall: The Design and Implementation of a Life-threatening Fall Detection and Alarming System. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 7, 1 (2023), 1--24.
[65]
Fusang Zhang, Zhaoxin Chang, Kai Niu, Jie Xiong, Beihong Jin, Qin Lv, and Daqing Zhang. 2020. Exploring lora for long-range through-wall sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 2 (2020), 1--27.
[66]
Fusang Zhang, Zhaoxin Chang, Jie Xiong, Junqi Ma, Jiazhi Ni, Wenbo Zhang, Beihong Jin, and Daqing Zhang. 2023. Embracing Consumer-level UWB-equipped Devices for Fine-grained Wireless Sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 4 (2023), 1--27.
[67]
Fusang Zhang, Jie Xiong, Zhaoxin Chang, Junqi Ma, and Daqing Zhang. 2022. Mobi2Sense: empowering wireless sensing with mobility. In Proceedings of the 28th Annual International Conference on Mobile Computing And Networking. 268--281.
[68]
Peijun Zhao, Chris Xiaoxuan Lu, Jianan Wang, Changhao Chen, Wei Wang, Niki Trigoni, and Andrew Markham. 2019. mid: Tracking and identifying people with millimeter wave radar. In 2019 15th International Conference on Distributed Computing in Sensor Systems (DCOSS). IEEE, 33--40.
[69]
Taohua Zhou, Mengmeng Yang, Kun Jiang, Henry Wong, and Diange Yang. 2020. MMW radar-based technologies in autonomous driving: A review. Sensors 20, 24 (2020), 7283.
[70]
Zhi-Hua Zhou. 2021. Machine learning. Springer Nature.

Cited By

View all
  • (2024)Predicting Multi-dimensional Surgical Outcomes with Multi-modal Mobile SensingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596288:2(1-30)Online publication date: 15-May-2024
  • (2024)PRECYSE: Predicting Cybersickness using Transformer for Multimodal Time-Series Sensor DataProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595948:2(1-24)Online publication date: 15-May-2024
  • (2024)Body-Area Capacitive or Electric Field Sensing for Human Activity Recognition and Human-Computer InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435558:1(1-49)Online publication date: 6-Mar-2024
  • Show More Cited By

Index Terms

  1. Waffle: A Waterproof mmWave-based Human Sensing System inside Bathrooms with Running Water

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
      Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 7, Issue 4
      December 2023
      1613 pages
      EISSN:2474-9567
      DOI:10.1145/3640795
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 12 January 2024
      Published in IMWUT Volume 7, Issue 4

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Bathroom
      2. Fall Detection
      3. Radar Point cloud
      4. Target Detection
      5. mmWave Radar Sensing

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Funding Sources

      • NSFC A3 Project
      • PKU-NTU Collaboration Project

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)420
      • Downloads (Last 6 weeks)31
      Reflects downloads up to 13 Sep 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Predicting Multi-dimensional Surgical Outcomes with Multi-modal Mobile SensingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596288:2(1-30)Online publication date: 15-May-2024
      • (2024)PRECYSE: Predicting Cybersickness using Transformer for Multimodal Time-Series Sensor DataProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595948:2(1-24)Online publication date: 15-May-2024
      • (2024)Body-Area Capacitive or Electric Field Sensing for Human Activity Recognition and Human-Computer InteractionProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435558:1(1-49)Online publication date: 6-Mar-2024
      • (2024)MSense: Boosting Wireless Sensing Capability Under Motion InterferenceProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3649350(108-123)Online publication date: 29-May-2024
      • (2024)I Know This Looks Bad, But I Can Explain: Understanding When AI Should Explain Actions In Human-AI TeamsACM Transactions on Interactive Intelligent Systems10.1145/363547414:1(1-23)Online publication date: 5-Feb-2024
      • (2024)LiqDetectorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314437:4(1-24)Online publication date: 12-Jan-2024
      • (2024)LoCalProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314367:4(1-27)Online publication date: 12-Jan-2024

      View Options

      Get Access

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media