Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

V2iFi: in-Vehicle Vital Sign Monitoring via Compact RF Sensing

Published: 15 June 2020 Publication History

Abstract

Given the significant amount of time people spend in vehicles, health issues under driving condition have become a major concern. Such issues may vary from fatigue, asthma, stroke, to even heart attack, yet they can be adequately indicated by vital signs and abnormal activities. Therefore, in-vehicle vital sign monitoring can help us predict and hence prevent these issues. Whereas existing sensor-based (including camera) methods could be used to detect these indicators, privacy concern and system complexity both call for a convenient yet effective and robust alternative. This paper aims to develop V2iFi, an intelligent system performing monitoring tasks using a COTS impulse radio mounted on the windshield. V2iFi is capable of reliably detecting driver's vital signs under driving condition and with the presence of passengers, thus allowing for potentially inferring corresponding health issues. Compared with prior work based on Wi-Fi CSI, V2iFi is able to distinguish reflected signals from multiple users, and hence provide finer-grained measurements under more realistic settings. We evaluate V2iFi both in lab environments and during real-life road tests; the results demonstrate that respiratory rate, heart rate, and heart rate variability can all be estimated accurately. Based on these estimation results, we further discuss how machine learning models can be applied on top of V2iFi so as to improve both physiological and psychological wellbeing in driving environments.

References

[1]
Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C Miller. 2014. 3D Tracking via Body Radio Reflections. In Proc. of the 10th USENIX NSDI. 317--329.
[2]
Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2015. Smart Homes That Monitor Breathing and Heart Rate. In Proc. of the 33rd ACM CHI. 837--846.
[3]
Muhammad Awais, Nasreen Badruddin, and Micheal Drieberg. 2017. A Hybrid Approach to Detect Driver Drowsiness Utilizing Physiological Signals to Improve System Performance and Wearability. Sensors 17, 9 (2017), 1991.
[4]
Amerjeet S Banning and G Andre Ng. 2012. Driving and Arrhythmia: A Review of Scientific Basis for International Guidelines. European Heart Journal 34, 3 (2012), 236--244.
[5]
Thomas Benichou, Bruno Pereira, Martial Mermillod, Igor Tauveron, Daniela Pfabigan, Salwan Maqdasy, and Frederic Dutheil. 2018. Heart Rate Variability in Type 2 Diabetes Mellitus: A Systematic Review and Meta-Analysis. PLOS One 13, 4 (2018), e0195166.
[6]
Svante Björklund, Anders Nelander, and Mats I Pettersson. 2015. Fast-Time and Slow-Time Space-Time Adaptive Processing for Bistatic Radar Interference Suppression. In 2015 IEEE Radar Conference (Radarcon). 0674--0678.
[7]
BMW AG. 2019. Smartsenior: Intelligente Dienste Und Dienstleistungen Für Senioren. http://www1.smart-senior.de/pdf/presse/SmartSenior_CeBIT_Partnerflyer_BMW_DE_EN_2012_final.pdf. Accessed: 2019-10-09.
[8]
Stephen Boyd, Neal Parikh, Eric Chu, Borja Peleato, Jonathan Eckstein, et al. 2011. Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers. Foundations and Trends® in Machine learning 3, 1 (2011), 1--122.
[9]
Karel A Brookhuis and Dick de Waard. 2010. Monitoring Drivers' Mental Workload in Driving Simulators using Physiological Measures. Accident Analysis & Prevention 42, 3 (2010), 898--903.
[10]
JR Catterall, PMA Calverley, V Brezinova, NJ Douglas, HM Brash, CM Shapiro, and DC Flenley. 1982. Irregular Breathing and Hypoxaemia During Sleep in Chronic Stable Asthma. The Lancet 319, 8267 (1982), 301--304.
[11]
John A Chalmers, Daniel S Quintana, Maree J Abbott, Andrew H Kemp, et al. 2014. Anxiety Disorders Are Associated with Reduced Heart Rate Variability: A Meta-Analysis. Frontiers in Psychiatry 5 (2014), 80.
[12]
Hyunggi Cho, Young-Woo Seo, BVK Vijaya Kumar, and Ragunathan Raj Rajkumar. 2014. A Multi-Sensor Fusion System for Moving Object Detection and Tracking in Urban Driving Environments. In IEEE International Conference on Robotics and Automation (ICRA). 1836--1843.
[13]
Eric Chern-Pin Chua, Wen-Qi Tan, Sing-Chen Yeo, Pauline Lau, Ivan Lee, Ivan Ho Mien, Kathiravelu Puvanendran, and Joshua J. Gooley. 2012. Heart Rate Variability Can Be Used to Estimate Sleepiness-related Decrements in Psychomotor Vigilance during Total Sleep Deprivation. Sleep 35, 3 (03 2012), 325--334.
[14]
Vivian L Clark and James A Kruse. 1990. Clinical Methods: The History, Physical, and Laboratory Examinations. Jama 264, 21 (1990), 2808--2809.
[15]
Michelle A Cretikos, Rinaldo Bellomo, Ken Hillman, Jack Chen, Simon Finfer, and Arthas Flabouris. 2008. Respiratory Rate: The Neglected Vital Sign. Medical Journal of Australia 188, 11 (2008), 657--659.
[16]
Dirk Cysarz, Silke Lange, Peter F Matthiessen, and Peter van Leeuwen. 2007. Regular Heartbeat Dynamics Are Associated with Cardiac Health. Am. J. Physiol 292, 1 (2007), R368-R372.
[17]
Daimler AG. 2019. Attention Assist: Drowsiness-Detection System Warns Drivers to Prevent Them Falling Asleep Momentarily -Daimler Global Media Site. https://media.daimler.com/marsMediaSite/en/instance/ko/ATTENTION-ASSIST-Drowsiness-detection-system-warns-drivers-to-prevent-them-falling-asleep-momentarily.xhtml?oid=9361586. Accessed: 2019-10-09.
[18]
Chacko John Deepu, Zhihao Chen, Ju Teng Teo, Soon Huat Ng, Xiefeng Yang, and Yong Lian. 2012. A Smart Cushion for Real-Time Heart Rate Monitoring. In 2012 IEEE Biomedical Circuits and Systems Conference. 53--56.
[19]
Jason P DePasquale, E Scott Geller, Steven W Clarke, and Lawrence C Littleton. 2001. Measuring Road Rage: Development of The Propensity for Angry Driving Scale. J. Saf. Res. 32, 1 (2001), 1--16.
[20]
Konstantin Dragomiretskiy and Dominique Zosso. 2013. Variational Mode Decomposition. IEEE Transactions on Signal Processing 62, 3 (2013), 531--544.
[21]
Malcolm Elliott and Alysia Coventry. 2012. Critical Care: the Eight Vital Signs of Patient Monitoring. British Journal of Nursing 21, 10 (2012), 621--625.
[22]
Sigrid Elsenbruch, Michael J Harnish, and William C Orr. 1999. Heart Rate Variability During Waking and Sleep in Healthy Males and Females. Sleep 22, 8 (1999), 1067--1071.
[23]
Martin Eriksson and Nikolaos P Papanikotopoulos. 1997. Eye-Tracking for Detection of Driver Fatigue. In Proc. of Conference on Intelligent Transportation Systems. 314--319.
[24]
Gernot Ernst. 2017. Heart-Rate Variability-More than Heart Beats? Frontiers in Public Health 5 (2017), 240.
[25]
John F Fieselmann, Michael S Hendryx, Charles M Helms, and Douglas S Wakefield. 1993. Respiratory Rate Predicts Cardiopulmonary Arrest for Internal Medicine Inpatients. Journal of General Internal Medicine 8, 7 (1993), 354--360.
[26]
Diane Flatley, LA Reyner, and James A Horne. 2004. Sleep-Related Crashes on Sections of Different Road Types in the UK (1995-2001). Road Safety United States Naval School of Aviation Medicine 52 (2004).
[27]
Koichi Fujiwara, Erika Abe, Keisuke Kamata, Chikao Nakayama, Yoko Suzuki, Toshitaka Yamakawa, Toshihiro Hiraoka, Manabu Kano, Yukiyoshi Sumi, Fumi Masuda, et al. 2018. Heart Rate Variability-Based Driver Drowsiness Detection and its Validation with EEG. IEEE Transactions on Biomedical Engineering 66, 6 (2018), 1769--1778.
[28]
Nicholas D Giardino, Seth D Friedman, and Stephen R Dager. 2007. Anxiety, Respiration, and Cerebral Blood Flow: Implications for Functional Brain Imaging. Comprehensive Psychiatry 48, 2 (2007), 103--112.
[29]
Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2011. Tool Release: Gathering 802.11n Traces with Channel State Information. ACM SIGCOMM Computer Communication Review 41, 1 (2011), 53.
[30]
Sinh Huynh, Rajesh Krishna Balan, JeongGil Ko, and Youngki Lee. 2019. VitaMon: Measuring Heart Rate Variability Using Smartphone Front Camera. In Proc. of the 17th ACM Sensys. 1--14.
[31]
P Jackson, C Hilditch, A Holmes, N Reed, N Merat, and L Smith. 2011. Fatigue and Road Safety: A Critical Analysis of Recent Evidence. Department for Transport, Road Safety Web Publication 21 (2011).
[32]
Wenjia Jia, Hongjian Peng, Na Ruan, Zhiping Tang, and Wei Zhao. 2018. WiFind: Driver Fatigue Detection with Fine-Grained Wi-Fi Signal Features. IEEE Transactions on Big Data (2018), 1--14.
[33]
Sang-Ho Jo, Jin-Myung Kim, and Dong Kyoo Kim. 2019. Heart Rate Change While Drowsy Driving. Journal of Korean Medical Science 34, 8 (2019).
[34]
Seong Kyu Leem, Faheem Khan, and Sung Ho Cho. 2017. Vital Sign Monitoring and Mobile Phone Usage Detection Using IR-UWB Radar for Intended Use in Car Crash Prevention. Sensors (2017).
[35]
Gang Li, Boon-Leng Lee, and Wan-Young Chung. 2015. Smartwatch-based Wearable EEG System for Driver Drowsiness Detection. IEEE Sensors Journal 15, 12 (2015), 7169--7180.
[36]
Xiang Li, Daqing Zhang, Qin Lv, Jie Xiong, Shengjie Li, Yue Zhang, and Hong Mei. 2017. IndoTrack: Device-Free Indoor Human Tracking with Commodity Wi-Fi. Proc. of the 17th ACM UbiComp 1, 3 (2017), 72.
[37]
H-O Lisper, Hans Laurell, and G Stening. 1973. Effects of Experience of The Driver on Heart-Rate, Respiration-Rate, and Subsidiary Reaction Time in A Three Hours Continuous Driving Task. Ergonomics 16, 4 (1973), 501--506.
[38]
Mohamed Faisal Lutfi. 2015. Patterns of Heart Rate Variability and Cardiac Autonomic Modulations in Controlled and Uncontrolled Asthmatic Patients. BMC Pulmonary Medicine 15, 1 (2015), 119.
[39]
Zahra Mardi, Seyedeh Naghmeh Miri Ashtiani, and Mohammad Mikaili. 2011. EEG-Based Drowsiness Detection for Safe Driving Using Chaotic Features and Statistical Tests. Journal of Medical Signals and Sensors 1, 2 (2011), 130.
[40]
Hermann Nabi, Martica Hall, Markku Koskenvuo, Archana Singh-Manoux, Tuula Oksanen, Sakari Suominen, Mika Kivimäki, and Jussi Vahtera. 2010. Psychological and Somatic Symptoms of Anxiety and Risk of Coronary Heart Disease: the Health and Social Support Prospective Cohort Study. Biological Psychiatry 67, 4 (2010), 378--385.
[41]
Novelda AS. 2017. Single-Chip Radar Sensors with Sub-mm Resolution - XETHRU. https://www.xethru.com/. Accessed: 2019-10-03.
[42]
Novelda AS. 2017. XETHRU Sensor Emissions: An In-Depth Look at Radar Safety Regulations. https://www.xethru.com/blog/posts/xethru-radar-emission-comparison. Accessed: 2019-10-03.
[43]
Mikito Ogino and Yasue Mitsukura. 2018. Portable Drowsiness Detection Through Use of A Prefrontal Single-Channel Electroencephalogram. Sensors 18, 12 (2018), 4477.
[44]
Jin-Kwan Park, Yunseog Hong, Hyunjae Lee, Chorom Jang, Gi-Ho Yun, Hee-Jo Lee, and Jong-Gwan Yook. 2019. Noncontact RF Vital Sign Sensor for Continuous Monitoring of Driver Status. IEEE Transactions on Biomedical Circuits and Systems 13, 3 (2019), 493--502.
[45]
Eduardo Pinheiro, Octavian Postolache, and Pedro Girão. 2010. Theory and Developments in An Unobtrusive Cardiovascular System Representation: Ballistocardiography. The Open Biomedical Engineering Journal 4 (2010), 201.
[46]
Harold R Raemer. 1996. Radar Systems Principles. CRC press.
[47]
Raspberry Pi Foundation. 2019. Teach, Learn and Make with Raspberry Pi - Raspberry Pi. https://https://www.raspberrypi.org/. Accessed: 2019-10-03.
[48]
Francesco Sessa, Valenzano Anna, Giovanni Messina, Giuseppe Cibelli, Vincenzo Monda, Gabriella Marsala, Maria Ruberto, Antonio Biondi, Orazio Cascio, Giuseppe Bertozzi, et al. 2018. Heart Rate Variability As Predictive Factor for Sudden Cardiac Death. Aging (Albany NY) 10, 2 (2018), 166.
[49]
Fred Shaffer and JP Ginsberg. 2017. An Overview of Heart Rate Variability Metrics and Norms. Frontiers in Public Health 5 (2017), 258.
[50]
Fred Shaffer, Rollin McCraty, and Christopher L Zerr. 2014. A Healthy Heart Is Not A Metronome: An Integrative Review of the Heart's Anatomy and Heart Rate Variability. Frontiers in Psychology 5 (2014), 1040.
[51]
Anupriya Sharma, NB Hirulkar, and Payal Ranka. 2011. Effect of Hyperglycemia on Electrolytes Imbalance. Int J Pharm Biol Arch 2 (2011), 526--33.
[52]
José Solaz, José Laparra-Hernández, Daniel Bande, Noelia Rodríguez, Sergio Veleff, José Gerpe, and Enrique Medina. 2016. Drowsiness Detection Based on the Analysis of Breathing Rate Obtained from Real-Time Image Recognition. Transportation Research Procedia 14 (2016), 3867--3876.
[53]
Richard Strauß, Santiago Ewig, Klaus Richter, Thomas König, Günther Heller, and Torsten T Bauer. 2014. The Prognostic Significance of Respiratory Rate in Patients with Pneumonia: A Retrospective Analysis of Data from 705 928 Hospitalized Patients in Germany from 2010-2012. Deutsches Ärzteblatt International 111, 29-30 (2014), 503.
[54]
Thomas J Sullivan, Stephen R Deiss, and Gert Cauwenberghs. 2007. A Low-Noise, Non-Contact EEG/ECG Sensor. In 2007 IEEE Biomedical Circuits and Systems Conference. 154--157.
[55]
John L Troutman. 2012. Variational Calculus and Optimal Control: Optimization with Elementary Convexity. Springer Science & Business Media.
[56]
Mihoko Tsunoda, Takuro Endo, Satoko Hashimoto, Sato Honma, and Ken-Ichi Honma. 2001. Effects of Light and Sleep Stages on Heart Rate Variability in Humans. Psychiatry and Clinical Neurosciences 55, 3 (2001), 285--286.
[57]
Volvo Group. 2019. Driver Alert System. https://www.volvocars.com/en-th/support/manuals/s60/2014/driver-support/driver-alert-system/driver-alert-control-dac---operation. Accessed: 2019-10-09.
[58]
Chuyu Wang, Lei Xie, Wei Wang, Yingying Chen, Yanling Bu, and Sanglu Lu. 2018. RF-ECG: Heart Rate Variability Assessment Based on COTS RFID Tag Array. Proc. of the 17th ACM UbiComp 2, 2 (2018), 85.
[59]
Tianben Wang, Daqing Zhang, Yuanqing Zheng, Tao Gu, Xingshe Zhou, and Bernadette Dorizzi. 2018. C-FMCW Based Contactless Respiration Detection Using Acoustic Signal. Proc. of the 17th ACM UbiComp 1, 4 (2018), 170.
[60]
WS Waring, JY Rhee, DN Bateman, GE Leggett, and H Jamie. 2008. Impaired Heart Rate Variability and Altered Cardiac Sympathovagal Balance After Antidepressant Overdose. European Journal of Clinical Pharmacology 64, 11 (2008), 1037--1041.
[61]
Dan Wu, Daqing Zhang, Chenren Xu, Hao Wang, and Xiang Li. 2017. Device-Free WiFi Human Sensing: From Pattern-Based to Model-Based Approaches. IEEE Communications Magazine 55, 10 (2017), 91--97.
[62]
Xiangyu Xu, Jiadi Yu, Yingying Chen, Yanmin Zhu, Linghe Kong, and Minglu Li. 2019. BreathListener: Fine-Grained Breathing Monitoring in Driving Environments Utilizing Acoustic Signals. In Proc. of the 17th ACM MobiSys. 54--66.
[63]
Youwei Zeng, Dan Wu, Ruiyang Gao, Tao Gu, and Daqing Zhang. 2018. FullBreathe: Full Human Respiration Detection Exploiting Complementarity of CSI Phase and Amplitude of WiFi Signals. Proc. of the 18th ACM UbiComp 2, 3 (2018), 148.
[64]
Jin Zhang, Weitao Xu, Wen Hu, and Salil S Kanhere. 2017. WiCare: Towards In-Situ Breath Monitoring. In Proc. of the 14th ACM MobiQuitous. ACM, 126--135.
[65]
Mingmin Zhao, Fadel Adib, and Dina Katabi. 2016. Emotion Recognition Using Wireless Signals. In Proc. of the 22nd ACM MobiCom. 95--108.

Cited By

View all
  • (2025)A Survey on WiFi-based Human Identification: Scenarios, Challenges, and Current SolutionsACM Transactions on Sensor Networks10.1145/370832321:1(1-32)Online publication date: 27-Jan-2025
  • (2025)Heart Rate Variability Estimation Based on RFID Tag-Pair in Dynamic EnvironmentsACM Transactions on Computing for Healthcare10.1145/36913556:1(1-26)Online publication date: 23-Jan-2025
  • (2025)Echoes of Fingertip: Unveiling POS Terminal Passwords Through Wi-Fi Beamforming FeedbackIEEE Transactions on Mobile Computing10.1109/TMC.2024.346556424:2(662-676)Online publication date: Feb-2025
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 4, Issue 2
June 2020
771 pages
EISSN:2474-9567
DOI:10.1145/3406789
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 June 2020
Published in IMWUT Volume 4, Issue 2

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Impulse Radio
  2. In-Vehicle Health Monitoring
  3. Ultra Wideband
  4. Vital Signs

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)282
  • Downloads (Last 6 weeks)26
Reflects downloads up to 23 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)A Survey on WiFi-based Human Identification: Scenarios, Challenges, and Current SolutionsACM Transactions on Sensor Networks10.1145/370832321:1(1-32)Online publication date: 27-Jan-2025
  • (2025)Heart Rate Variability Estimation Based on RFID Tag-Pair in Dynamic EnvironmentsACM Transactions on Computing for Healthcare10.1145/36913556:1(1-26)Online publication date: 23-Jan-2025
  • (2025)Echoes of Fingertip: Unveiling POS Terminal Passwords Through Wi-Fi Beamforming FeedbackIEEE Transactions on Mobile Computing10.1109/TMC.2024.346556424:2(662-676)Online publication date: Feb-2025
  • (2025) mmTAA : A Contact-Less Thoracoabdominal Asynchrony Measurement System Based on mmWave Sensing IEEE Transactions on Mobile Computing10.1109/TMC.2024.346178424:2(627-641)Online publication date: Feb-2025
  • (2024)π-jackProceedings of the 33rd USENIX Conference on Security Symposium10.5555/3698900.3699309(7321-7338)Online publication date: 14-Aug-2024
  • (2024)Innovative Seatbelt-Integrated Metasurface Radar for Enhanced In-Car Healthcare MonitoringSensors10.3390/s2423749424:23(7494)Online publication date: 24-Nov-2024
  • (2024)Ship Bridge OOW Activity Status Detection Using Wi-Fi Beamforming Feedback InformationJournal of Marine Science and Engineering10.3390/jmse1206087212:6(872)Online publication date: 24-May-2024
  • (2024)Fusion-vitalProceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence and Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence and Fourteenth Symposium on Educational Advances in Artificial Intelligence10.1609/aaai.v38i2.27898(1344-1352)Online publication date: 20-Feb-2024
  • (2024)Road Rage Identification and Real-Time Monitoring: Technological Advances and ChallengesAdvances in Psychology10.12677/ap.2024.14856714:08(447-460)Online publication date: 2024
  • (2024)MmECare: Enabling Fine-grained Vital Sign Monitoring for Emergency Care with Handheld MmWave RadarsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36997668:4(1-24)Online publication date: 21-Nov-2024
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media