research-article

Smartphone Sonar-Based Contact-Free Respiration Rate Monitoring

Authors:

Shiwen MaoAuthors Info & Claims

ACM Transactions on Computing for Healthcare , Volume 2, Issue 2

Article No.: 15, Pages 1 - 26

https://doi.org/10.1145/3436822

Published: 09 February 2021 Publication History

Abstract

Vital sign (e.g., respiration rate) monitoring has become increasingly more important because it offers useful clues about medical conditions such as sleep disorders. There is a compelling need for technologies that enable contact-free and easy deployment of vital sign monitoring over an extended period of time for healthcare. In this article, we present a SonarBeat system to leverage a phase-based active sonar to monitor respiration rates with smartphones. We provide a sonar phase analysis and discuss the technical challenges for respiration rate estimation utilizing an inaudible sound signal. Moreover, we design and implement the SonarBeat system, with components including signal generation, data extraction, received signal preprocessing, and breathing rate estimation with Android smartphones. Our extensive experimental results validate the superior performance of SonarBeat in different indoor environment settings.

References

[1]

Heba Abdelnasser, Khaled A. Harras, and Moustafa Youssef. 2015. Ubibreathe: A ubiquitous non-invasive WiFi-based breathing estimator. In the ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc’15). 277--286.

[2]

Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C. Miller. 2015. Smart homes that monitor breathing and heart rate. In the ACM CHI Conference on Human Factors in Computing Systems (CHI’15). 837--846.

[3]

Heba Aly and Moustafa Youssef. 2016. Zephyr: Ubiquitous accurate multi-sensor fusion-based respiratory rate estimation using smartphones. In the IEEE International Conference on Computer Communications (INFOCOM’16). 1--9.

[4]

Inci M. Baytas, Kaixiang Lin, Fei Wang, Anil K. Jain, and Jiayu Zhou. 2016. PhenoTree: Interactive visual analytics for hierarchical phenotyping from large-scale electronic health records. IEEE Trans. Multimedia 18, 11 (Nov. 2016), 2257--2270.

[5]

Edgar A. Bernal, Xitong Yang, Qun Li, Jayant Kumar, Sriganesh Madhvanath, Palghat Ramesh, and Raja Bala. 2018. Deep temporal multimodal fusion for medical procedure monitoring using wearable sensors. IEEE Trans. Multimedia 20, 1 (2018), 107--118.

Digital Library

[6]

Sergio Cicalo, Matteo Mazzotti, Simone Moretti, Velio Tralli, and Marco Chiani. 2016. Multiple video delivery in m-health emergency applications. IEEE Trans. Multimedia 18, 10 (Oct. 2016), 1988--2001.

[7]

Charalampos A. Dimoulas. 2016. Audiovisual spatial-audio analysis by means of sound localization and imaging: A multimedia healthcare framework in abdominal sound mapping. IEEE Trans. Multimedia 18, 10 (Oct. 2016), 1969--1976.

[8]

Amy Droitcour, Victor Lubecke, Jenshan Lin, and Olga Boric-Lubecke. 2001. A microwave radio for Doppler radar sensing of vital signs. In Proc. 2001 IEEE MTT-S International Microwave Symposium Digest (Cat. No. 01CH37157). 175--178.

[9]

Amy D. Droitcour, Olga Boric-Lubecke, and Gregory T. A. Kovacs. 2009. Signal-to-noise ratio in Doppler radar system for heart and respiratory rate measurements. IEEE Trans. Microw. Theory Technol. 57, 10 (Oct. 2009), 2498--2507.

[10]

Biying Fu, Jakob Karolus, Tobias Grosse-Puppendahl, Jonathan Hermann, and Arjan Kuijper. 2015. Opportunities for activity recognition using ultrasound doppler sensing on unmodified mobile phones. In Proc. 2nd International Workshop on Sensor-Based Activity Recognition and Interaction. ACM, 8:1--8:10.

Digital Library

[11]

Pedro Henriquez, Bogdan J. Matuszewski, Yasmina Andreu-Cabedo, Luca Bastiani, Sara Colantonio, Giuseppe Coppini, Mario D’Acunto, Riccardo Favilla, Danila Germanese, Daniela Giorgi, et al. 2017. Mirror mirror on the wall... an unobtrusive intelligent multisensory mirror for well-being status self-assessment and visualization. IEEE Trans. Multimedia 19, 7 (July 2017), 1467--1481.

[12]

Carl E. Hunt and Fern R. Hauck. 2006. Sudden infant death syndrome. Can. Med. Assoc. J 174, 13 (April 2006), 1309--1310.

[13]

S. M. Riazul Islam, Daehan Kwak, M. D. Humaun Kabir, Mahmud Hossain, and Kyung-Sup Kwak. 2015. The Internet of Things for health care: A comprehensive survey. IEEE Access 3 (June 2015), 678--708.

[14]

Fan Li, Huijie Chen, Xiaoyu Song, Qian Zhang, Youqi Li, and Yu Wang. 2017. CondioSense: High-quality context-aware service for audio sensing system via active sonar. Personal Ubiquitous Comput. 22, 1 (Feb. 2017), 17--29.

[15]

Jian Liu, Yan Wang, Yinging Chen, Jie Yang, Xu Chen, and Jerry Cheng. 2015a. Tracking vital signs during sleep leveraging off-the-shelf WiFi. In the ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc’15). 267--276.

[16]

Jian Liu, Yan Wang, Gorkem Kar, Yingying Chen, Jie Yang, and Marco Gruteser. 2015b. Snooping keystrokes with mm-level audio ranging on a single phone. In the ACM Annual International Conference on Mobile Computing and Networking (MobiCom’15). ACM, 142--154.

[17]

V. M. Lubecke, O. Boric-Lubecke, G. Awater, P. W. Ong, P. Gammel, R. H. Yan, and J. C. Lin. 2000. Remote sensing of vital signs with telecommunications signals. In Proc. World Congress on Medical Physics and Biomedical Engineering (WC’00).

[18]

Victor Lubecke, Olga Boric-Lubecke, and Eric Beck. 2002. A compact low-cost add-on module for Doppler radar sensing of vital signs using a wireless communications terminal. In Proc. 2002 IEEE MTT-S International Microwave Symposium Digest (Cat. No. 02CH37278). 1767--1770.

[19]

Wenguang Mao, Jian He, and Lili Qiu. 2016. CAT: High-precision acoustic motion tracking. In the ACM Annual International Conference on Mobile Computing and Networking (MobiCom’16). ACM, New York, NY, 491--492.

[20]

L. Robert Mogue and Boerje Rantala. 1988. Capnometers. J. Clin. Monit. 4, 2 (April 1988), 115--121.

[21]

Frank Mokaya, Roland Lucas, Hae Young Noh, and Pei Zhang. 2016. Burnout: A wearable system for unobtrusive skeletal muscle fatigue estimation. In the 15th International Conference on Information Processing in Sensor Networks (IPSN’16). IEEE, 1--12.

[22]

Seong-Eun Moon and Jong-Seok Lee. 2017. Implicit analysis of perceptual multimedia experience based on physiological response: A review. IEEE Trans. Multimedia 19, 2 (Feb. 2017), 340--353.

[23]

Henning Müeller and Devrim Unay. 2017. Retrieval from and understanding of large-scale multi-modal medical datasets: A review. IEEE Trans. Multimedia 19, 9 (Sept. 2017), 2093--2104.

[24]

Rajalakshmi Nandakumar, Krishna Kant Chintalapudi, Venkat Padmanabhan, and Ramarathnam Venkatesan. 2013. Dhwani: Secure peer-to-peer acoustic NFC. ACM SIGCOMM Comput. Commun. Rev. 43, 4 (2013), 63--74.

Digital Library

[25]

Rajalakshmi Nandakumar and Shyamnath Gollakota. 2017. Unleashing the power of active sonar. IEEE Pervasive Comput. 16, 1 (2017), 11--15.

Digital Library

[26]

Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. 2015. Contactless sleep apnea detection on smartphones. In the 13th International Conference on Mobile Systems, Applications, and Services (MobiSys’15). ACM, 45--57.

Digital Library

[27]

Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan, and Shyamnath Gollakota. 2016. Fingerio: Using active sonar for fine-grained finger tracking. In the ACM CHI Conference on Human Factors in Computing Systems (CHI’16). ACM, 1515--1525.

[28]

Phuc Nguyen, Xinyu Zhang, Ann Halbower, and Tam Vu. 2016. Continuous and fine-grained breathing volume monitoring from afar using wireless signals. In the IEEE International Conference on Computer Communications (INFOCOM’16). 1--9.

[29]

Chen Qiu and Matt W. Mutka. 2017. Silent whistle: Effective indoor positioning with assistance from acoustic sensing on smartphones. In the 18th International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM’17). IEEE, 1--6.

[30]

Yanzhi Ren, Chen Wang, Jie Yang, and Yingying Chen. 2015. Fine-grained sleep monitoring: Hearing your breathing with smartphones. In the IEEE International Conference on Computer Communications (INFOCOM’15). 1194--1202.

[31]

Wenjie Ruan, Quan Z. Sheng, Lei Yang, Tao Gu, Peipei Xu, and Longfei Shangguan. 2016. AudioGest: Enabling fine-grained hand gesture detection by decoding echo signal. In the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp’16). ACM, 474--485.

Digital Library

[32]

Jussi Salmi and Andreas F. Molisch. 2011. Propagation parameter estimation, modeling and measurements for ultrawideband mimo radar. IEEE Trans. Microw. Theory Technol. 59, 11 (Nov. 2011), 4257--4267.

[33]

Nastaran H. Shariati and Edmond Zahedi. 2005. Comparison of selected parametric models for analysis of the photoplethysmographic signal. In Proc. 1st IEEE Conf. Comput., Commun. Signal Process. 169--172.

[34]

Dan Stowell, Dimitrios Giannoulis, Emmanouil Benetos, Mathieu Lagrange, and Mark D. Plumbley. 2015. Detection and classification of acoustic scenes and events. IEEE Trans. Multimedia 17, 10 (Oct. 2015), 1733--1746.

[35]

Junjue Wang, Kaichen Zhao, Xinyu Zhang, and Chunyi Peng. 2014. Ubiquitous keyboard for small mobile devices: Harnessing multipath fading for fine-grained keystroke localization. In the 12th International Conference on Mobile Systems, Applications, and Services (MobiSys’14). ACM, 14--27.

Digital Library

[36]

Wei Wang, Alex X. Liu, and Ke Sun. 2016. Device-free gesture tracking using acoustic signals. In the ACM Annual International Conference on Mobile Computing and Networking (MobiCom’16). ACM, New York, NY, 82--94.

[37]

Xuyu Wang, Runze Huang, and Shiwen Mao. 2017a. SonarBeat: Sonar phase for breathing beat monitoring with smartphones. In the 26th International Conference on Computer Communication and Networks (ICCCN’17). 1--8.

[38]

Xuyu Wang, Chao Yang, and Shiwen Mao. 2017b. PhaseBeat: Exploiting CSI phase data for vital sign monitoring with commodity WiFi devices. In the 37th IEEE International Conference on Distributed Computing Systems (ICDCS’17). 1--10.

[39]

Xuyu Wang, Chao Yang, and Shiwen Mao. 2017c. TensorBeat: Tensor decomposition for monitoring multi-person breathing beats with commodity WiFi. ACM Trans. Intell. Sys. Technol. 9, 1 (Sept. 2017), 8:1--8:27.

Digital Library

[40]

Xuyu Wang, Choa Yang, and Shiwen Mao. 2020. On CSI-based vital sign monitoring using commodity WiFi. ACM Trans. Comput. Healthcare 1, 3 (April 2020), 12:1--12:27.

[41]

Teng Wei and Xinyu Zhang. 2015. mTrack: High-precision passive tracking using millimeter wave radios. In the ACM Annual International Conference on Mobile Computing and Networking (MobiCom’15). ACM, 117--129.

[42]

Cheng Yang, Gene Cheung, and Vladimir Stankovic. 2017. Estimating heart rate and rhythm via 3D motion tracking in depth video. IEEE Trans. Multimedia 19, 7 (July 2017), 1625--1636.

[43]

Zhicheng Yang, Parth H. Pathak, Yunze Zeng, Xixi Liran, and Prasant Mohapatra. 2016. Monitoring vital signs using millimeter wave. In the ACM International Symposium on Mobile Ad Hoc Networking and Computing (MobiHoc’16). 211--220.

[44]

Xingliang Yuan, Xinyu Wang, Cong Wang, Jian Weng, and Kui Ren. 2016. Enabling secure and fast indexing for privacy-assured healthcare monitoring via compressive sensing. IEEE Trans. Multimedia 18, 10 (Oct. 2016), 2002--2014.

[45]

Sangki Yun, Yi-Chao Chen, and Lili Qiu. 2015. Turning a mobile device into a mouse in the air. In the 13th International Conference on Mobile Systems, Applications, and Services (MobiSys’15). 15--29.

Digital Library

[46]

Bing Zhou, Mohammed Elbadry, Ruipeng Gao, and Fan Ye. 2017. BatMapper: Acoustic sensing based indoor floor plan construction using smartphones. In the 15th International Conference on Mobile Systems, Applications, and Services (MobiSys’17). ACM, 42--55.

Cited By

Vincent KWang LJing NLiu W(2024)AcHand: Detecting Respiratory Rate of Operator Via Smartphone MicrophoneIEEE Sensors Journal10.1109/JSEN.2024.337225524:8(12946-12956)Online publication date: 15-Apr-2024
https://doi.org/10.1109/JSEN.2024.3372255
Ma KSong SAn LMao SWang X(2024)APC: Contactless healthy sitting posture monitoring with microphone arraySmart Health10.1016/j.smhl.2024.10046332(100463)Online publication date: Jun-2024
https://doi.org/10.1016/j.smhl.2024.100463
Mammen PZakaria CShenoy P(2024)Personalized Sleep Monitoring Using Smartphones and Semi-supervised LearningPervasive Computing Technologies for Healthcare10.1007/978-3-031-59717-6_22(322-338)Online publication date: 4-Jun-2024
https://doi.org/10.1007/978-3-031-59717-6_22
Show More Cited By

Index Terms

Smartphone Sonar-Based Contact-Free Respiration Rate Monitoring
1. Applied computing
  1. Life and medical sciences
    1. Health informatics
2. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile devices
      1. Smartphones

Recommendations

A realisation of ethical concerns with smartphone personal health monitoring apps
Special Issue on Ethicomp

The pervasiveness of smartphones has facilitated a new way in which owners of devices can monitor their health using applications (apps) that are installed on their smartphones. Smartphone personal health monitoring (SPHM) collects and stores health ...
A noninvasive heartbeat, respiration, and body movement monitoring system for neonates

Long-term monitoring of heart rate, respiratory rate, and body movement in neonates would be useful for preventing illnesses, such as respiratory disorders. However, currently, there is no noninvasive monitoring system available for neonates. Therefore, ...
Identifying diverse usage behaviors of smartphone apps
IMC '11: Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference

Smartphone users are increasingly shifting to using apps as "gateways" to Internet services rather than traditional web browsers. App marketplaces for iOS, Android, and Windows Phone platforms have made it attractive for developers to deploy apps and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Computing for Healthcare

ACM Transactions on Computing for Healthcare Volume 2, Issue 2

April 2021

226 pages

EISSN:2637-8051

DOI:10.1145/3446675

Editors:
Insup Lee
University of Pennsylvania, USA
,
John A. Stankovic
University of Virginia, USA

Issue’s Table of Contents

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 February 2021

Accepted: 01 November 2020

Revised: 01 October 2020

Received: 01 July 2019

Published in HEALTH Volume 2, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

NSF
Wireless Engineering Research and Education Center (WEREC) at Auburn University

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
491
Total Downloads

Downloads (Last 12 months)100
Downloads (Last 6 weeks)16

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Vincent KWang LJing NLiu W(2024)AcHand: Detecting Respiratory Rate of Operator Via Smartphone MicrophoneIEEE Sensors Journal10.1109/JSEN.2024.337225524:8(12946-12956)Online publication date: 15-Apr-2024
https://doi.org/10.1109/JSEN.2024.3372255
Ma KSong SAn LMao SWang X(2024)APC: Contactless healthy sitting posture monitoring with microphone arraySmart Health10.1016/j.smhl.2024.10046332(100463)Online publication date: Jun-2024
https://doi.org/10.1016/j.smhl.2024.100463
Mammen PZakaria CShenoy P(2024)Personalized Sleep Monitoring Using Smartphones and Semi-supervised LearningPervasive Computing Technologies for Healthcare10.1007/978-3-031-59717-6_22(322-338)Online publication date: 4-Jun-2024
https://doi.org/10.1007/978-3-031-59717-6_22
Bui TThangavel BSharipov MChen KShin J(2023)Smartphone-Based Portable Bio-Chemical Sensors: Exploring Recent AdvancementsChemosensors10.3390/chemosensors1109046811:9(468)Online publication date: 22-Aug-2023
https://doi.org/10.3390/chemosensors11090468
Ahmed TRahman MNemati EAhmed MKuang JGao A(2023)Remote Breathing Rate Tracking in Stationary Position Using the Motion and Acoustic Sensors of EarablesProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581265(1-22)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581265
Shan YLiao PWang XAn LMao S(2023)MAA: Modulation-adaptive Acoustic Gesture Recognition2023 IEEE 20th International Conference on Mobile Ad Hoc and Smart Systems (MASS)10.1109/MASS58611.2023.00016(62-70)Online publication date: 25-Sep-2023
https://doi.org/10.1109/MASS58611.2023.00016
Fang KQiu JWang TZheng KXing LMao KChi K(2023)IDRes: Identity-Based Respiration Monitoring System for Digital Twins Enabled HealthcareIEEE Journal on Selected Areas in Communications10.1109/JSAC.2023.331009541:10(3333-3348)Online publication date: 1-Oct-2023
https://dl.acm.org/doi/10.1109/JSAC.2023.3310095
Liu WChang SLi FXu YYan SLiu Y(2023)Contactless Breathing Airflow Detection on SmartphoneIEEE Internet of Things Journal10.1109/JIOT.2022.322220210:4(3428-3439)Online publication date: 15-Feb-2023
https://doi.org/10.1109/JIOT.2022.3222202
Dharangutte PXie ZGao JSchoenfeld EHua YYe F(2023)HeartInsightify: Interpreting Longitudinal Heart Rate Data for Health Insights through Conformal Clustering2023 IEEE International Conference on Bioinformatics and Biomedicine (BIBM)10.1109/BIBM58861.2023.10385567(4289-4296)Online publication date: 5-Dec-2023
https://doi.org/10.1109/BIBM58861.2023.10385567
Mammen PZakaria CShenoy P(2023)SleepLess: personalized sleep monitoring using smartphones and semi-supervised learningCSI Transactions on ICT10.1007/s40012-023-00389-811:4(203-219)Online publication date: 16-Nov-2023
https://doi.org/10.1007/s40012-023-00389-8
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents