Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3134230.3134238acmotherconferencesArticle/Chapter ViewAbstractPublication PagesiwoarConference Proceedingsconference-collections
research-article

Exercise Monitoring On Consumer Smart Phones Using Ultrasonic Sensing

Published: 21 September 2017 Publication History

Abstract

Quantified self has been a trend over the last several years. An increasing number of people use devices, such as smartwatches or smartphones to log activities of daily life, including step count or vital information. However, most of these devices have to be worn by the user during the activities, as they rely on integrated motion sensors. Our goal is to create a technology that enables similar precision with remote sensing, based on common sensors installed in every smartphone, in order to enable ubiquitous application. We have created a system that uses the Doppler effect in ultrasound frequencies to detect motion around the smartphone. We propose a novel use case to track exercises, based on several feature extraction methods and machine learning classification. We conducted a study with 14 users, achieving an accuracy between 73 % and 92% for the different exercises.

References

[1]
Md Tanvir Islam Aumi, Sidhant Gupta, Mayank Goel, Eric Larson, and Shwetak Patel. 2013. DopLink: Using the Doppler Effect for Multi-device Interaction. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '13). ACM, 583--586.
[2]
Andreas Braun, Ingrid Schembri, and Sebastian Frank. 2015. ExerSeat - Sensor-Supported Exercise System for Ergonomic Microbreaks. Springer International Publishing, Cham, 236--251.
[3]
Sanjoy Dasgupta. 2000. Experiments with Random Projection. In Proceedings of the 16th Conference on Uncertainty in Artificial Intelligence (UAI '00). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 143--151. http://dl.acm.org/citation.cfm?id=647234.719759
[4]
Biying Fu, Jakob Karolus, Tobias Grosse-Puppendahl, Jonathan Herrmann, and Arjan Kuijper. 2015. Opportunities for Activity Recognition using Ultrasound Doppler Sensing on Unmodified Mobile Phones. In iWOAR 2015 2nd international Workshop on Sensor-based Activity Recognition and Interaction. ACM.
[5]
Sidhant Gupta, Daniel Morris, Shwetak Patel, and Desney Tan. 2012. SoundWave: Using the Doppler Effect to Sense Gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, 1911--1914.
[6]
A. Hyvärinen and E. Oja. 2000. Independent Component Analysis: Algorithms and Applications. Neural Netw. 13, 4--5 (May 2000), 411--430.
[7]
I.T. Jolliffe. 1986. Principal Component Analysis. Springer Verlag.
[8]
Florian Kirchbuchner, Tobias Grosse-Puppendahl, Matthias R Hastall, Martin Distler, and Arjan Kuijper. 2015. Ambient Intelligence from Senior Citizens Perspectives: Understanding Privacy Concerns, Technology Acceptance, and Expectations. In Ambient Intelligence. Springer, 48--59.
[9]
Hong Lu, Wei Pan, Nicholas D. Lane, Tanzeem Choudhury, and Andrew T. Campbell. 2009. SoundSense: Scalable Sound Sensing for People-centric Applications on Mobile Phones. In Proceedings of the 7th International Conference on Mobile Systems, Applications, and Services (MobiSys '09). ACM, New York, NY, USA, 165--178.
[10]
Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. 2015. Contactless Sleep Apnea Detection on Smartphones. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys '15). ACM, New York, NY, USA, 45--57.
[11]
Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan, and Shyamnath Gollakota. 2016. FingerIO: Using Sonar for Fine-Grained Finger Tracking. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '16). ACM, to appear.
[12]
Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, David Cournapeau, Matthieu Brucher, Matthieu Perrot, and Édouard Duchesnay. 2011. Scikit-learn: Machine Learning in Python. J. Mach. Learn. Res. 12 (Nov. 2011), 2825--2830. http://dl.acm.org/citation.cfm?id=1953048.2078195
[13]
M. Popescu, Yun Li, M. Skubic, and M. Rantz. 2008. An acoustic fall detector system that uses sound height information to reduce the false alarm rate. In Engineering in Medicine and Biology Society, 2008. EMBS 2008. 30th Annual International Conference of the IEEE. 4628--4631.
[14]
Yang Qifan, Tang Hao, Zhao Xuebing, Li Yin, and Zhang Sanfeng. 2014. Dolphin: Ultrasonic-Based Gesture Recognition on Smartphone Platform. In Computational Science and Engineering (CSE), 2014 IEEE 17th International Conference on. 1461--1468.
[15]
Wenjie Ruan, Quan Z. Sheng, Lei Yang, Tao Gu, Peipei Xu, and Longfei Shangguan. 2016. AudioGest: Enabling Fine-grained Hand Gesture Detection by Decoding Echo Signal. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 474--485.
[16]
Albrecht Schmidt. 2000. Implicit human computer interaction through context. Personal technologies 4, 2--3 (2000), 191--199.
[17]
Immanuel Schweizer, Roman Bärtl, Axel Schulz, Florian Probst, and Max Mühlhäuser. 2011. NoiseMap - Real-time participatory noise maps. In Second International Workshop on Sensing Applications on Mobile Phones.
[18]
Zheng Sun, Aveek Purohit, Raja Bose, and Pei Zhang. 2013. Spartacus: Spatially-aware Interaction for Mobile Devices Through Energy-efficient Audio Sensing. In Proceeding of the 11th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys '13). ACM, 263--276.

Cited By

View all
  • (2024)Acoustic-based Lip Reading for Mobile Devices: Dataset, Benchmark and A Self Distillation-based ApproachIEEE Transactions on Mobile Computing10.1109/TMC.2023.3294416(1-18)Online publication date: 2024
  • (2024)Towards a Multi-Sensor Paradigm for High Resolution Infant Activity ClassificationSoutheastCon 202410.1109/SoutheastCon52093.2024.10500197(291-296)Online publication date: 15-Mar-2024
  • (2023)ProxiFitProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109207:3(1-32)Online publication date: 27-Sep-2023
  • Show More Cited By

Index Terms

  1. Exercise Monitoring On Consumer Smart Phones Using Ultrasonic Sensing

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    iWOAR '17: Proceedings of the 4th International Workshop on Sensor-based Activity Recognition and Interaction
    September 2017
    83 pages
    ISBN:9781450352239
    DOI:10.1145/3134230
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    In-Cooperation

    • Rostock: University of Rostock

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 September 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Doppler effect
    2. Human activity recognition
    3. Ultrasound sensing
    4. mobile applications

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    iWOAR '17

    Acceptance Rates

    iWOAR '17 Paper Acceptance Rate 12 of 19 submissions, 63%;
    Overall Acceptance Rate 46 of 73 submissions, 63%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)16
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 26 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Acoustic-based Lip Reading for Mobile Devices: Dataset, Benchmark and A Self Distillation-based ApproachIEEE Transactions on Mobile Computing10.1109/TMC.2023.3294416(1-18)Online publication date: 2024
    • (2024)Towards a Multi-Sensor Paradigm for High Resolution Infant Activity ClassificationSoutheastCon 202410.1109/SoutheastCon52093.2024.10500197(291-296)Online publication date: 15-Mar-2024
    • (2023)ProxiFitProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109207:3(1-32)Online publication date: 27-Sep-2023
    • (2023)Demonstrating ProxiFit: Proximal Magnetic Sensing using a Single Commodity Mobile toward Holistic Weight Exercise MonitoringAdjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing10.1145/3594739.3610710(151-156)Online publication date: 8-Oct-2023
    • (2023) HearFit + : Personalized Fitness Monitoring via Audio Signals on Smart Speakers IEEE Transactions on Mobile Computing10.1109/TMC.2021.312568422:5(2756-2770)Online publication date: 1-May-2023
    • (2022)The Design of the Exercise Load Monitoring System Based on Internet of ThingsWireless Communications & Mobile Computing10.1155/2022/80111242022Online publication date: 1-Jan-2022
    • (2022)A Review of IoT-Enabled Mobile Healthcare: Technologies, Challenges, and Future TrendsIEEE Internet of Things Journal10.1109/JIOT.2022.31444009:12(9478-9502)Online publication date: 15-Jun-2022
    • (2021)Quantified Self: From Self-Learning to Machine LearningIT Professional10.1109/MITP.2021.305948523:4(69-74)Online publication date: 1-Jul-2021
    • (2020)Performing Realistic Workout Activity Recognition on Consumer SmartphonesTechnologies10.3390/technologies80400658:4(65)Online publication date: 6-Nov-2020
    • (2020)Unconstrained workout activity recognition on unmodified commercial off-the-shelf smartphonesProceedings of the 13th ACM International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3389189.3389195(1-10)Online publication date: 30-Jun-2020
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media