Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3583120.3586954acmconferencesArticle/Chapter ViewAbstractPublication PagescpsweekConference Proceedingsconference-collections
research-article

Addressing Practical Challenges in Acoustic Sensing To Enable Fast Motion Tracking

Published: 09 May 2023 Publication History

Abstract

Motivated by many potential applications that could be enabled by acoustic motion tracking, in this paper we systematically examine the factors that limit the accuracy of acoustic tracking in practical scenarios. We identify three main challenges: (i) high mobility, (ii) low SNR, and (iii) hardware frequency response. We further show that the last two issues may exacerbate the performance issue under high mobility. We develop effective approaches to address the issues. In particular, to address high mobility, we tackle phase wrap-around using the derivative of the phase; we further estimate the Doppler shift under diverse scenarios and compensate the Doppler in channel impulse response (CIR). To address low SNR, we use a novel approach to estimate the phase shift between consecutive time intervals to effectively support time-domain beamforming and increase SNR. To tackle the uneven frequency response, we show that it is important to estimate and compensate the phase as well as the amplitude of the frequency response. Our extensive evaluation shows that each of our techniques is effective and putting them together significantly enhances the accuracy of acoustic motion tracking in general scenarios.

References

[1]
2023.2. Real-Sense Hand Tracking Tutorial. https://www.intel.com/content/dam/develop/external/us/en/documents/hand-tracking-843462.pdf.
[2]
Mohammed H AlSharif, Mohamed Saad, Mohamed Siala, Tarig Ballal, Hatem Boujemaa, and Tareq Y Al-Naffouri. 2017. Zadoff-Chu coded ultrasonic signal for accurate range estimation. In 2017 25th European Signal Processing Conference (EUSIPCO). IEEE, 1250–1254.
[3]
Jeffrey G Andrews. 2022. A Primer on Zadoff Chu Sequences. arXiv preprint arXiv:2211.05702 (2022).
[4]
Md Tanvir Islam Aumi, Sidhant Gupta, Mayank Goel, Eric Larson, and Shwetak Patel. 2013. DopLink: Using the Doppler Effect for Multi-Device Interaction. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Zurich, Switzerland) (UbiComp ’13). Association for Computing Machinery, New York, NY, USA, 583–586. https://doi.org/10.1145/2493432.2493515
[5]
Calum J Chamberlain, Chet J Hopp, Carolin M Boese, Emily Warren-Smith, Derrick Chambers, Shanna X Chu, Konstantinos Michailos, and John Townend. 2018. EQcorrscan: Repeating and near-repeating earthquake detection and analysis in Python. Seismological Research Letters 89, 1 (2018), 173–181.
[6]
Ke-Yu Chen, Daniel Ashbrook, Mayank Goel, Sung-Hyuck Lee, and Shwetak Patel. 2014. AirLink: Sharing Files between Multiple Devices Using in-Air Gestures. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (Seattle, Washington) (UbiComp ’14). Association for Computing Machinery, New York, NY, USA, 565–569. https://doi.org/10.1145/2632048.2632090
[7]
John C Curlander and Robert N McDonough. 1991. Synthetic aperture radar. Vol. 11. Wiley, New York.
[8]
Kurt M DeGoede, James A Ashton-Miller, Jimmy M Liao, and Neil B Alexander. 2001. How quickly can healthy adults move their hands to intercept an approaching object? Age and gender effects. The Journals of Gerontology Series A: Biological Sciences and Medical Sciences 56, 9 (2001), M584–M588.
[9]
Matteo Frigo and Steven G Johnson. 1998. FFTW: An adaptive software architecture for the FFT. In Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP’98 (Cat. No. 98CH36181), Vol. 3. IEEE, 1381–1384.
[10]
Munther Gdeisat. 2019. Two-Dimensional Phase Unwrapping Problem. (06 2019).
[11]
Munther Gdeisat and Francis Lilley. 2011. One-dimensional phase unwrapping problem. signal 4 (2011), 6.
[12]
Richard M Goldstein, Howard A Zebker, and Charles L Werner. 1988. Satellite radar interferometry: Two-dimensional phase unwrapping. Radio science 23, 4 (1988), 713–720.
[13]
S Golomb and R Scholtz. 1965. Generalized barker sequences. IEEE Transactions on Information theory 11, 4 (1965), 533–537.
[14]
Anders Grunnet-Jepsen, John N Sweetser, and John Woodfill. 2018. Best-known-methods for tuning intel® realsense™ d400 depth cameras for best performance. Intel Corporation: Satan Clara, CA, USA 1 (2018).
[15]
Guifen Gu and Guili Peng. 2010. The survey of GSM wireless communication system. In 2010 international conference on computer and information application. IEEE, 121–124.
[16]
Silviu Guiasu and Abe Shenitzer. 1985. The principle of maximum entropy. The mathematical intelligencer 7, 1 (1985), 42–48.
[17]
Sidhant Gupta, Daniel Morris, Shwetak Patel, and Desney Tan. 2012. Soundwave: using the doppler effect to sense gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1911–1914.
[18]
MP Jacob Habgood, David Moore, David Wilson, and Sergio Alapont. 2018. Rapid, continuous movement between nodes as an accessible virtual reality locomotion technique. In 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 371–378.
[19]
Liya Han, Zhongwei Li, Kai Zhong, Xu Cheng, Hua Luo, Gang Liu, Junyun Shang, Congjun Wang, and Yusheng Shi. 2019. Vibration detection and motion compensation for multi-frequency phase-shifting-based 3d sensors. Sensors 19, 6 (2019), 1368.
[20]
George Helffrich. 2006. Extended-time multitaper frequency domain cross-correlation receiver-function estimation. Bulletin of the Seismological Society of America 96, 1 (2006), 344–347.
[21]
J Stuart Hunter. 1986. The exponentially weighted moving average. Journal of quality technology 18, 4 (1986), 203–210.
[22]
JM Huntley. 1989. Noise-immune phase unwrapping algorithm. Applied optics 28, 16 (1989), 3268–3270.
[23]
JM Huntley and JR Buckland. 1995. Characterization of sources of 2π phase discontinuity in speckle interferograms. JOSA A 12, 9 (1995), 1990–1996.
[24]
Rubén Iglesias, Jordi J Mallorqui, Dani Monells, Carlos López-Martínez, Xavier Fabregas, Albert Aguasca, Josep A Gili, and Jordi Corominas. 2015. PSI deformation map retrieval by means of temporal sublook coherence on reduced sets of SAR images. Remote Sensing 7, 1 (2015), 530–563.
[25]
Intel. 2022. Intel® RealSense™ Depth Camera D435i. Retrieved June, 21, 2022 from https://store.intelrealsense.com/buy-intel-realsense-depth-camera-d435i.html
[26]
Kazuyoshi Itoh. 1982. Analysis of the phase unwrapping algorithm. Applied optics 21, 14 (1982), 2470–2470.
[27]
Chengkun Jiang, Junchen Guo, Yuan He, Meng Jin, Shuai Li, and Yunhao Liu. 2020. MmVib: Micrometer-Level Vibration Measurement with Mmwave Radar. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking (London, United Kingdom) (MobiCom ’20). Association for Computing Machinery, New York, NY, USA, Article 45, 13 pages. https://doi.org/10.1145/3372224.3419202
[28]
Min-Ho Ka and Aleksandr I Baskakov. 2007. Selection of pulse repetition frequency in high-precision oceanographic radar altimeters. IEEE Geoscience and Remote Sensing Letters 4, 3 (2007), 345–348.
[29]
Qian Kemao. 2007. Two-dimensional windowed Fourier transform for fringe pattern analysis: principles, applications and implementations. Optics and Lasers in Engineering 45, 2 (2007), 304–317.
[30]
Eike Langbehn, Tobias Eichler, Sobin Ghose, Kai von Luck, Gerd Bruder, and Frank Steinicke. 2015. Evaluation of an omnidirectional walking-in-place user interface with virtual locomotion speed scaled by forward leaning angle. In Proceedings of the GI Workshop on Virtual and Augmented Reality (GI VR/AR). 149–160.
[31]
Paul C Lauterbur. 1973. Image formation by induced local interactions: examples employing nuclear magnetic resonance. nature 242, 5394 (1973), 190–191.
[32]
Dong Li, Jialin Liu, Sunghoon Ivan Lee, and Jie Xiong. 2020. FM-track: pushing the limits of contactless multi-target tracking using acoustic signals. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 150–163.
[33]
Jaime Lien, Nicholas Gillian, M Emre Karagozler, Patrick Amihood, Carsten Schwesig, Erik Olson, Hakim Raja, and Ivan Poupyrev. 2016. Soli: Ubiquitous gesture sensing with millimeter wave radar. ACM Transactions on Graphics (TOG) 35, 4 (2016), 1–19.
[34]
Chao Liu, Penghao Wang, Ruobing Jiang, and Yanmin Zhu. 2021. AMT: Acoustic Multi-target Tracking with Smartphone MIMO System. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications. IEEE, 1–10.
[35]
Gang Liu, Robert Wang, YunKai Deng, Runpu Chen, Yunfeng Shao, and Zhihui Yuan. 2013. A new quality map for 2-D phase unwrapping based on gray level co-occurrence matrix. IEEE Geoscience and Remote Sensing Letters 11, 2 (2013), 444–448.
[36]
Yuangang Lu, Xiangzhao Wang, and Xuping Zhang. 2007. Weighted least-squares phase unwrapping algorithm based on derivative variance correlation map. Optik 118, 2 (2007), 62–66.
[37]
YG Lu and XP Zhang. 2006. Minimum L0-norm two-dimensional phase unwrapping algorithm Based on the derivative variance correlation map. In Journal of Physics: Conference Series, Vol. 48. IOP Publishing, 057.
[38]
Wenguang Mao, Jian He, and Lili Qiu. 2016. Cat: high-precision acoustic motion tracking. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. 69–81.
[39]
Wenguang Mao, Wei Sun, Mei Wang, and Lili Qiu. 2020. DeepRange: acoustic ranging via deep learning. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1–23.
[40]
Wenguang Mao, Mei Wang, and Lili Qiu. 2018. Aim: Acoustic imaging on a mobile. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. 468–481.
[41]
Wenguang Mao, Mei Wang, Wei Sun, Lili Qiu, Swadhin Pradhan, and Yi-Chao Chen. 2019. RNN-based room scale hand motion tracking. In The 25th Annual International Conference on Mobile Computing and Networking. 1–16.
[42]
Wenguang Mao, Zaiwei Zhang, Lili Qiu, Jian He, Yuchen Cui, and Sangki Yun. 2017. Indoor follow me drone. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services. 345–358.
[43]
Umberto Mengali. 2013. Synchronization techniques for digital receivers. Springer Science & Business Media.
[44]
Carolyn R Mercer and Glenn Beheim. 1990. Fiber-optic Projected Fringe Digital Interferometry. National Aeronautics and Space Administration.
[45]
Rajalakshmi Nandakumar, Shyamnath Gollakota, and Nathaniel Watson. 2015. Contactless Sleep Apnea Detection on Smartphones. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services (Florence, Italy) (MobiSys ’15). Association for Computing Machinery, New York, NY, USA, 45–57. https://doi.org/10.1145/2742647.2742674
[46]
Rajalakshmi Nandakumar, Vikram Iyer, Desney Tan, and Shyamnath Gollakota. 2016. Fingerio: Using active sonar for fine-grained finger tracking. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 1515–1525.
[47]
Steve Spreads It On. 1985. Digital communications. Van Nostrand Reinhold, New York.
[48]
Alan V Oppenheim. 1999. Discrete-time signal processing. Pearson Education India.
[49]
SM Pandit, N Jordache, and GA Joshi. 1994. Data-dependent systems methodology for noise-insensitive phase unwrapping in laser interferometric surface characterization. JOSA A 11, 10 (1994), 2584–2592.
[50]
Mari Partio, Bogdan Cramariuc, Moncef Gabbouj, and Ari Visa. 2002. Rock texture retrieval using gray level co-occurrence matrix. In Proc. of 5th Nordic Signal Processing Symposium, Vol. 75. Citeseer.
[51]
Chunyi Peng, Guobin Shen, Yongguang Zhang, Yanlin Li, and Kun Tan. 2007. BeepBeep: A High Accuracy Acoustic Ranging System Using COTS Mobile Devices. In Proceedings of the 5th International Conference on Embedded Networked Sensor Systems (Sydney, Australia) (SenSys ’07). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/1322263.1322265
[52]
Branislav M Popovic. 1992. Generalized chirp-like polyphase sequences with optimum correlation properties. IEEE Transactions on Information Theory 38, 4 (1992), 1406–1409.
[53]
Bruno Quesson, Jacco A de Zwart, and Chrit TW Moonen. 2000. Magnetic resonance temperature imaging for guidance of thermotherapy. Journal of Magnetic Resonance Imaging: An Official Journal of the International Society for Magnetic Resonance in Medicine 12, 4 (2000), 525–533.
[54]
Alexander Rauscher, Markus Barth, Jürgen R Reichenbach, Rudolf Stollberger, and Ewald Moser. 2003. Automated unwrapping of MR phase images applied to BOLD MR-venography at 3 Tesla. Journal of Magnetic Resonance Imaging: An Official Journal of the International Society for Magnetic Resonance in Medicine 18, 2 (2003), 175–180.
[55]
Paul A Rosen, Scott Hensley, Ian R Joughin, Fuk K Li, Soren N Madsen, Ernesto Rodriguez, and Richard M Goldstein. 2000. Synthetic aperture radar interferometry. Proc. IEEE 88, 3 (2000), 333–382.
[56]
M Schwabisch and D Geudtner. 1995. Improvement of phase and coherence map quality using azimuth prefiltering: Examples from ERS-1 and X-SAR. In 1995 International Geoscience and Remote Sensing Symposium, IGARSS’95. Quantitative Remote Sensing for Science and Applications, Vol. 1. IEEE, 205–207.
[57]
Nader Shakibay Senobari, Gareth J Funning, Eamonn Keogh, Yan Zhu, Chin-Chia Michael Yeh, Zachary Zimmerman, and Abdullah Mueen. 2019. Super-efficient cross-correlation (SEC-C): A fast matched filtering code suitable for desktop computers. Seismological Research Letters 90, 1 (2019), 322–334.
[58]
GE Spoorthi, Rama Krishna Sai Subrahmanyam Gorthi, and Subrahmanyam Gorthi. 2020. PhaseNet 2.0: Phase unwrapping of noisy data based on deep learning approach. IEEE Transactions on Image Processing 29 (2020), 4862–4872.
[59]
Kay M Stanney and Phillip Hash. 1998. Locus of user-initiated control in virtual environments: Influences on cybersickness. Presence 7, 5 (1998), 447–459.
[60]
Ke Sun, Ting Zhao, Wei Wang, and Lei Xie. 2018. Vskin: Sensing touch gestures on surfaces of mobile devices using acoustic signals. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking. 591–605.
[61]
Li Sun, Souvik Sen, Dimitrios Koutsonikolas, and Kyu-Han Kim. 2015. Widraw: Enabling hands-free drawing in the air on commodity wifi devices. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. 77–89.
[62]
Shinichi Tamura, Shigenori Nakano, and Kozo Okazaki. 1985. Optical code-multiplex transmission by gold sequences. Journal of lightwave technology 3, 1 (1985), 121–127.
[63]
Michele Vespe, Gareth Jones, and Chris J Baker. 2009. Lessons for radar. IEEE Signal Processing Magazine 26, 1 (2009), 65–75.
[64]
JR Wait. 1970. Distortion of pulsed signals when the group delay is a nonlinear function of frequency. Proc. IEEE 58, 8 (1970), 1292–1294.
[65]
Anran Wang and Shyamnath Gollakota. 2019. Millisonic: Pushing the limits of acoustic motion tracking. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–11.
[66]
Anran Wang, Jacob E Sunshine, and Shyamnath Gollakota. 2019. Contactless infant monitoring using white noise. In The 25th Annual International Conference on Mobile Computing and Networking. 1–16.
[67]
Jue Wang, Deepak Vasisht, and Dina Katabi. 2014. RF-IDraw: Virtual touch screen in the air using RF signals. ACM SIGCOMM Computer Communication Review 44, 4 (2014), 235–246.
[68]
Tianben Wang, Daqing Zhang, Yuanqing Zheng, Tao Gu, Xingshe Zhou, and Bernadette Dorizzi. 2018. C-FMCW based contactless respiration detection using acoustic signal. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 4 (2018), 1–20.
[69]
Wei Wang, Alex X Liu, and Ke Sun. 2016. Device-free gesture tracking using acoustic signals. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. 82–94.
[70]
Teng Wei and Xinyu Zhang. 2015. mtrack: High-precision passive tracking using millimeter wave radios. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. 117–129.
[71]
Jie Xiong and Kyle Jamieson. 2013. { ArrayTrack} : A { Fine-Grained} Indoor Location System. In 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). 71–84.
[72]
Hanwen Yu, Yang Lan, Hyongki Lee, and Ning Cao. 2018. 2-D phase unwrapping using minimum infinity-norm. IEEE Geoscience and Remote Sensing Letters 15, 12 (2018), 1887–1891.
[73]
Sangki Yun, Yi-Chao Chen, and Lili Qiu. 2015. Turning a Mobile Device into a Mouse in the Air. In Proceedings of the 13th Annual International Conference on Mobile Systems, Applications, and Services (Florence, Italy) (MobiSys ’15). Association for Computing Machinery, New York, NY, USA, 15–29. https://doi.org/10.1145/2742647.2742662
[74]
Sangki Yun, Yi-Chao Chen, Huihuang Zheng, Lili Qiu, and Wenguang Mao. 2017. Strata: Fine-Grained Acoustic-Based Device-Free Tracking. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services (Niagara Falls, New York, USA) (MobiSys ’17). Association for Computing Machinery, New York, NY, USA, 15–28. https://doi.org/10.1145/3081333.3081356
[75]
Cheng Zhang, Qiuyue Xue, Anandghan Waghmare, Sumeet Jain, Yiming Pu, Sinan Hersek, Kent Lyons, Kenneth A. Cunefare, Omer T. Inan, and Gregory D. Abowd. 2017. SoundTrak: Continuous 3D Tracking of a Finger Using Active Acoustics. 1, 2, Article 30 (June 2017), 25 pages. https://doi.org/10.1145/3090095
[76]
Yongzhao Zhang, Wei-Hsiang Huang, Chih-Yun Yang, Wen-Ping Wang, Yi-Chao Chen, Chuang-Wen You, Da-Yuan Huang, Guangtao Xue, and Jiadi Yu. 2020. Endophasia: Utilizing Acoustic-Based Imaging for Issuing Contact-Free Silent Speech Commands. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1–26.
[77]
Zengbin Zhang, David Chu, Xiaomeng Chen, and Thomas Moscibroda. 2012. SwordFight: Enabling a New Class of Phone-to-Phone Action Games on Commodity Phones. In Proceedings of the 10th International Conference on Mobile Systems, Applications, and Services (Low Wood Bay, Lake District, UK) (MobiSys ’12). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/2307636.2307638
[78]
Yuzhou Zhuang, Yuntao Wang, Yukang Yan, Xuhai Xu, and Yuanchun Shi. 2021. ReflecTrack: Enabling 3D Acoustic Position Tracking Using Commodity Dual-Microphone Smartphones. Association for Computing Machinery, New York, NY, USA, 1050–1062. https://doi.org/10.1145/3472749.3474805

Cited By

View all
  • (2024)Pushing the Limits of Acoustic Spatial Perception via Incident Angle EncodingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595838:2(1-28)Online publication date: 15-May-2024

Index Terms

  1. Addressing Practical Challenges in Acoustic Sensing To Enable Fast Motion Tracking

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    IPSN '23: Proceedings of the 22nd International Conference on Information Processing in Sensor Networks
    May 2023
    385 pages
    ISBN:9798400701184
    DOI:10.1145/3583120
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 May 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. SNR enhancement
    2. acoustic motion tracking
    3. fast motion tracking

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    IPSN '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 143 of 593 submissions, 24%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)142
    • Downloads (Last 6 weeks)5
    Reflects downloads up to 08 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Pushing the Limits of Acoustic Spatial Perception via Incident Angle EncodingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36595838:2(1-28)Online publication date: 15-May-2024

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media