research-article

Public Access

Boosting the sensing granularity of acoustic signals by exploiting hardware non-linearity

Authors:

Jie XiongAuthors Info & Claims

HotNets '22: Proceedings of the 21st ACM Workshop on Hot Topics in Networks

Pages 53 - 59

https://doi.org/10.1145/3563766.3564091

Published: 14 November 2022 Publication History

Abstract

Acoustic sensing is a new sensing modality that senses the contexts of human targets and our surroundings using acoustic signals. It becomes a hot topic in both academia and industry owing to its finer sensing granularity and the wide availability of microphone and speaker on commodity devices. While prior studies focused on addressing well-known challenges such as increasing the limited sensing range and enabling multi-target sensing, we propose a novel scheme to leverage the non-linearity distortion of microphones to further boost the sensing granularity. Specifically, we observe the existence of the non-linear signal generated by the direct path signal and target reflection signal. We mathematically show that the non-linear chirp signal amplifies the phase variations and this property can be utilized to improve the granularity of acoustic sensing. Experiment results show that, by properly leveraging the hardware non-linearity, the amplitude estimation error for sub-millimeter-level vibration can be reduced from 0.137 mm to 0.029 mm.

References

[1]

Zhenlin An, Qiongzheng Lin, Lei Yang, and Yi Guo. 2020. Revitalizing ultrasonic positioning systems for ultrasound-incapable smart devices. IEEE Transactions on Mobile Computing 20, 5 (2020), 2007--2024.

[2]

Yang Bai, Jian Liu, Li Lu, Yilin Yang, Yingying Chen, and Jiadi Yu. 2020. BatComm: enabling inaudible acoustic communication with high-throughput for mobile devices. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 205--217.

Digital Library

[3]

Chao Cai, Zhe Chen, Henglin Pu, Liyuan Ye, Menglan Hu, and Jun Luo. 2020. AcuTe: Acoustic thermometer empowered by a single smartphone. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 28--41.

Digital Library

[4]

Chao Cai, Rong Zheng, Jun Li, Linwei Zhu, Henglin Pu, and Menglan Hu. 2019. Asynchronous acoustic localization and tracking for mobile targets. IEEE Internet of Things Journal 7, 2 (2019), 830--845.

[5]

Chao Cai, Rong Zheng, and Jun Luo. 2022. Ubiquitous acoustic sensing on commodity iot devices: A survey. IEEE Communications Surveys & Tutorials 24, 1 (2022), 432--454.

[6]

Zhihui Gao, Ang Li, Dong Li, Jialin Liu, Jie Xiong, Yu Wang, Bing Li, and Yiran Chen. 2022. MOM: Microphone based 3D Orientation Measurement. In 2022 21st ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). IEEE, 132--144.

[7]

Chengkun Jiang, Junchen Guo, Yuan He, Meng Jin, Shuai Li, and Yunhao Liu. 2020. mmVib: micrometer-level vibration measurement with mmwave radar. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--13.

Digital Library

[8]

Dong Li, Shirui Cao, Sunghoon Ivan Lee, and Jie Xiong. 2022. Experience: practical problems for acoustic sensing. In Proceedings of the 28th Annual International Conference on Mobile Computing And Networking. 381--390.

Digital Library

[9]

Dong Li, Jialin Liu, Sunghoon Ivan Lee, and Jie Xiong. 2020. FM-track: pushing the limits of contactless multi-target tracking using acoustic signals. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 150--163.

Digital Library

[10]

Dong Li, Jialin Liu, Sunghoon Ivan Lee, and Jie Xiong. 2022. LASense: Pushing the Limits of Fine-grained Activity Sensing Using Acoustic Signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 1 (2022), 1--27.

Digital Library

[11]

Qiongzheng Lin, Zhenlin An, and Lei Yang. 2019. Rebooting ultrasonic positioning systems for ultrasound-incapable smart devices. In The 25th Annual International Conference on Mobile Computing and Networking. 1--16.

Digital Library

[12]

Jialin Liu, Dong Li, Lei Wang, and Jie Xiong. 2021. BlinkListener: " Listen" to Your Eye Blink Using Your Smartphone. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 2 (2021), 1--27.

Digital Library

[13]

Jialin Liu, Dong Li, Lei Wang, Fusang Zhang, and Jie Xiong. 2022. Enabling Contact-free Acoustic Sensing under Device Motion. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1--27.

Digital Library

[14]

Wenguang Mao, Wei Sun, Mei Wang, and Lili Qiu. 2020. DeepRange: Acoustic Ranging via Deep Learning. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1--23.

Digital Library

[15]

Wenguang Mao, Mei Wang, Wei Sun, Lili Qiu, Swadhin Pradhan, and Yi-Chao Chen. 2019. RNN-Based Room Scale Hand Motion Tracking. In The 25th Annual International Conference on Mobile Computing and Networking. ACM, 38.

[16]

Kun Qian, Chenshu Wu, Fu Xiao, Yue Zheng, Yi Zhang, Zheng Yang, and Yunhao Liu. 2018. Acousticcardiogram: Monitoring heartbeats using acoustic signals on smart devices. In IEEE INFOCOM 2018-IEEE conference on computer communications. IEEE, 1574--1582.

Digital Library

[17]

Nirupam Roy, Haitham Hassanieh, and Romit Roy Choudhury. 2017. Backdoor: Making microphones hear inaudible sounds. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services. 2--14.

Digital Library

[18]

Nirupam Roy, Sheng Shen, Haitham Hassanieh, and Romit Roy Choudhury. 2018. Inaudible Voice Commands: The {Long-Range} Attack and Defense. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18). 547--560.

[19]

Seeed. 2022. ReSpeaker 4-Mic Linear Array kit. https://wiki.seeedstudio.com/ReSpeaker_4-Mic_Linear_Array_Kit_for_Raspberry_Pi/. (2022).

[20]

Xingzhe Song, Boyuan Yang, Ge Yang, Ruirong Chen, Erick Forno, Wei Chen, and Wei Gao. 2020. SpiroSonic: monitoring human lung function via acoustic sensing on commodity smartphones. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--14.

Digital Library

[21]

Yu-Chih Tung, Duc Bui, and Kang G Shin. 2018. Cross-platform support for rapid development of mobile acoustic sensing applications. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. 455--467.

Digital Library

[22]

Haoran Wan, Shuyu Shi, Wenyu Cao, Wei Wang, and Guihai Chen. 2021. RespTracker: Multi-user Room-scale Respiration Tracking with Commercial Acoustic Devices. In IEEE INFOCOM 2021-IEEE Conference on Computer Communications. IEEE, 1--10.

[23]

Haoran Wan, Lei Wang, Ting Zhao, Ke Sun, Shuyu Shi, Haipeng Dai, Guihai Chen, Haodong Liu, and Wei Wang. 2022. VECTOR: Velocity Based Temperature-field Monitoring with Distributed Acoustic Devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1--28.

Digital Library

[24]

Anran Wang and Shyamnath Gollakota. 2019. Millisonic: Pushing the limits of acoustic motion tracking. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--11.

Digital Library

[25]

Anran Wang, Jacob E Sunshine, and Shyamnath Gollakota. 2019. Contactless infant monitoring using white noise. In The 25th Annual International Conference on Mobile Computing and Networking. 1--16.

Digital Library

[26]

Wei Wang, Alex X Liu, and Ke Sun. 2016. Device-free gesture tracking using acoustic signals. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. 82--94.

[27]

Wei Wang, Lei Xie, and Xun Wang. 2017. Tremor detection using smartphone-based acoustic sensing. In Proceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposium on Wearable Computers. 309--312.

Digital Library

[28]

Wikipedia. 2022. Intermodulation distortion. https://en.wikipedia.org/wiki/Intermodulation. (2022).

[29]

Fusang Zhang, Zhi Wang, Beihong Jin, Jie Xiong, and Daqing Zhang. 2020. Your Smart Speaker Can" Hear" Your Heartbeat! Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1--24.

Digital Library

[30]

Guoming Zhang, Chen Yan, Xiaoyu Ji, Tianchen Zhang, Taimin Zhang, and Wenyuan Xu. 2017. Dolphinattack: Inaudible voice commands. In Proceedings of the 2017 ACM SIGSAC Conference on Computer and Communications Security. 103--117.

Digital Library

[31]

Qian Zhang, Dong Wang, Run Zhao, Yinggang Yu, and Junjie Shen. 2021. Sensing to hear: Speech enhancement for mobile devices using acoustic signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1--30.

Digital Library

[32]

Ningzhi Zhu, Huangxun Chen, and Zhice Yang. 2021. Fine-grained Multi-user Device-Free Gesture Tracking on Today's Smart Speakers. In 2021 IEEE 18th International Conference on Mobile Ad Hoc and Smart Systems (MASS). IEEE, 99--107.

Cited By

Zhou JLi YWang YDing DLu YChen YXue G(2024)Visar: Projecting Virtual Sound Spots for Acoustic Augmented Reality Using Air NonlinearityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785468:3(1-30)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678546
He JXiong JHu WFeng CYao EWang XLiu CChen XOkoshi TKo JLiKamWa R(2024)CW-AcousLen: A Configurable Wideband Acoustic MetasurfaceProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661882(29-41)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661882
Wu YChen SMeng XTong XLiu XXie XQu WOkoshi TKo JLiKamWa R(2024)Enabling 6D Pose Tracking on Your Acoustic DevicesProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661875(15-28)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661875
Show More Cited By

Index Terms

Boosting the sensing granularity of acoustic signals by exploiting hardware non-linearity
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

DF-Sense: Multi-user Acoustic Sensing for Heartbeat Monitoring with Dualforming
MobiSys '23: Proceedings of the 21st Annual International Conference on Mobile Systems, Applications and Services

Acoustic sensing for heartbeat monitoring has become a prevailing research topic in wireless sensing. Existing acoustic sensing systems have two limitations---limited sensing range, and heartbeat monitoring for a single user only, hindering the large-...
Active bone-conducted sound sensing for wearable interfaces
UIST '11 Adjunct: Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology

In this paper, we propose a wearable sensor system that measures an angle of an elbow and position tapped by finger using bone-conducted sound. Our system consists of two microphones and a speaker, and they are attached on forearm. A novelty of this ...
Cross-Platform Support for Rapid Development of Mobile Acoustic Sensing Applications
MobiSys '18: Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services

LibAS is a cross-platform framework to facilitate the rapid development of mobile acoustic sensing apps. It helps developers quickly realize their ideas by using a high-level Matlab script, and test them on various OS platforms, such as Android, iOS, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

HotNets '22: Proceedings of the 21st ACM Workshop on Hot Topics in Networks

November 2022

252 pages

ISBN:9781450398992

DOI:10.1145/3563766

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

HotNets '22

Sponsor:

SIGCOMM

HotNets '22: The 21st ACM Workshop on Hot Topics in Networks

November 14 - 15, 2022

Texas, Austin

Acceptance Rates

Overall Acceptance Rate 110 of 460 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
257
Total Downloads

Downloads (Last 12 months)133
Downloads (Last 6 weeks)26

Reflects downloads up to 26 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zhou JLi YWang YDing DLu YChen YXue G(2024)Visar: Projecting Virtual Sound Spots for Acoustic Augmented Reality Using Air NonlinearityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785468:3(1-30)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678546
He JXiong JHu WFeng CYao EWang XLiu CChen XOkoshi TKo JLiKamWa R(2024)CW-AcousLen: A Configurable Wideband Acoustic MetasurfaceProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661882(29-41)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661882
Wu YChen SMeng XTong XLiu XXie XQu WOkoshi TKo JLiKamWa R(2024)Enabling 6D Pose Tracking on Your Acoustic DevicesProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661875(15-28)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661875
Li YZhou JDing DChen YQiu LYu JXue GGanesan DLane NShi W(2024)MuDiS: An Audio-independent, Wide-angle, and Leak-free Multi-directional SpeakerProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3649360(263-278)Online publication date: 29-May-2024
https://dl.acm.org/doi/10.1145/3636534.3649360
Bai YShahid ITakawale HRoy N(2024)ScribeProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314117:4(1-31)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631411
Wang WHe YJin MSun YGuo XCosta XAl Hassanieh HAsadi ACox LPerino DWidmer JGiustiniano D(2023)Meta-Speaker: Acoustic Source Projection by Exploiting Air NonlinearityProceedings of the 29th Annual International Conference on Mobile Computing and Networking10.1145/3570361.3613279(1-15)Online publication date: 2-Oct-2023
https://dl.acm.org/doi/10.1145/3570361.3613279
Cao SLi DLee SXiong JCosta XAl Hassanieh HAsadi ACox LPerino DWidmer JGiustiniano D(2023)PowerPhone: Unleashing the Acoustic Sensing Capability of SmartphonesProceedings of the 29th Annual International Conference on Mobile Computing and Networking10.1145/3570361.3613270(1-16)Online publication date: 2-Oct-2023
https://dl.acm.org/doi/10.1145/3570361.3613270

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents