research-article

Adaptive Metasurface-Based Acoustic Imaging using Joint Optimization

Authors:

Yongzhao Zhang,

Yaoxue ZhangAuthors Info & Claims

MOBISYS '24: Proceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services

Pages 492 - 504

https://doi.org/10.1145/3643832.3661863

Published: 04 June 2024 Publication History

Abstract

Acoustic imaging is attractive due to its ability to work under occlusion, different lighting conditions, and privacy-sensitive environments. Existing acoustic imaging methods require large transceiver arrays or device movement, which makes it challenging to use in many scenarios. In this paper, we develop a novel acoustic imaging system for low-cost devices with few speakers and microphones without any device movement. To achieve this goal, we leverage a 3D-printed passive acoustic metasurface to significantly enhance the diversity of the measurement data, thereby improving the imaging quality. Specifically, we jointly design the transmission signal, transceivers' beamforming weights, metasurface, and imaging algorithm to minimize the imaging reconstruction error in an end-to-end manner. We further develop a scheme to dynamically adapt the imaging resolution based on the distance to the target. We implement a system prototype. Using extensive experiments, we show that our system yields high-quality images across a wide range of scenarios.

References

[1]

All-new Echo (4th Gen). https://www.amazon.com/Echo-4th-Gen/dp/B07XKF5RM3.

[2]

Bela: create beautiful interaction with sensors and sound. https://bela.io/, 2022.

[3]

COMSOL: simulate real-world designs, devices, and processes with multiphysics software from comsol. https://www.ti.com/product/LM386, 2023.2.

[4]

A. Adhikari, H. Regmi, S. Sur, and S. Nelakuditi. Mishape: Accurate human silhouettes and body joints from commodity millimeter-wave devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 6(3):1--31, 2022.

Digital Library

[5]

Y. Bai, N. Garg, and N. Roy. Spidr: Ultra-low-power acoustic spatial sensing for micro-robot navigation. In ACM MobiSys, 2022.

Digital Library

[6]

S. Boyd, N. Parikh, E. Chu, B. Peleato, J. Eckstein, et al. Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends® in Machine learning, 3(1):1--122, 2011.

Digital Library

[7]

P. Cai and S. Sur. Millipcd: Beyond traditional vision indoor point cloud generation via handheld millimeter-wave devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 6(4):1--24, 2023.

[8]

E. J. Candes and M. B. Wakin. An introduction to compressive sampling. IEEE Signal Processing Magazine, 25(2):21--30, 2008.

[9]

E. J. Candès. The restricted isometry property and its implications for compressed sensing. Comptes Rendus Mathematique, pages 589--592, May 2008.

[10]

X. Chen, P. Liu, Z. Hou, and Y. Pei. Magnetic-control multifunctional acoustic metasurface for reflected wave manipulation at deep subwavelength scale. Scientific reports, 7(1):1--9, 2017.

[11]

Our acoustic imaging demo. https://youtu.be/ASEbUA11IbY.

[12]

D. Donoho. For most large underdetermined systems of linear equations, the minimal l1-norm nearsolution approximates the sparsest near-solution.

[13]

Y. Fu, S. Wang, L. Zhong, L. Chen, J. Ren, and Y. Zhang. Svoice: Enabling voice communication in silence via acoustic sensing on commodity devices. In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems, pages 622--636, 2022.

Digital Library

[14]

Y. Ghasempour, C.-Y. Yeh, R. Shrestha, Y. Amarasinghe, D. Mittleman, and E. W. Knightly. LeakyTrack: Non-coherent single-antenna nodal and environmental mobility tracking with a leaky-wave antenna. In ACM SenSys, 2020.

Digital Library

[15]

J. Hald. Time domain acoustical holography and its applications. Sound and Vibration, 35(2):16--25, 2001.

[16]

B. P. Hildebrand. An introduction to acoustical holography. Springer Science & Business Media, 2013.

[17]

Product environmental report. https://www.apple.com/environment/pdf/products/homepod/HomePod_PER_Jan2023.pdf.

[18]

F.-L. Hsiao, T.-K. Li, P.-C. Chen, S.-C. Wang, K.-W. Lin, W.-L. Lin, Y.-P. Tsai, W.-K. Lin, and B.-S. Lin. Phase resonance and sensing application of an acoustic metamaterial based on a composite both-sides-open disk resonator arrays. Sensors and Actuators A: Physical, 339:113524, 2022.

[19]

D. Huang, R. Nandakumar, and S. Gollakota. Feasibility and limits of wi-fi imaging. In ACM SenSys, 2014.

Digital Library

[20]

C. R. Karanam and Y. Mostofi. 3d through-wall imaging with unmanned aerial vehicles using WiFi. In ACM/IEEE IPSN, 2017.

Digital Library

[21]

H. Lee. Acoustical Sensing and Imaging. CRC Press, 2016.

[22]

K. H. Lee, K. Yu, A. Xin, Z. Feng, Q. Wang, et al. Sharkskin-inspired magnetoactive reconfigurable acoustic metamaterials. Research, 2020, 2020.

[23]

C. Li, Z. Liu, Y. Yao, Z. Cao, M. Zhang, and Y. Liu. Wi-Fi see it all: generative adversarial network-augmented versatile Wi-Fi imaging. In ACM SenSys, 2020.

Digital Library

[24]

J. Lian, X. Yuan, M. Li, and N.-F. Tzeng. Fall detection via inaudible acoustic sensing. In UbiComp, 2021.

Digital Library

[25]

Z. Liang and J. Li. Extreme acoustic metamaterial by coiling up space. Physical review letters, 108(11):114301, 2012.

[26]

W. Mao, J. He, and L. Qiu. CAT: high-precision acoustic motion tracking. In Proc. of ACM MobiCom, 2016.

Digital Library

[27]

W. Mao, W. Sun, M. Wang, and L. Qiu. Deeprange: Ranging via deep learning. In Proc. of UbiComp, 2021.

[28]

W. Mao, M. Wang, and L. Qiu. Aim: Acoustic imaging on a mobile. In ACM MobiSys, 2018.

Digital Library

[29]

W. Mao, M. Wang, W. Sun, L. Qiu, S. Pradhan, and Y.-C. Chen. Rnn-based room scale hand motion tracking. In The 25th Annual International Conference on Mobile Computing and Networking, pages 1--16, 2019.

Digital Library

[30]

M. Mardani, E. Gong, J. Y. Cheng, S. Vasanawala, G. Zaharchuk, M. Alley, N. Thakur, S. Han, W. Dally, J. M. Pauly, et al. Deep generative adversarial networks for compressed sensing automates mri. arXiv preprint arXiv:1706.00051, 2017.

[31]

G. Memoli, M. Caleap, M. Asakawa, D. R. Sahoo, B. W. Drinkwater, and S. Subramanian. Metamaterial bricks and quantization of meta-surfaces. Nature Communication, 2017.

[32]

G. Memoli, L. Chisari, J. P. Eccles, M. Caleap, B. W. Drinkwater, and S. Subramanian. Vari-sound: A varifocal lens for sound. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, CHI '19, page 1--14, New York, NY, USA, 2019. Association for Computing Machinery.

Digital Library

[33]

R. Nandakumar, S. Gollakota, and N. Watson. Contactless sleep apnea detection on smartphones. In Proc. of ACM MobiSys, 2015.

Digital Library

[34]

R. Nandakumar, V. Iyer, D. Tan, and S. Gollakota. FingerIO: Using active sonar for fine-grained finger tracking. In Proc. of ACM CHI, pages 1515--1525, 2016.

Digital Library

[35]

A. Pallaprolu, B. Korany, and Y. Mostofi. Wiffract: a new foundation for RF imaging via edge tracing. In ACM MobiCom, 2022.

Digital Library

[36]

C. Peng, G. Shen, Y. Zhang, Y. Li, and K. Tan. BeepBeep: a high accuracy acoustic ranging system using COTS mobile devices. In Proc. of ACM SenSys, 2007.

Digital Library

[37]

K. Qian, Z. He, and X. Zhang. 3D point cloud generation with millimeter-wave radar. ACM IMWUT, 2020.

Digital Library

[38]

M. Rezvani and R. Adve. Channel estimation for dynamic metasurface antennas. IEEE Transactions on Wireless Communications, 2023.

[39]

Lecture note on rip.

[40]

O. Ronneberger, P. Fischer, and T. Brox. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and ComputerAssisted Intervention-MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, pages 234--241. Springer, 2015.

[41]

S. Shen, D. Chen, Y.-L. Wei, Z. Yang, and R. R. Choudhury. Voice localization using nearby wall reflections. In Proc. of ACM MobiCom, 2020.

Digital Library

[42]

Y. Shibata, Y. Kawashima, M. Isogawa, G. Irie, A. Kimura, and Y. Aoki. Listening human behavior: 3d human pose estimation with acoustic signals. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 13323--13332, 2023.

[43]

R. I. Stantchev, X. Yu, T. Blu, and E. Pickwell-MacPherson. Real-time terahertz imaging with a single-pixel detector. Nature communications, 2020.

[44]

J. Sun, H. Li, Z. Xu, et al. Deep admm-net for compressive sensing mri. Advances in neural information processing systems, 29, 2016.

[45]

A. Wang, J. E. Sunshine, and S. Gollakota. Contactless infant monitoring using white noise. In The 25th Annual International Conference on Mobile Computing and Networking, pages 1--16, 2019.

Digital Library

[46]

J. Wang, J. Xiong, X. Chen, H. Jiang, R. K. Balan, and D. Fang. TagScan: Simultaneous target imaging and material identification with commodity RFID devices. In ACM MobiCom, 2017.

Digital Library

[47]

M. Wang, W. Sun, and L. Qiu. Mavl: Multiresolution analysis of voice localization. In Proc. of NSDI, 2021.

[48]

S. Wang, L. Zhong, Y. Fu, L. Chen, J. Ren, and Y. Zhang. Uface: Your smartphone can" hear" your facial expression! Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 8(1):1--27, 2024.

Digital Library

[49]

W. Wang, A. X. Liu, and K. Sun. Device-free gesture tracking using acoustic signals. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, pages 82--94. ACM, 2016.

Digital Library

[50]

H. Xiao, K. Rasul, and R. Vollgraf. Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms. arXiv preprint arXiv:1708.07747, 2017.

[51]

S. Yun, Y. chao Chen, and L. Qiu. Turning a mobile device into a mouse in the air. In Proc. of ACM MobiSys, May 2015.

Digital Library

[52]

Y. Zhang, Y. Wang, L. Yang, M. Wang, Y.-C. Chen, L. Qiu, Y. Liu, G. Xue, and J. Yu. Acoustic sensing and communication using metasurface. In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23), pages 1359--1374, 2023.

Cited By

Zhou JLi YWang YDing DLu YChen YXue G(2024)Visar: Projecting Virtual Sound Spots for Acoustic Augmented Reality Using Air NonlinearityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785468:3(1-30)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678546
Chen XFeng ZSun KQian KZhang XShu YLiu JTan RHe YChen J(2024)RFCanvas: Modeling RF Channel by Fusing Visual Priors and Few-shot RF MeasurementsProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699351(464-477)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699351
Feng ZChen XCao XZhang XGanesan DLane NShi W(2024)Hybrid Data-Driven and Simulation-Driven Prediction of mmWave Network PerformanceProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3694725(1998-2003)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3694725

Index Terms

Adaptive Metasurface-Based Acoustic Imaging using Joint Optimization
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

Joint noise reduction and acoustic echo cancellation using the transfer-function generalized sidelobe canceller

Man machine interaction requires an acoustic interface for providing full duplex hands-free communication. The transfer-function generalized sidelobe canceller (TF-GSC) is an adaptive beamformer suitable for enhancing a speech signal received by an ...
Nonlinear stereophonic acoustic echo cancellation using sub-filter based adaptive algorithm
Abstract
The nonlinear echo path resulting from the unwarranted acoustic echo and nonlinear distortion will degrade the echo cancellation performance of a stereophonic acoustic echo cancellation system. Techniques proposed in the literature ...
Gain enhancement and broadband RCS reduction of a circularly polarized aperture-coupled annular-slot antenna using metasurface

A circularly polarized microstrip slot antenna with low radar cross-section (RCS) and high gain was designed using a metasurface composed of a $$6 \times 6$$6 6 array of corner-truncated square patches placed on top of the upper substrate. By optimizing ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MOBISYS '24: Proceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services

June 2024

778 pages

ISBN:9798400705816

DOI:10.1145/3643832

Chairs:
Tadashi Okoshi,
JeongGil Ko,
Program Chair:
Robert LiKamWa

Copyright © 2024 Copyright is held by the owner/author(s). Publication rights licensed to ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

In-Cooperation

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 June 2024

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China

Conference

MOBISYS '24

Sponsor:

SIGMOBILE

MOBISYS '24: 22nd Annual International Conference on Mobile Systems, Applications and Services

June 3 - 7, 2024

Minato-ku, Tokyo, Japan

Acceptance Rates

Overall Acceptance Rate 274 of 1,679 submissions, 16%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
652
Total Downloads

Downloads (Last 12 months)652
Downloads (Last 6 weeks)62

Reflects downloads up to 04 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhou JLi YWang YDing DLu YChen YXue G(2024)Visar: Projecting Virtual Sound Spots for Acoustic Augmented Reality Using Air NonlinearityProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785468:3(1-30)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678546
Chen XFeng ZSun KQian KZhang XShu YLiu JTan RHe YChen J(2024)RFCanvas: Modeling RF Channel by Fusing Visual Priors and Few-shot RF MeasurementsProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699351(464-477)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699351
Feng ZChen XCao XZhang XGanesan DLane NShi W(2024)Hybrid Data-Driven and Simulation-Driven Prediction of mmWave Network PerformanceProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3694725(1998-2003)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3694725

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten