Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Akte-Liquid: Acoustic-based Liquid Identification with Smartphones

Published: 21 February 2023 Publication History

Abstract

Liquid identification plays an essential role in our daily lives. However, existing RF sensing approaches still require dedicated hardware such as RFID readers and UWB transceivers, which are not readily available to most users. In this article, we propose Akte-Liquid, which leverages the speaker on smartphones to transmit acoustic signals, and the microphone on smartphones to receive reflected signals to identify liquid types and analyze the liquid concentration. Our work arises from the acoustic intrinsic impedance property of liquids, in that different liquids have different intrinsic impedance, causing reflected acoustic signals of liquids to differ. Then, we discover that the amplitude-frequency feature of reflected signals may be utilized to represent the liquid feature. With this insight, we propose new mechanisms to eliminate the interference caused by hardware and multi-path propagation effects to extract the liquid features. In addition, we design a new Siamese network-based structure with a specific training sample selection mechanism to reconstruct the extracted feature to container-irrelevant features. Our experimental evaluations demonstrate that Akte-Liquid is able to distinguish 20 types of liquids at a higher accuracy, and to identify food additives and measure protein concentration in the artificial urine with a 92.3% accuracy under 1 mg/100 mL as well.

References

[1]
L. Bertinetto, J. Valmadre, Joo F. Henriques, A. Vedaldi, and Phs Torr. 2016. Fully-convolutional Siamese Networks for Object Tracking. Springer, Cham.
[2]
Anurag Chowdhury and Arun Ross. 2019. Fusing MFCC and LPC features using 1D triplet CNN for speaker recognition in severely degraded audio signals. IEEE Transactions on Information Forensics and Security 15 (2019), 1616–1629.
[3]
J. Y. Chung and D. A. Blaser. 1980. Transfer function method of measuring in-duct acoustic properties. II. Experiment. The Journal of the Acoustical Society of America 68, 3 (1980), 914–921.
[4]
Ashutosh Dhekne, Mahanth Gowda, Yixuan Zhao, Haitham Hassanieh, and Romit Roy Choudhury. 2018. Liquid: A wireless liquid identifier. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. 442–454.
[5]
David I. Ellis, Victoria L. Brewster, Warwick B. Dunn, J. William Allwood, Alexander P. Golovanov, and Royston Goodacre. 2012. Fingerprinting food: Current technologies for the detection of food adulteration and contamination. Chemical Society Reviews 41, 17 (2012), 5706–5727.
[6]
Chao Feng, Jie Xiong, Liqiong Chang, Fuwei Wang, Ju Wang, and Dingyi Fang. 2021. RF-Identity: Non-intrusive person identification based on commodity RFID devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (2021), 1–23.
[7]
Yang Gao, Wei Wang, Vir V. Phoha, Wei Sun, and Zhanpeng Jin. 2019. EarEcho: Using ear canal echo for wearable authentication. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1–24.
[8]
Unsoo Ha, Junshan Leng, Alaa Khaddaj, and Fadel Adib. 2020. Food and liquid sensing in practical environments using RFIDs. In Proceedings of the 17th USENIX Symposium on Networked Systems Design and Implementation (NSDI’20).
[9]
Unsoo Ha, Yunfei Ma, Zexuan Zhong, Tzu-Ming Hsu, and Fadel Adib. 2018. Learning food quality and safety from wireless stickers. In Proceedings of the 17th ACM Workshop on Hot Topics in Networks. 106–112.
[10]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 770–778.
[11]
Yongzhi Huang, Kaixin Chen, Yandao Huang, Lu Wang, and Kaishun Wu. 2021. Vi-liquid: Unknown liquid identification with your smartphone vibration. In MobiCom. 174–187.
[12]
ISO. 1998. Acoustics-determination of sound absorption coefficient and impedance in impedance tubes-Part 2: Transfer-function method. (1998).
[13]
Gordon S. Kino. 1987. Acoustic Waves: Devices, Imaging, and Analog Signal Processing. Vol. 107. Prentice-Hall, Englewood Cliffs, NJ.
[14]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems. 1097–1105.
[15]
Y. Lecun and L. Bottou. 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE 86, 11 (1998), 2278–2324.
[16]
Yantao Li, Hailong Hu, Zhangqian Zhu, and Gang Zhou. 2020. SCANet: Sensor-based continuous authentication with two-stream convolutional neural networks. ACM Transactions on Sensor Networks 16, 3 (2020), 1–27.
[17]
J. Liu, D. Li, L. Wang, and J. Xiong. 2021. BlinkListener: “Listen” to your eye blink using your smartphone. Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies 5, 2 (2021), 1–27.
[18]
Wenguang Mao, Jian He, and Lili Qiu. 2016. CAT: High-precision acoustic motion tracking. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. 69–81.
[19]
Tauhidur Rahman, Alexander T. Adams, Perry Schein, Aadhar Jain, David Erickson, and Tanzeem Choudhury. 2016. Nutrilyzer: A mobile system for characterizing liquid food with photoacoustic effect. In Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems CD-ROM. 123–136.
[20]
Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556.
[21]
Yu-Chih Tung, Duc Bui, and Kang G. Shin. 2018. Cross-platform support for rapid development of mobile acoustic sensing applications. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. 455–467.
[22]
U.S. FOOD and DRUG ADMINISTRATION. 2004. Overview of Food Ingredients, Additives, Colors. https://www.fda.gov/food/food-ingredients-packaging/overview-food-ingredients-additives-colors/.
[23]
Hideo Utsuno, Toshimitsu Tanaka, Takeshi Fujikawa, and A. F. Seybert. 1989. Transfer function method for measuring characteristic impedance and propagation constant of porous materials. The Journal of the Acoustical Society of America 86, 2 (1989), 637–643.
[24]
R. R. Varior, M. Haloi, and G. Wang. 2016. Gated siamese convolutional neural network architecture for human re-identification. European Conference on Computer Vision. (2016).
[25]
Jue Wang and Dina Katabi. 2013. Dude, where’s my card?: RFID positioning that works with multipath and non-line of sight. Computer Communication Review 43, 4 (2013), 51–62.
[26]
Ju Wang, Jie Xiong, Xiaojiang Chen, Hongbo Jiang, Rajesh Krishna Balan, and Dingyi Fang. 2017. TagScan: Simultaneous target imaging and material identification with commodity RFID devices. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking. 288–300.
[27]
M. R. Weir.2007. Microalbuminuria and cardiovascular disease. Clinical Journal of the American Society of Nephrology 2, 3 (2007), 581–590.
[28]
Binbin Xie, Jie Xiong, Xiaojiang Chen, Eugene Chai, Liyao Li, Zhanyong Tang, and Dingyi Fang. 2019. Tagtag: Material sensing with commodity RFID. In Proceedings of the 17th Conference on Embedded Networked Sensor Systems. 338–350.
[29]
Shichao Yue and Dina Katabi. 2019. Liquid testing with your smartphone. In Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services. 275–286.
[30]
Bin Zhang, Changqin Quan, and Fuji Ren. 2016. Study on CNN in the recognition of emotion in audio and images. In 2016 IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS’16). IEEE, 1–5.
[31]
Fusang Zhang, Zhi Wang, Beihong Jin, Jie Xiong, and Daqing Zhang. 2020. Your smart speaker can “hear” your heartbeat! Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 4 (2020), 1–24.
[32]
Hanbin Zhang, Chen Song, Aosen Wang, Chenhan Xu, Dongmei Li, and Wenyao Xu. 2019. Pdvocal: Towards privacy-preserving Parkinson’s disease detection using non-speech body sounds. In The 25th Annual International Conference on Mobile Computing and Networking. 1–16.

Cited By

View all
  • (2024)UrineSpec: A Lightweight Near-Infrared Spectroscopy System for Metabolite Detection in UrineProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699375(799-810)Online publication date: 4-Nov-2024
  • (2024)ASLiquid: Non-Intrusive Liquid Counterfeit Identification with Your EarphonesProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699321(41-53)Online publication date: 4-Nov-2024
  • (2024)Enabling 6D Pose Tracking on Your Acoustic DevicesProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661875(15-28)Online publication date: 3-Jun-2024
  • Show More Cited By

Index Terms

  1. Akte-Liquid: Acoustic-based Liquid Identification with Smartphones

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Sensor Networks
    ACM Transactions on Sensor Networks  Volume 19, Issue 1
    February 2023
    565 pages
    ISSN:1550-4859
    EISSN:1550-4867
    DOI:10.1145/3561987
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Journal Family

    Publication History

    Published: 21 February 2023
    Online AM: 03 August 2022
    Accepted: 30 June 2022
    Revised: 29 June 2022
    Received: 15 October 2021
    Published in TOSN Volume 19, Issue 1

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Liquid identification
    2. acoustic sensing
    3. mobile sensing
    4. neural networks

    Qualifiers

    • Research-article

    Funding Sources

    • National Natural Science Foundation of China
    • NSFC A3 Foresight Program
    • Shaanxi International Science and Technology Cooperation Program
    • ShaanXi Science and Technology Innovation Team Support Project

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)309
    • Downloads (Last 6 weeks)25
    Reflects downloads up to 10 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)UrineSpec: A Lightweight Near-Infrared Spectroscopy System for Metabolite Detection in UrineProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699375(799-810)Online publication date: 4-Nov-2024
    • (2024)ASLiquid: Non-Intrusive Liquid Counterfeit Identification with Your EarphonesProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699321(41-53)Online publication date: 4-Nov-2024
    • (2024)Enabling 6D Pose Tracking on Your Acoustic DevicesProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661875(15-28)Online publication date: 3-Jun-2024
    • (2024)FSS-TagProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314577:4(1-24)Online publication date: 12-Jan-2024
    • (2024)RF-Symmetry: Contactless Liquid Identification Using Two Symmetrically-Located COTS RFID Tag ArraysIEEE Sensors Journal10.1109/JSEN.2024.344228924:19(30530-30540)Online publication date: 1-Oct-2024
    • (2024)A Wireless Self-Service System for Library Using Commodity RFID DevicesIEEE Internet of Things Journal10.1109/JIOT.2023.330146211:3(4998-5010)Online publication date: 1-Feb-2024
    • (2023)Enhancing Water Pollutant Detection with few Training Samples using Feature Image and Acoustic Signals2023 IEEE/CIC International Conference on Communications in China (ICCC)10.1109/ICCC57788.2023.10233348(1-6)Online publication date: 10-Aug-2023

    View Options

    Get Access

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media