Ubiquitous WiFi and Acoustic Sensing: Principles, Technologies, and Applications
Authors: 
Jia-Ling Huang, Yun-Shu Wang, Yong-Pan Zou, Kai-Shun Wu, Lionel Ming-shuan NiAuthors Info & Claims
Jia-Ling Huang, Yun-Shu Wang, Yong-Pan Zou, Kai-Shun Wu, Lionel Ming-shuan NiAuthors Info & ClaimsPages 25 - 63
Abstract
With the increasing pervasiveness of mobile devices such as smartphones, smart TVs, and wearables, smart sensing, transforming the physical world into digital information based on various sensing medias, has drawn researchers’ great attention. Among different sensing medias, WiFi and acoustic signals stand out due to their ubiquity and zero hardware cost. Based on different basic principles, researchers have proposed different technologies for sensing applications with WiFi and acoustic signals covering human activity recognition, motion tracking, indoor localization, health monitoring, and the like. To enable readers to get a comprehensive understanding of ubiquitous wireless sensing, we conduct a survey of existing work to introduce their underlying principles, proposed technologies, and practical applications. Besides we also discuss some open issues of this research area. Our survey reals that as a promising research direction, WiFi and acoustic sensing technologies can bring about fancy applications, but still have limitations in hardware restriction, robustness, and applicability.
References
[1]
Bahl P, Padmanabhan V N. RADAR: An in-building RF-based user location and tracking system. In Proc. the 19th Annual Joint Conference of the IEEE Computer and Communications Societies, Mar. 2000.
[2]
Halperin D, Hu WJ, Sheth A, and Wetherall D Tool release: Gathering 802.11n traces with channel state information. ACM SIGCOMM Computer Communication Review 2011 41 1 53
[3]
Liu J, Wang Y, Chen Y Y, Yang J, Cheng J. Tracking vital signs during sleep leveraging off-the-shelf WiFi. In Proc. the 16th ACM International Symposium on Mobile Ad Hoc Networking and Computing, Jun. 2015, pp.267–276.
[4]
Liu X F, Cao J N, Tang S J, Wen J Q. Wi-Sleep: Contactless sleep monitoring via WiFi signals. In Proc. the 2014 IEEE Real-Time Systems Symposium, Dec. 2014, pp.346–355.
[5]
Wu C S, Yang Z, Zhou Z M, Liu X F, Liu Y H, Cao J N. Non-invasive detection of moving and stationary human with WiFi. IEEE Journal on Selected Areas in Communications, 2015, 33(11): 2329–2342.
[6]
Liu J, Chen YY, Wang Y, Chen X, Cheng J, and Yang J Monitoring vital signs and postures during sleep using WiFi signals IEEE Internet of Things Journal 2018 5 3 2071-2084
[7]
Wang X Y, Yang C, Mao S W. PhaseBeat: Exploiting CSI phase data for vital sign monitoring with commodity WiFi devices. In Proc. the 37th IEEE International Conference on Distributed Computing Systems, Jun. 2017, pp.1230–1239.
[8]
Wang X Y, Yang C, Mao S W. On CSI-based vital sign monitoring using commodity WiFi. ACM Trans. Computing for Healthcare, 2020, 1(3): Article No. 12.
[9]
Wang YX, Wu KS, and Ni LM WiFall: Device-free fall detection by wireless networks IEEE Trans. Mobile Computing 2017 16 2 581-594
[10]
Wang H, Zhang DQ, Wang YS, Ma JY, Wang YX, and Li SJ RT-Fall: A real-time and contactless fall detection system with commodity WiFi devices IEEE Trans. Mobile Computing 2017 16 2 511-526
[11]
Zhang L, Wang Z R, Yang L. Commercial Wi-Fi based fall detection with environment influence mitigation. In Proc. the 16th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON), Jun. 2019.
[12]
Palipana S, Rojas D, Agrawal P, Pesch D. FallDeFi: Ubiquitous fall detection using commodity Wi-Fi devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2018, 1(4): Article No. 155.
[13]
Hu YQ, Zhang F, Wu CS, Wang BB, and Liu KJR De Fall: Environment-independent passive fall detection using WiFi IEEE Internet of Things Journal 2022 9 11 8515-8530
[14]
Chen S, Yang W, Yang X, Geng Y Y, Xin B Z, Huang L S. AFall: Wi-Fi-based device-free fall detection system using spatial angle of arrival. IEEE Trans. Mobile Computing, 2022.
[15]
Ji S J, Xie Y X, Li M. SiFall: Practical online fall detec tion with RF sensing. arXiv: 2301.03773, 2023. https://arxiv.org/abs/2301.03773, Jan. 2023.
[16]
Yang Z, Zhang Y, Zhang Q. Rethinking fall detection with Wi-Fi. IEEE Trans. Mobile Computing, 2022.
[17]
Wang YC, Yang S, Li F, Wu Y, and Wang Y FallViewer: A fine-grained indoor fall detection system with ubiquitous Wi-Fi devices IEEE Internet of Things Journal 2021 8 15 12455-12466
[18]
Ali K, Liu A X, Wang W, Shahzad M. Keystroke recognition using WiFi signals. In Proc. the 21st Annual Int. Conf. Mobile Computing and Networking, Sept. 2015, pp.90–102.
[19]
Ouyang Z, Srinivasan K. Mudra: User-friendly fine-grained gesture recognition using WiFi signals. In Proc. the 12th International Conference on Emerging Networking EXperiments and Technologies, Dec. 2016, pp.83–96.
[20]
He W F, Wu K S, Zou Y P, Ming Z. WiG: WiFi-based gesture recognition system. In Proc. the 24th International Conference on Computer Communication and Networks (ICCCN), Aug. 2015.
[21]
Zhang Y, Zheng Y, Qian K, Zhang GD, Liu YH, Wu CS, and Yang Z Widar3.0: Zero-effort cross-domain gesture recognition with Wi-Fi. IEEE Trans. Pattern Analysis and Machine Intelligence 2022 44 11 8671-8688
[22]
Venkatnarayan RH, Mahmood S, and Shahzad M WiFi based multi-user gesture recognition IEEE Trans. Mobile Computing 2021 20 3 1242-1256
[23]
Li CN, Liu MN, and Cao ZC WiHF: Gesture and user recognition with WiFi IEEE Trans. Mobile Computing 2022 21 2 757-768
[24]
Tan S, Yang J, and Chen YY Enabling fine-grained finger gesture recognition on commodity WiFi devices IEEE Trans. Mobile Computing 2022 21 8 2789-2802
[25]
Niu K, Zhang FS, Wang XZ, Lv Q, Luo HT, and Zhang DQ Understanding WiFi signal frequency features for position-independent gesture sensing IEEE Trans. Mobile Computing 2021 21 11 4156-4171
[26]
Xiao R, Liu J W, Han J S, Ren K. OneFi: One-shot recognition for unseen gesture via COTS WiFi. In Proc. the 19th ACM Conference on Embedded Networked Sensor Systems, Nov. 2021, pp.206–219.
[27]
Gao R Y, Li W W, Xie Y X, Yi E Z, Wang L Y, Wu D, Zhang D Q. Towards robust gesture recognition by characterizing the sensing quality of WiFi signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2022, 6(1): Article No. 11.
[28]
Zhou Y X, Chen H X, Huang C Y, Zhang Q. WiADv: Practical and robust adversarial attack against WiFi- based gesture recognition system. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2022, 6(2): Article No. 92.
[29]
Wu D, Gao R Y, Zeng Y W, Liu J Y, Wang L Y, Gu T, Zhang D Q. FingerDraw: Sub-wavelength level finger motion tracking with WiFi signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2020, 4(1): Article No. 31.
[30]
Sun L, Sen S, Koutsonikolas D, Kim K H. WiDraw: Enabling hands-free drawing in the air on commodity WiFi devices. In Proc. the 21st Annual International Conference on Mobile Computing and Networking, Sept. 2015, pp.77–89.
[31]
Hernandez S M, Bulut E. Performing WiFi sensing with off-the-shelf smartphones. In Proc. the 2020 IEEE Int. Conf. Pervasive Computing and Communications Workshops (PerCom Workshops), Mar. 2020.
[32]
Zeng Y W, Wu D, Xiong J, Yi E Z, Gao R Y, Zhang D Q. FarSense: Pushing the range limit of WiFi-based respiration sensing with CSI ratio of two antennas. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2019, 3(3): Article No. 121.
[33]
Wang G H, Zou Y P, Zhou Z M, Wu K S, Ni L M. We can hear you with Wi-Fi! In Proc. the 20th ACM Annual International Conference on Mobile Computing and Networking (MobiCom), Sept. 2014, pp.593–604.
[34]
Du C L, Yuan X Q, Lou W J, Hou Y T. Context-free fine-grained motion sensing using WiFi. In Proc. the 15th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON), Jun. 2018.
[35]
Guo X N, Liu B, Shi C, Liu H B, Chen Y Y, Chuah M C. WiFi-enabled smart human dynamics monitoring. In Proc. the 15th ACM Conference on Embedded Network Sensor Systems, Nov. 2017, Article No. 16.
[36]
Xi W, Zhao J Z, Li X Y, Zhao K, Tang S J, Liu X, Jiang Z P. Electronic frog eye: Counting crowd using WiFi. In Proc. the 2014 IEEE Conference on Computer Communications, Apr. 27–May 2, 2014, pp.361–369.
[37]
Zou H, Zhou Y X, Yang J F, Jiang H, Xie L H, Spanos C J. DeepSense: Device-free human activity recognition via autoencoder long-term recurrent convolutional network. In Proc. the 2018 IEEE International Conference on Communications (ICC 2018), May 2018.
[38]
Jiang W J, Miao C L, Ma F L, Yao S C, Wang Y Q, Yuan Y, Xue H F, Song C, Ma X, Koutsonikolas D, Xu W Y, Su L. Towards environment independent device free human activity recognition. In Proc. the 24th Annual Int. Conf. Mobile Computing and Networking, Oct. 2018, pp.289–304.
[39]
Xue H F, Jiang W J, Miao C L, Ma F L, Wang S Y, Yuan Y, Yao S C, Zhang A D, Su L. DeepMV: Multiview deep learning for device-free human activity recognition. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2020, 4(1): Article No. 34.
[40]
Chen ZH, Zhang L, Jiang CY, Cao ZG, and Cui W WiFi CSI based passive human activity recognition using attention based BLSTM IEEE Trans. Mobile Computing 2018 18 11 2714-2724
[41]
Wang W, Liu A X, Shahzad M, Ling K, Lu S L. Understanding and modeling of WiFi signal based human activity recognition. In Proc. the 21st Annual International Conference on Mobile Computing and Networking, Sept. 2015, pp.65–76.
[42]
Zhang F, Wu C S, Wang B B, Lai H Q, Han Y, Liu K J R. WiDetect: Robust motion detection with a statistical electromagnetic model. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2019, 3(3): Article No. 122.
[43]
Wang W, Liu A X, Shahzad M, Ling K, Lu S L. Understanding and modeling of WiFi signal based human activity recognition. In Proc. the 21st Annual International Conference on Mobile Computing and Networking, Sept. 2015, pp.65–76.
[44]
Li S J, Liu Z P, Zhang Y, Lv Q, Niu X P, Wang L Y, Zhang D Q. WiBorder: Precise Wi-Fi based boundary sensing via through-wall discrimination. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2020, 4(3): Article No. 89.
[45]
Li HJ, He X, Chen XK, Fang YY, and Fang Q Wi-Motion: A robust human activity recognition using WiFi signals IEEE Access 2019 7 153287-153299
[46]
Pu Q, Gupta S, Gollakota S, Patel S. Whole-home gesture recognition using wireless signals. In Proc. the 19th Annual International Conference on Mobile Computing & Networking, Sept. 2013, pp.27–38.
[47]
Zheng X L, Wang J L, Shangguan L F, Zhou Z M, Liu Y H. Smokey: Ubiquitous smoking detection with commercial WiFi infrastructures. In Proc. the 35th Annual IEEE Int. Conf. Computer Communications, Apr. 2016.
[48]
Wu XH, Chu ZB, Yang PL, Xiang CC, Zheng X, and Huang WC TW-See: Human activity recognition through the wall with commodity Wi-Fi devices IEEE Trans. Vehicular Technology 2019 68 1 306-319
[49]
Wang H, Zhang D Q, Ma J Y, Wang Y S, Wang Y X, Wu D, Gu T, Xie B. Human respiration detection with commodity WiFi devices: Do user location and body orientation matter? In Proc. the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Sept. 2016, pp.25–36.
[50]
Liu J Y, Zeng Y W, Gu T, Wang L Y, Zhang D Q. Wi-Phone: Smartphone-based respiration monitoring using ambient reflected WiFi signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2021, 5(1): Article No. 23.
[51]
Yin YQ, Yang X, Xiong J, Lee SI, Chen PP, and Niu Q Ubiquitous smartphone-based respiration sensing with Wi-Fi signal IEEE Internet of Things Journal 2022 9 2 1479-1490
[52]
Korany B, Karanam C R, Cai H, Mostofi Y. XModal-ID: Using WiFi for through-wall person identification from candidate video footage. In Proc. the 25th Annual Int. Conf. Mobile Computing and Networking, Aug. 2019, Article No. 36.
[53]
Zeng Y Z, Pathak P H, Mohapatra P. WiWho: WiFi- based person identification in smart spaces. In Proc. the 15th ACM/IEEE International Conference on Information Processing in Sensor Networks, Apr. 2016.
[54]
Zhang J, Wei B, Hu W, Kanhere S S. WiFi-ID: Human identification using WiFi signal. In Proc. the 2016 Int. Conf. Distributed Computing in Sensor Systems, May 2016, pp.75–82.
[55]
Xu Y, Yang W, Wang J X, Zhou X, Li H, Huang L S. WiStep: Device-free step counting with WiFi signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2018, 1(4): Article No. 172.
[56]
Li X, Li S J, Zhang D Q, Xiong J, Wang Y S, Mei H. Dynamic-MUSIC: Accurate device-free indoor localization. In Proc. the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Sept. 2016, pp.196–207.
[57]
Qian K, Wu C S, Yang Z, Liu Y H, Jamieson K. Widar: Decimeter-level passive tracking via velocity monitoring with commodity Wi-Fi. In Proc. the 18th ACM International Symposium on Mobile Ad Hoc Networking and Computing, Jul. 2017, Article No. 6.
[58]
Qian K, Wu C S, Zhang Y, Zhang G D, Yang Z, Liu Y H. Widar2.0: Passive human tracking with a single WiFi link. In Proc. the 16th Annual International Conference on Mobile Systems, Applications, and Services, Jun. 2018, pp.350–361.
[59]
Xie Y X, Xiong J, Li M, Jamieson K. mD-Track: Leveraging multi-dimensionality for passive indoor Wi-Fi tracking. In Proc. the 25th Annual International Conference on Mobile Computing and Networking, Aug. 2019, Article No. 8.
[60]
Abdel-Nasser H, Samir R, Sabek I, Youssef M. Mono-PHY: Mono-stream-based device-free WLAN localization via physical layer information. In Proc. the 2013 IEEE Wireless Communications and Networking Conference, Apr. 2013, pp.4546–4551.
[61]
Wang X Y, Gao L J, Mao S W, Pandey S. DeepFi: Deep learning for indoor fingerprinting using channel state information. In Proc. the 2015 IEEE Wireless Communications and Networking Conference (WCNC), Mar. 2015, pp.1666–1671.
[62]
Li H, Chen X, Wang J, Wu D, Liu X. DAFI: WiFi- based device-free indoor localization via domain adaptation. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2021, 5(4): Article No. 167.
[63]
Alkandari M, Basu D, Hasan S F. A Wi-Fi based passive technique for speed estimation in indoor environments. In Proc. the 2nd Workshop on Recent Trends in Telecommunications Research, Feb. 2017.
[64]
Basu D, Hasan S F. Assessing device-free passive localization with a single access point. In Proc. the 14th International Conference on Dependable, Autonomic and Secure Computing, 14th International Conference on Pervasive Intelligence and Computing, 2nd International Conference on Big Data Intelligence and Computing and Cyber Science and Technology Congress, Aug. 2016, pp.493–496.
[65]
Oguntala G, Obeidat H, Al Khambashi M, Elmegri F, Abd-Alhameed R A, Yuxiang T, Noras J. Design framework for unobtrusive patient location recognition using passive RFID and particle filtering. In Proc. the 2017 Internet Technologies and Applications, Sept. 2017, pp.212–217.
[66]
Xiao J, Wu K S, Yi Y W, Wang L, Ni L M. FIMD: Fine-grained device-free motion detection. In Proc. the 18th IEEE International Conference on Parallel and Distributed Systems, Dec. 2012, pp.229–235.
[67]
Wu K S, Xiao J, Yi Y W, Gao M, Ni L M. FILA: Fine-grained indoor localization. In Proc. the 2012 IEEE INFOCOM, Mar. 2012, pp.2210–2218.
[68]
Jiang GY, Li ML, Liu XJ, Liu WP, Jia YF, Jiang HB, Lei JL, Xiao F, and Zhang K WiDE: WiFi distance based group profiling via machine learning IEEE Trans. Mobile Computing 2023 22 1 607-620
[69]
Chen X, Li H, Zhou CY, Liu X, Wu D, and Dudek G Fidora: Robust WiFi-based indoor localization via unsupervised domain adaptation IEEE Internet of Things Journal 2022 9 12 9872-9888
[70]
Bai Y H, Wang Z J, Zheng K Y, Wang X R, Wang J M. WiDrive: Adaptive WiFi-based recognition of driver activity for real-time and safe takeover. In Proc. the 39th IEEE Int. Conf. Distributed Computing Systems, Jul. 2019, pp.901–911.
[71]
Peng H J, Jia W J. WiFind: Driver fatigue detection with fine-grained Wi-Fi signal features. In Proc. the 2017 IEEE Global Communications Conference, Dec. 2017.
[72]
Kong H, Lu L, Yu J D, Chen Y Y, Kong L H, Li M L. FingerPass: Finger gesture-based continuous user authentication for smart homes using commodity WiFi. In Proc. the 20th ACM International Symposium on Mobile Ad Hoc Networking and Computing, Jul. 2019, pp.201–210.
[73]
Lu H, Pan W, Lane N D, Choudhury T, Campbell A T. SoundSense: Scalable sound sensing for people-centric applications on mobile phones. In Proc. the 7th Int. Conf. Mobile Systems, Applications, and Services, Jun. 2009, pp.165–178.
[74]
Yatani K, Truong K N. BodyScope: A wearable acoustic sensor for activity recognition. In Proc. the 2012 ACM Conference on Ubiquitous Computing, Sept. 2012, pp.341–350.
[75]
Prakash J, Yang Z J, Wei Y L, Hassanieh H, Choudhury R R. EarSense: Earphones as a teeth activity sensor. In Proc. the 26th Annual International Conference on Mobile Computing and Networking, Apr. 2020, Article No. 40.
[76]
Xie Y D, Li F, Wu Y, Wang Y. HearFit: Fitness monitoring on smart speakers via active acoustic sensing. In Proc. the 2021 IEEE Conference on Computer Communications, May 2021.
[77]
Liang D W, Thomaz E. Audio-based activities of daily living (ADL) recognition with large-scale acoustic embeddings from online videos. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2019, 3(1): Article No. 17.
[78]
Nicolaou P, Efstratiou C. Tracking daily routines of elderly users through acoustic sensing: An unsupervised learning approach. In Proc. the 2022 IEEE International Conference on Pervasive Computing and Communications Workshops and Other Affiliated Events (PerCom Workshops), Mar. 2022, pp.391–396.
[79]
Aumi M T I, Gupta S, Goel M, Larson E, Patel S. DopLink: Using the Doppler effect for multi-device interaction. In Proc. the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Sept. 2013, pp.583–586.
[80]
Yang Q F, Tang H, Zhao X B, Li Y, Zhang S F. Dolphin: Ultrasonic-based gesture recognition on smartphone platform. In Proc. the 17th IEEE International Conference on Computational Science and Engineering, Dec. 2014, pp.1461–1468.
[81]
Sun K, Zhao T, Wang W, Xie L. VSkin: Sensing touch gestures on surfaces of mobile devices using acoustic signals. In Proc. the 24th Annual International Conference on Mobile Computing and Networking, Oct. 2018, pp.591–605.
[82]
Zhang Y T, Wang J L, Wang W Y, Wang Z, Liu Y H. Vernier: Accurate and fast acoustic motion tracking using mobile devices. In Proc. the 2018 IEEE Conference on Computer Communications, Apr. 2018, pp.1709–1717.
[83]
Luo G, Chen M S, Li P, Zhang M T, Yang P L. Sound-Write II: Ambient acoustic sensing for noise tolerant device-free gesture recognition. In Proc. the 23rd IEEE International Conference on Parallel and Distributed Systems (ICPADS), Dec. 2017, pp.121–126.
[84]
Wang W, Liu A X, Sun K. Device-free gesture tracking using acoustic signals. In Proc. the 22nd Annual International Conference on Mobile Computing and Networking, Oct. 2016, pp.82–94.
[85]
Ling K, Dai HP, Liu YT, Liu AX, Wang W, and Gu Q UltraGesture: Fine-grained gesture sensing and recognition IEEE Trans. Mobile Computing 2020 21 7 2620-2636
[86]
Wang YW, Shen JX, and Zheng YQ Push the limit of acoustic gesture recognition IEEE Trans. Mobile Computing 2020 21 5 1798-1811
[87]
Wang P H, Jiang R B, Liu C. Amaging: Acoustic hand imaging for self-adaptive gesture recognition. In Proc. the 2022 IEEE Conference on Computer Communications, May 2022, pp.80–89.
[88]
Larson E C, Goel M, Boriello G, Heltshe S, Rosenfeld M, Patel S N. SpiroSmart: Using a microphone to measure lung function on a mobile phone. In Proc. the 2012 ACM Conference on Ubiquitous Computing, Sept. 2012, pp.280–289.
[89]
Qian K, Wu C S, Xiao F, Zheng Y, Zhang Y, Yang Z, Liu Y H. Acousticcardiogram: Monitoring heartbeats using acoustic signals on smart devices. In Proc. the 2018 IEEE Conference on Computer Communications, Apr. 2018, pp.1574–1582.
[90]
Song X Z, Yang B Y, Yang G, Chen R R, Forno E, Chen W, Gao W. SpiroSonic: Monitoring human lung function via acoustic sensing on commodity smartphones. In Proc. the 26th Annual International Conference on Mobile Computing and Networking, Apr. 2020, Article No. 52.
[91]
Wan H R, Shi S Y, Cao W Y, Wang W, Chen G H. RespTracker: Multi-user room-scale respiration tracking with commercial acoustic devices. In Proc. the 2021 IEEE Conference on Computer Communications, May 2021.
[92]
Vernon J, Canyelles-Pericas P, Torun H, Binns R, Ng W P, Fu Y Q. Apnoea-Pi: Sleep disorder monitoring with open-source electronics and acoustics. In Proc. the 26th Int. Conf. Automation and Computing (ICAC), Sept. 2021.
[93]
Liu K K, Liu X X, Li X L. Guoguo: Enabling fine-grained indoor localization via smartphone. In Proc. the 11th Annual International Conference on Mobile Systems, Applications, and Services, Jun. 2013, pp.235–248.
[94]
Zhou B, Elbadry M, Gao R P, Ye F. BatMapper: Acoustic sensing based indoor floor plan construction using smartphones. In Proc. the 15th Annual International Conference on Mobile Systems, Applications, and Services, Jun. 2017, pp.42–55.
[95]
Pradhan S, Baig G, Mao W G, Qiu L L, Chen G H, Yang B. Smartphone-based acoustic indoor space mapping. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2018, 2(2): Article No. 75.
[96]
Wijers M, Loveridge A, Macdonald DW, and Markham A CARACAL: A versatile passive acoustic monitoring tool for wildlife research and conservation Bioacoustics 2021 30 1 41-57
[97]
Dong LJ, Tao Q, Hu QC, Deng SJ, Chen YC, Luo QM, and Zhang XH Acoustic emission source location method and experimental verification for structures containing unknown empty areas International Journal of Mining Science and Technology 2022 32 3 487-497
[98]
Kafle MD, Fong S, and Narasimhan S Active acoustic leak detection and localization in a plastic pipe using time delay estimation Applied Acoustics 2022 187 108482
[99]
Wang J J, Zhao K C, Zhang X Y, Peng C Y. Ubiquitous keyboard for small mobile devices: Harnessing multipath fading for fine-grained keystroke localization. In Proc. the 12th Annual International Conference on Mobile Systems, Applications, and Services, Jun. 2014, pp.14–27.
[100]
Alegre F, Vipperla R, Evans N, Fauve B. On the vulnerability of automatic speaker recognition to spoofing attacks with artificial signals. In Proc. the 20th European Signal Processing Conference (EUSIPCO), Aug. 2012, pp.36–40.
[101]
Chauhan J, Hu Y N, Seneviratne S, Misra A, Seneviratne A, Lee Y. BreathPrint: Breathing acoustics-based user authentication. In Proc. the 15th Annual Int. Conf. Mobile Systems, Applications, and Services, Jun. 2017, pp.278–291.
[102]
Zhang G M, Yan C, Ji X Y, Zhang T C, Zhang T M, Xu W Y. DolphinAttack: Inaudible voice commands. In Proc. the 2017 ACM SIGSAC Conference on Computer and Communications Security, Oct. 2017, pp.103–117.
[103]
Yuan X J, Chen Y X, Zhao Y, Long Y H, Liu X K, Chen K, Zhang S Z, Huang H Q, Wang X F, Gunter C A. CommanderSong: A systematic approach for practical adversarial voice recognition. arXiv: 1801.08535, 2018. https://arxiv.org/abs/1801.08535, Jan. 2023.
[104]
Gao Y, Wang W, Phoha V V, Sun W, Jin Z P. EarEcho: Using ear canal echo for wearable authentication. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2019, 3(3): Article No. 81.
[105]
Lu L, Yu J D, Chen Y Y, Liu H B, Zhu Y M, Liu Y F, Li M L. LipPass: Lip reading-based user authentication on smartphones leveraging acoustic signals. In Proc. the 2018 IEEE Conference on Computer Communications, Apr. 2018, pp.1466–1474.
[106]
Chen M Q, Lin J W, Zou Y P, Ruby R, Wu K S. SilentSign: Device-free handwritten signature verification through acoustic sensing. In Proc. the 2020 IEEE International Conference on Pervasive Computing and Communications (PerCom), Mar. 2020.
[107]
Ferlini A, Ma D, Harle R, Mascolo C. EarGate: Gaitbased user identification with in-ear microphones. In Proc. the 27th Annual International Conference on Mobile Computing and Networking, Oct. 2021, pp.337–349.
[108]
Ren Y Z, Wen P, Liu H B, Zheng Z R, Chen Y Y, Huang P C, Li H W. Proximity-Echo: Secure two factor authentication using active sound sensing. In Proc. the 2021 IEEE Conference on Computer Communications, May 2021.
[109]
Balagani K, Cardaioli M, Cecconello S, Conti M, Tsudik G. We can hear your PIN drop: An acoustic side-channel attack on ATM PIN pads. In Proc. the 27th European Symposium on Research in Computer Security, Sept. 2022, pp.633–652.
[110]
Xie Y D, Li F, Wu Y, Chen H J, Zhao Z Y, Wang Y. TeethPass: Dental occlusion-based user authentication via in-ear acoustic sensing. In Proc. the 2022 IEEE Conference on Computer Communications, May 2022, pp.1789–1798.
[111]
Wang Z, Ren Y L, Chen Y Y, Yang J. ToothSonic: Earable authentication via acoustic toothprint. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2022, 6(2): Article No. 78.
[112]
Ma Y S, Zhou G, Wang S Q. WiFi sensing with channel state information: A survey. ACM Computing Surveys, 2019, 52(3): Article No. 46.
[113]
Xie Y X, Li Z J, Li M. Precise power delay profiling with commodity WiFi. In Proc. the 21st Annual International Conference on Mobile Computing and Networking, Sept. 2015, pp.53–64.
[114]
Jiang Z P, Luan T H, Ren X C, Lv D T, Hao H, Wang J, Zhao K, Xi W, Xu Y S, Li R. Eliminating the barriers: Demystifying Wi-Fi baseband design and introducing the PicoScenes Wi-Fi sensing platform. IEEE Internet of Things Journal, 2022, 9(6): 4476–4496.
[115]
Zheng F, Zhang G L, Song Z J. Comparison of different implementations of MFCC. Journal of Computer Science and Technology, 2001, 16(6): 582–589.
[116]
Pedretti L W, Early M B. Occupational Therapy: Practice Skills for Physical Dysfunction. Mosby London, 2001.
[117]
Santhalingam P S, Hosain A A, Zhang D, Pathak P, Rangwala H, Kushalnagar R. mmASL: Environment-independent ASL gesture recognition using 60 GHz millimeter-wave signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2020, 4(1): Article No. 26.
[118]
Gallo P, Mangione S. RSS-eye: Human-assisted indoor localization without radio maps. In Proc. the 2015 IEEE International Conference on Communications, Jun. 2015, pp.1553–1558.
[119]
Liu H, Darabi H, Banerjee P, and Liu J Survey of wireless indoor positioning techniques and systems IEEE Trans. Systems, Man, and Cybernetics, Part C (Applications and Reviews) 2007 37 6 1067-1080
[120]
Pahlavan K, Li XR, and Makela JP Indoor geolocation science and technology IEEE Communications Magazine 2002 40 2 112-118
[121]
Chen K Y, Ashbrook D, Goel M, Lee S H, Patel S. Air-Link: Sharing files between multiple devices using in-air gestures. In Proc. the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Sept. 2014, pp.565–569.
[122]
Zhang M T, Yang P L, Tian C, Shi L, Tang S J, Xiao F. SoundWrite: Text input on surfaces through mobile acoustic sensing. In Proc. the 1st International Workshop on Experiences with the Design and Implementation of Smart Objects, Sept. 2015, pp.13–17.
[123]
Wang X, Sun K, Zhao T, Wang W, Gu Q. Dynamic speed warping: Similarity-based one-shot learning for device-free gesture signals. In Proc. the 2020 IEEE Conference on Computer Communications, Jul. 2020, pp.556–565.
[124]
Weiss K, Khoshgoftaar T M, Wang D D. A survey of transfer learning. Journal of Big Data, 2016, 3(1): Article No. 9.
[125]
Wang Y Q, Yao Q M, Kwok J T, Ni L M. Generalizing from a few examples: A survey on few-shot learning. ACM Computing Surveys, 2021, 53(3): Article No. 63.
[126]
Yi X, Walia E, and Babyn P Generative adversarial network in medical imaging: A review Medical Image Analysis 2019 58 101552
[127]
Ozcan T and Basturk A Transfer learning-based convolutional neural networks with heuristic optimization for hand gesture recognition Neural Computing and Applications 2019 31 12 8955-8970
[128]
Rahimian E, Zabihi S, Asif A, Farina D, Atashzar SF, and Mohammadi A FS-HGR: Few-shot learning for hand gesture recognition via electromyography. IEEE Trans. Neural Systems and Rehabilitation Engineering 2021 29 1004-1015
[129]
Wang J, Zhang L, Wang CC, Ma XR, Gao QH, and Lin B Device-free human gesture recognition with generative adversarial networks IEEE Internet of Things Journal 2020 7 8 7678-7688
[130]
Liu C, Wang P H, Jiang R B, Zhu Y M. AMT: Acoustic multi-target tracking with smartphone MIMO system. In Proc. the 2021 IEEE Conference on Computer Communications, May 2021.
[131]
Yun S K, Chen Y C, Qiu L L. Turning a mobile device into a mouse in the air. In Proc. the 13th Annual International Conference on Mobile Systems, Applications, and Services, May 2015, pp.15–29.
[132]
Mao W G, He J, Qiu L L. CAT: High-precision acoustic motion tracking. In Proc. the 22nd Annual International Conference on Mobile Computing and Networking, Oct. 2016, pp.69–81.
[133]
Chen H J, Li F, Wang Y. EchoTrack: Acoustic device- free hand tracking on smart phones. In Proc. the 2017 IEEE Conference on Computer Communications, May 2017.
[134]
Nandakumar R, Iyer V, Tan D, Gollakota S. FingerIO: Using active sonar for fine-grained finger tracking. In Proc. the 2016 CHI Conference on Human Factors in Computing Systems, May 2016, pp.1515–1525.
[135]
Yun S K, Chen Y C, Zheng H H, Qiu L L, Mao W G. Strata: Fine-grained acoustic-based device-free tracking. In Proc. the 15th Annual International Conference on Mobile Systems, Applications, and Services, Jun. 2017, pp.15–28.
[136]
Lu L, Liu J, Yu JD, Chen YY, Zhu YM, Kong LH, and Li ML Enable traditional laptops with virtual writing capability leveraging acoustic signals The Computer Journal 2021 64 12 1814-1831
[137]
Liu Y, Zhang W X, Yang Y, Fang W D, Qin F, Dai X W. PAMT: Phase-based acoustic motion tracking in multipath fading environments. In Proc. the 2019 IEEE Conference on Computer Communications, Apr. 29–May 2, 2019, pp.2386–2394.
[138]
Kumar M, Veeraraghavan A, and Sabharwal A DistancePPG: Robust non-contact vital signs monitoring using a camera Biomedical Optics Express 2015 6 5 1565-1588
[139]
Jia Z H, Bonde A, Li S G, Xu C R, Wang J X, Zhang Y Y, Howard R E, Zhang P. Monitoring a person’s heart rate and respiratory rate on a shared bed using geophones. In Proc. the 15th ACM Conference on Embedded Network Sensor Systems (SenSys 2017), Nov. 2017, Article No. 6.
[140]
Jia Z H, Alaziz M, Chi X, Howard R E, Zhang Y Y, Zhang P, Trappe W, Sivasubramaniam A, An N. HB- phone: A bed-mounted geophone-based heartbeat monitoring system. In Proc. the 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN), Apr. 2016.
[141]
Li FY, Valero M, Shahriar H, Khan RA, and Ahamed SI Wi-COVID: A COVID-19 symptom detection and patient monitoring framework using WiFi Smart Health 2021 19 100147
[142]
Nandakumar R, Gollakota S, Watson N. Contactless sleep apnea detection on smartphones. In Proc. the 13th Annual International Conference on Mobile Systems, Applications, and Services, May 2015, pp.45–57.
[143]
Li Y, Zeng Z L, Popescu M, Ho K C. Acoustic fall detection using a circular microphone array. In Proc. the 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, Aug. 31–Sept. 4, 2010, pp.2242–2245.
[144]
Ren Y Z, Wang C, Yang J, Chen Y Y. Fine-grained sleep monitoring: Hearing your breathing with smartphones. In Proc. the 2015 IEEE Conference on Computer Communications (INFOCOM), Apr. 26–May 1, 2015, pp.1194–1202.
[145]
Yang J, Sidhom S, Chandrasekaran G, Vu T, Liu H B, Cecan N, Chen Y Y, Gruteser M, Martin R P. Detecting driver phone use leveraging car speakers. In Proc. the 17th Annual International Conference on Mobile Computing and Networking, Sept. 2011, pp.97–108.
[146]
Xu X Y, Gao H, Yu J D, Chen Y Y, Zhu Y M, Xue G T, Li M L. ER: Early recognition of inattentive driving leveraging audio devices on smartphones. In Proc. the 2017 IEEE Conference on Computer Communications, May 2017.
[147]
Xu XY, Yu JD, Chen YY, Zhu YM, Qian SY, and Li ML Leveraging audio signals for early recognition of inattentive driving with smartphones IEEE Trans. Mobile Computing 2018 17 7 1553-1567
[148]
Xu X Y, Yu J D, Chen Y Y, Zhu Y M, Kong L H, Li M L. BreathListener: Fine-grained breathing monitoring in driving environments utilizing acoustic signals. In Proc. the 17th Annual International Conference on Mobile Systems, Applications, and Services, Jun. 2019, pp.54–66.
[149]
Liu S C, Zhou Z M, Du J Z, Shangguan L F, Han J, Wang X. UbiEar: Bringing location-independent sound awareness to the hard-of-hearing people with smartphones. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2017, 1(2): Article No. 17.
[150]
Nishimura Y, Imai N, Yoshihara K. A proposal on direction estimation between devices using acoustic waves. In Proc. the 8th International Conference on Mobile and Ubiquitous Systems: Computing, Networking, and Services, Dec. 2011, pp.25–36.
[151]
Zhang Z B, Chu D, Chen X M, Moscibroda T. Sword- Fight: Enabling a new class of phone-to-phone action games on commodity phones. In Proc. the 10th International Conference on Mobile Systems, Applications, and Services, Jun. 2012, pp.1–14.
[152]
Liu H B, Gan Y, Yang J, Sidhom S, Wang Y, Chen Y Y, Ye F. Push the limit of WiFi based localization for smartphones. In Proc. the 18th Annual International Conference on Mobile Computing and Networking, Aug. 2012, pp.305–316.
[153]
Nandakumar R, Chintalapudi K K, Padmanabhan V N. Centaur: Locating devices in an office environment. In Proc. the 18th Annual International Conference on Mobile Computing and Networking, Aug. 2012, pp.281–292.
[154]
Tarzia S P, Dinda P A, Dick R P, Memik G. Indoor localization without infrastructure using the acoustic background spectrum. In Proc. the 9th International Conference on Mobile Systems, Applications, and Services, Jun. 2011, pp.155–168.
[155]
Tung Y C, Shin K G. EchoTag: Accurate infrastructure- free indoor location tagging with smartphones. In Proc. the 21st Annual International Conference on Mobile Computing and Networking, Sept. 2015, pp.525–536.
[156]
Huang W C, Xiong Y, Li X Y, Lin H, Mao X F, Yang P L, Liu Y H. Shake and walk: Acoustic direction finding and fine-grained indoor localization using smartphones. In Proc. the 2014 IEEE Conference on Computer Communications, Apr. 27–May 2, 2014, pp.370–378.
[157]
Zhu T, Ma Q, Zhang S F, Liu Y H. Context-free attacks using keyboard acoustic emanations. In Proc. the 2014 ACM SIGSAC Conference on Computer and Communications Security, Nov. 2014, pp.453–464.
[158]
Liu J, Wang Y, Kar G, Chen Y Y, Yang J, Gruteser M. Snooping keystrokes with mm-level audio ranging on a single phone. In Proc. the 21st Annual International Conference on Mobile Computing and Networking, Sept. 2015, pp.142–154.
[159]
Liu X Y, Zhou Z, Diao W R, Li Z, Zhang K H. When good becomes evil: Keystroke inference with smartwatch. In Proc. the 22nd ACM SIGSAC Conference on Computer and Communications Security, Oct. 2015, pp.1273– 1285.
[160]
Fang YY, Zhao ZW, Wang Z, Min GY, Cao Y, Huang HJ, and Yin H Eavesdrop with PoKeMon: Position free keystroke monitoring using acoustic data Future Generation Computer Systems 2018 87 704-711
[161]
Wu ZZ, Evans N, Kinnunen T, Yamagishi J, Alegre F, and Li HZ Spoofing and countermeasures for speaker verification: A survey Speech Communication 2015 66 130-153
[162]
Wu Z Z, Gao S, Cling E S, Li H Z. A study on replay attack and anti-spoofing for text-dependent speaker verification. In Proc. the 2014 Signal and Information Processing Association Annual Summit and Conference (APSIPA), Dec. 2014.
[163]
Wu Z Z, Li H Z. Voice conversion and spoofing attack on speaker verification systems. In Proc. the 2013 Asia- Pacific Signal and Information Processing Association Annual Summit and Conference, Oct. 29–Nov. 1, 2013.
[164]
Carlini N, Mishra P, Vaidya T, Zhang Y K, Sherr M, Shields C, Wagner D, Zhou W C. Hidden voice commands. In Proc. the 25th USENIX Security Symposium (USENIX Security 16), Aug. 2016, pp.513–530.
[165]
Carlini N, Wagner D. Audio adversarial examples: Targeted attacks on speech-to-text. In Proc. the 2018 IEEE Security and Privacy Workshops (SPW), May 2018.
[166]
Kasmi C and Esteves JL IEMI threats for information security: Remote command injection on modern smartphones IEEE Trans. Electromagnetic Compatibility 2015 57 6 1752-1755
[167]
Wei L Q, Long Y H, Wei H R, Li Y J. New acoustic features for synthetic and replay spoofing attack detection. Symmetry, 2022, 14(2): Article No. 274.
[168]
Zhou B, Lohokare J, Gao R P, Ye F. EchoPrint: Two- factor authentication using acoustics and vision on smartphones. In Proc. the 24th Annual International Conference on Mobile Computing and Networking, Oct. 2018, pp.321–336.
[169]
Zou Y P, Zhao M, Zhou Z M, Lin J W, Li M, Wu K S. BiLock: User authentication via dental occlusion biometrics. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2018, 2(3): Article No. 152.
[170]
Xu W, Yu Z W, Wang Z, Guo B, Han Q. AcousticID: Gait-based human identification using acoustic signal. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2019, 3(3): Article No. 115.
[171]
Ding F, Wang D, Zhang Q, Zhao R. ASSV: Handwritten signature verification using acoustic signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2019, 3(3): Article No. 80.
[172]
Shrestha P, Shrestha B, Saxena N. Home alone: The insider threat of unattended wearables and a defense using audio proximity. In Proc. the 2018 IEEE Conference on Communications and Network Security (CNS), May 30–Jun 1, 2018.
[173]
Shrestha P, Saxena N. Listening watch: Wearable two- factor authentication using speech signals resilient to near-far attacks. In Proc. the 11th ACM Conference on Security & Privacy in Wireless and Mobile Networks, Jun. 2018, pp.99–110.
[174]
Feng H, Fawaz K, Shin K G. Continuous authentication for voice assistants. In Proc. the 23rd Annual International Conference on Mobile Computing and Networking, Oct. 2017, pp.343–355.
[175]
Chen S, Ren K, Piao S X, Wang C, Wang Q, Weng J, Su L, Mohaisen A. You can hear but you cannot steal: Defending against voice impersonation attacks on smartphones. In Proc. the 37th IEEE International Conference on Distributed Computing Systems (ICDCS), Jun. 2017, pp.183–195.
[176]
Wang Q, Lin X, Zhou M, Chen Y J, Wang C, Li Q, Luo X Y. VoicePop: A pop noise based anti-spoofing system for voice authentication on smartphones. In Proc. the 2019 IEEE Conference on Computer Communications, Apr. 29–May 2, 2019, pp.2062–2070.
[177]
Yan C, Ji X Y, Wang K, Jiang Q H, Jin Z Z, Xu W Y. A survey on voice assistant security: Attacks and countermeasures. ACM Computing Surveys, 2022, 55(4): Article No. 84.
[178]
Wang F, Zhou S P, Panev S, Han J S, Huang D. Personin-WiFi: Fine-grained person perception using WiFi. In Proc. the 2019 IEEE/CVF International Conference on Computer Vision, Oct. 27–Nov. 2, 2019, pp.5451–5460.
[179]
Li C N, Liu Z, Yao Y G, Cao Z C, Zhang M, Liu Y H. Wi-Fi see it all: Generative adversarial network-augmented versatile Wi-Fi imaging. In Proc. the 18th Conference on Embedded Networked Sensor Systems, Nov. 2020, pp.436–448.
[180]
Yang Q, Wu H X, Huang Q Y, Zhang J, Chen H, Li W C, Tao X F, Zhang Q. Side-lobe can know more: Towards simultaneous communication and sensing for mmWave. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2023, 6(4): Article No. 191.
[181]
Huang QY, Luo ZQ, Zhang J, Wang W, and Zhang Q Lo- Radar: Enabling concurrent radar sensing and LoRa communication IEEE Trans. Mobile Computing 2022 21 6 2045-2057
[182]
Wang J, Varshney N, Gentile C, Blandino S, Chuang J, and Golmie N Integrated sensing and communication: Enabling techniques, applications, tools and data sets, standardization, and future directions IEEE Internet of Things Journal 2022 9 23 23416-23440
Recommendations
WiFi Sensing with Channel State Information: A Survey
With the high demand for wireless data traffic, WiFi networks have experienced very rapid growth, because they provide high throughput and are easy to deploy. Recently, Channel State Information (CSI) measured by WiFi networks is widely used for ...
Enabling WiFi Sensing on New-generation WiFi Cards
The last few years have witnessed the rapid development of WiFi sensing with a large spectrum of applications enabled. However, existing works mainly leverage the obsolete 802.11n WiFi cards (i.e., Intel 5300 and Atheros AR9k series cards) for sensing. ...
Comments
Information & Contributors
Information
Published In
© Institute of Computing Technology, Chinese Academy of Sciences 2023.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 31 January 2023
Accepted: 23 January 2023
Received: 04 January 2023
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 10 Aug 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in