research-article

Augmenting User Identification with WiFi Based Gesture Recognition

Authors:

Muhammad Shahzad,

Shaohu ZhangAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 2, Issue 3

Article No.: 134, Pages 1 - 27

https://doi.org/10.1145/3264944

Published: 18 September 2018 Publication History

Abstract

Over the last few years, researchers have proposed several WiFi based gesture recognition systems that can recognize predefined gestures performed by users at runtime. As most environments are inhabited by multiple users, the true potential of WiFi based gesture recognition can be unleashed only when each user can independently define the actions that the system should take when the user performs a certain predefined gesture. To enable this, a gesture recognition system should not only be able to recognize any given predefined gesture, but should also be able to identify the user that performed it. Unfortunately, none of the prior WiFi based gesture recognition systems can identify the user performing the gesture. In this paper, we propose WiID, a WiFi and gesture based user identification system that can identify the user as soon as he/she performs a predefined gesture at runtime. WiID integrates with the WiFi based gesture recognition systems as an add-on module whose sole objective is to identify the users that perform the predefined gestures. The design of WiID is based on our novel result which states that the timeseries of the frequencies that appear in WiFi channel's frequency response while performing a given gesture are different in the samples of that gesture performed by different users, and are similar in the samples of that gesture performed by the same user. We implemented and extensively evaluated WiID in a variety of environments using a comprehensive data set comprising over 25,000 gesture samples.

References

[1]

{n. d.}. https://www.ettus.com/product/category/USRP-Networked-Series. ({n. d.}).

[2]

{n. d.}. Ambient OS. https://www.essential.com/blog/home-now-has-an-os. ({n. d.}).

[3]

{n. d.}. Coefficient of Variation. https://en.wikipedia.org/wiki/Coefficient_of_variation. ({n. d.}).

[4]

{n. d.}. Contiki: The Open Source OS for the Internet of Things. http://www.contiki-os.org/. ({n. d.}).

[5]

{n. d.}. Google Wi-Fi Mesh. https://store.google.com/us/product/google_wifi_learn?hl=en-US. ({n. d.}).

[6]

{n. d.}. House Operating System (HOS). http://www.houseoperatingsystem.com/. ({n. d.}).

[7]

{n. d.}. Spectrogram. https://en.wikipedia.org/wiki/Spectrogram. ({n. d.}).

[8]

{n. d.}. Unity-based normalization. https://en.wikipedia.org/wiki/Normalization_(statistics). ({n. d.}).

[9]

{n. d.}. USRP N210. https://www.ettus.com/product/details/UN210-KIT. ({n. d.}).

[10]

Heba Abdelnasser, Moustafa Youssef, and Khaled A Harras. 2015. WiGest: A ubiquitous Wi-Fi-based gesture recognition system. In Proceedings of IEEE INFOCOM.

[11]

Fadel Adib and Dina Katabi. 2013. See Through Walls with Wi-Fi!. In Proceedings of the ACM SIGCOMM 2013 Conference on SIGCOMM (SIGCOMM '13). ACM, New York, NY, USA, 75--86.

Digital Library

[12]

Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C Miller. 2015. Smart homes that monitor breathing and heart rate. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, 837--846.

Digital Library

[13]

Kamran Ali, Alex Xiao Liu, Wei Wang, and Muhammad Shahzad. 2015. Keystroke Recognition Using Wi-Fi Signals. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 90--102.

Digital Library

[14]

Kamran Ali, Alex X Liu, Wei Wang, and Muhammad Shahzad. 2017. Recognizing Keystrokes Using Wi-Fi Devices. IEEE Journal on Selected Areas in Communications 35, 5 (2017), 1175--1190.

[15]

Chih-Chung Chang and Chin-Jen Lin. 2011. LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2, 3 (2011), 27:1--27.

Digital Library

[16]

Yuanying Chen, Wei Dong, Yi Gao, Xue Liu, and Tao Gu. 2017. Rapid: a multimodal and device-free approach using noise estimation for robust person identification. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 41.

Digital Library

[17]

Colin Dixon, Ratul Mahajan, Sharad Agarwal, AJ Brush, Bongshin Lee, Stefan Saroiu, and Paramvir Bahl. 2012. An operating system for the home. In Proceedings of the 9th USENIX conference on Networked Systems Design and Implementation. USENIX Association, 25--25.

Digital Library

[18]

Biyi Fang, Nicholas D Lane, Mi Zhang, Aidan Boran, and Fahim Kawsar. 2016. BodyScan: Enabling radio-based sensing on wearable devices for contactless activity and vital sign monitoring. In Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 97--110.

Digital Library

[19]

Biyi Fang, Nicholas D Lane, Mi Zhang, and Fahim Kawsar. 2016. Headscan: A wearable system for radio-based sensing of head and mouth-related activities. In Proceedings of the 15th International Conference on Information Processing in Sensor Networks. IEEE Press, 21.

Digital Library

[20]

Daniel Halperin, Wenjun Hu, Anmol Sheth, and David Wetherall. 2011. Tool Release: Gathering 802.11n Traces with Channel State Information. ACM SIGCOMM CCR 41, 1 (Jan. 2011), 53.

Digital Library

[21]

Chunmei Han, Kaishun Wu, Yuxi Wang, and Lionel M Ni. 2014. WiFall: Device-free fall detection by wireless networks. In Proceedings of IEEE INFOCOM. 271--279.

[22]

Feng Hong, Xiang Wang, Yanni Yang, Yuan Zong, Yuliang Zhang, and Zhongwen Guo. 2016. WFID: passive device-free human identification using Wi-Fi signal. In Proceedings of the 13th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services. ACM, 47--56.

Digital Library

[23]

S. Sathiya Keerthi and Chih-Jen Lin. 2003. Asymptotic behaviors of support vector machines with Gaussian kernel. Neural computation 15, 7 (2003), 1667--1689.

Digital Library

[24]

Bryce Kellogg, Vamsi Talla, and Shyamnath Gollakota. 2014. Bringing Gesture Recognition to All Devices. In Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation (NSDI'14). USENIX Association, Berkeley, CA, USA, 303--316.

Digital Library

[25]

Jiguang Lv, Wu Yang, Dapeng Man, Xiaojiang Du, Miao Yu, and Mohsen Guizani. 2017. Wii: Device-Free Passive Identity Identification via Wi-Fi Signals. In GLOBECOM 2017-2017 IEEE Global Communications Conference. IEEE, 1--6.

[26]

Qifan Pu, Sidhant Gupta, Shyamnath Gollakota, and Shwetak Patel. 2013. Whole-home Gesture Recognition Using Wireless Signals. In Proceedings of the 19th ACM MobiCom (MobiCom '13). ACM, New York, NY, USA, 27--38.

Digital Library

[27]

Bernhard SchÃűlkopf, John C. Platt, John Shawe-Taylor, Alex J. Smola, and Robert C. Williamson. 2001. Estimating the support of a high-dimensional distribution. Neural computation 13, 7 (2001), 1443--1471.

Digital Library

[28]

Muhammad Shahzad, Alex X Liu, and Arjmand Samuel. 2013. Secure unlocking of mobile touch screen devices by simple gestures: You can see it but you can not do it. In Proceedings of the 19th ACM MobiCom. ACM, 39--50.

Digital Library

[29]

Muhammad Shahzad, Alex X Liu, and Arjmand Samuel. 2015. Behavior Based Human Authentication on Touch Screen Devices Using Gestures and Signatures. Mobile Computing, IEEE Transactions on 23, 1 (2015), 241--254.

Digital Library

[30]

Li Sun, Souvik Sen, Dimitrios Koutsonikolas, and Kyu-Han Kim. 2015. Widraw: Enabling hands-free drawing in the air on commodity wifi devices. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 77--89.

Digital Library

[31]

Sheng Tan and Jie Yang. 2016. Wi-Finger: leveraging commodity Wi-Fi for fine-grained finger gesture recognition. In Proceedings of the 17th ACM International Symposium on Mobile Ad Hoc Networking and Computing. ACM, 201--210.

Digital Library

[32]

Raghav H Venkatnarayan, Griffin Page, and Muhammad Shahzad. 2018. Multi-User Gesture Recognition Using Wi-Fi. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 401--413.

Digital Library

[33]

Aditya Virmani and Muhammad Shahzad. 2017. Position and Orientation Agnostic Gesture Recognition Using Wi-Fi. In Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services. ACM, 252--264.

Digital Library

[34]

Wei Wang, Alex X Liu, and Muhammad Shahzad. 2016. Gait recognition using wifi signals. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 363--373.

Digital Library

[35]

Wei Wang, Alex X Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2015. Understanding and Modeling of Wi-Fi Signal Based Human Activity Recognition. In Proceedings of the 21st Annual International Conference on Mobile Computing and Networking. ACM, 65--76.

Digital Library

[36]

Wei Wang, Alex X Liu, Muhammad Shahzad, Kang Ling, and Sanglu Lu. 2017. Device-Free Human Activity Recognition Using Commercial Wi-Fi Devices. IEEE Journal on Selected Areas in Communications 35, 5 (2017), 1118--1131.

[37]

Yan Wang, Jian Liu, Yingying Chen, Marco Gruteser, Jie Yang, and Hongbo Liu. 2014. E-eyes: In-home Device-free Activity Identification Using Fine-grained Wi-Fi Signatures. In Proceedings of ACM MobiCom.

Digital Library

[38]

Wei Xi, Jizhong Zhao, Xiang-Yang Li, Kun Zhao, Shaojie Tang, Xue Liu, and Zhiping Jiang. 2014. Electronic Frog Eye: Counting Crowd Using Wi-Fi. In Proceedings of IEEE INFOCOM.

[39]

Yunze Zeng, Parth H Pathak, and Prasant Mohapatra. 2016. WiWho: wifi-based person identification in smart spaces. In Proceedings of the 15th International Conference on Information Processing in Sensor Networks. IEEE Press, 4.

Digital Library

[40]

Jin Zhang, Bo Wei, Wen Hu, and Salil S Kanhere. 2016. Wifi-id: Human identification using wifi signal. In Distributed Computing in Sensor Systems (DCOSS), 2016 International Conference on. IEEE, 75--82.

Cited By

Mosharaf MKwak JChoi W(2024)WiFi-Based Human Identification with Machine Learning: A Comprehensive SurveySensors10.3390/s2419641324:19(6413)Online publication date: 3-Oct-2024
https://doi.org/10.3390/s24196413
Chiu JLee GHsieh CLin Q(2024)Design and Implementation of Nursing-Secure-Care System with mmWave Radar by YOLO-v4 Computing MethodsApplied System Innovation10.3390/asi70100107:1(10)Online publication date: 19-Jan-2024
https://doi.org/10.3390/asi7010010
Hassan MKelsey TRahman F(2024)Adversarial AI applied to cross-user inter-domain and intra-domain adaptation in human activity recognition using wireless signalsPLOS ONE10.1371/journal.pone.029888819:4(e0298888)Online publication date: 18-Apr-2024
https://doi.org/10.1371/journal.pone.0298888
Show More Cited By

Index Terms

Augmenting User Identification with WiFi Based Gesture Recognition
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques
      1. Gestural input

Recommendations

Multi-User Gesture Recognition Using WiFi
MobiSys '18: Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services

WiFi based gesture recognition has received significant attention over the past few years. However, the key limitation of prior WiFi based gesture recognition systems is that they cannot recognize the gestures of multiple users performing them ...
Multi-scenario gesture recognition using Kinect
CGAMES '12: Proceedings of the 2012 17th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES)

Hand gesture recognition (HGR) is an important research topic because some situations require silent communication with sign languages. Computational HGR systems assist silent communication, and help people learn a sign language. In this article, a ...
Position and Orientation Agnostic Gesture Recognition Using WiFi
MobiSys '17: Proceedings of the 15th Annual International Conference on Mobile Systems, Applications, and Services

WiFi based gesture recognition systems have recently proliferated due to the ubiquitous availability of WiFi in almost every modern building. The key limitation of existing WiFi based gesture recognition systems is that they require the user to be in ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 2, Issue 3

September 2018

1536 pages

EISSN:2474-9567

DOI:10.1145/3279953

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 September 2018

Accepted: 01 September 2018

Revised: 01 May 2018

Received: 01 February 2018

Published in IMWUT Volume 2, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

86
Total Citations
View Citations
1,052
Total Downloads

Downloads (Last 12 months)68
Downloads (Last 6 weeks)8

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mosharaf MKwak JChoi W(2024)WiFi-Based Human Identification with Machine Learning: A Comprehensive SurveySensors10.3390/s2419641324:19(6413)Online publication date: 3-Oct-2024
https://doi.org/10.3390/s24196413
Chiu JLee GHsieh CLin Q(2024)Design and Implementation of Nursing-Secure-Care System with mmWave Radar by YOLO-v4 Computing MethodsApplied System Innovation10.3390/asi70100107:1(10)Online publication date: 19-Jan-2024
https://doi.org/10.3390/asi7010010
Hassan MKelsey TRahman F(2024)Adversarial AI applied to cross-user inter-domain and intra-domain adaptation in human activity recognition using wireless signalsPLOS ONE10.1371/journal.pone.029888819:4(e0298888)Online publication date: 18-Apr-2024
https://doi.org/10.1371/journal.pone.0298888
Wang ZChen ZZhang YGeng CSong WSun ZGuo BYu ZChen L(2024)GrainSense: A Wireless Grain Moisture Sensing System Based on Wi-Fi SignalsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785898:3(1-25)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678589
Liu RYao TShi RMei LWang SYin ZJiang WWang SShu YLiu JTan RHe YChen J(2024)Mission: mmWave Radar Person Identification with RGB CamerasProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699340(309-321)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699340
Zhang XZhang DXie YWu DLi YZhang D(2024)WaffleProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314587:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631458
Lu LChen MYu JBa ZLin FHan JZhu YRen K(2024)An Imperceptible Eavesdropping Attack on WiFi Sensing SystemsIEEE/ACM Transactions on Networking10.1109/TNET.2024.340383932:5(4009-4024)Online publication date: Oct-2024
https://doi.org/10.1109/TNET.2024.3403839
Zhang LJiang YMa YMao SHuang WYu ZZheng XShu LFan XXu GDong C(2024)Toward Robust and Effective Behavior Based User Authentication With Off-the-Shelf Wi-FiIEEE Transactions on Information Forensics and Security10.1109/TIFS.2024.342836719(8731-8746)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TIFS.2024.3428367
Wang JZhao SLv YLiu XGao QPan M(2024)Cross-Scenario Device-Free Gesture Recognition Based on Parallel Adversarial NetworkIEEE Transactions on Cognitive Communications and Networking10.1109/TCCN.2023.334586910:3(893-904)Online publication date: Jun-2024
https://doi.org/10.1109/TCCN.2023.3345869
De Silva VArtaud C(2024)Adversarial Contrastive Representation Learning for Passive WiFi Fingerprinting of Individuals2024 14th International Conference on Pattern Recognition Systems (ICPRS)10.1109/ICPRS62101.2024.10677808(1-7)Online publication date: 15-Jul-2024
https://doi.org/10.1109/ICPRS62101.2024.10677808
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents