research-article

Understanding and Modeling of WiFi Signal Based Human Activity Recognition

Authors:

Muhammad Shahzad,

Sanglu LuAuthors Info & Claims

MobiCom '15: Proceedings of the 21st Annual International Conference on Mobile Computing and Networking

Pages 65 - 76

https://doi.org/10.1145/2789168.2790093

Published: 07 September 2015 Publication History

Abstract

Some pioneer WiFi signal based human activity recognition systems have been proposed. Their key limitation lies in the lack of a model that can quantitatively correlate CSI dynamics and human activities. In this paper, we propose CARM, a CSI based human Activity Recognition and Monitoring system. CARM has two theoretical underpinnings: a CSI-speed model, which quantifies the correlation between CSI value dynamics and human movement speeds, and a CSI-activity model, which quantifies the correlation between the movement speeds of different human body parts and a specific human activity. By these two models, we quantitatively build the correlation between CSI value dynamics and a specific human activity. CARM uses this correlation as the profiling mechanism and recognizes a given activity by matching it to the best-fit profile. We implemented CARM using commercial WiFi devices and evaluated it in several different environments. Our results show that CARM achieves an average accuracy of greater than 96%.

References

[1]

Enhancements for higher throughput. IEEE Standard 802.11n, 2009.

[2]

Google project Soli. https://www.youtube.com/watch?v=0QNiZfSsPc0.

[3]

H. Abdelnasser, M. Youssef, and K. A. Harras. WiGest: A ubiquitous wifi-based gesture recognition system. In Proceedings of IEEE INFOCOM, 2015.

[4]

F. Adib, Z. Kabelac, and D. Katabi. Multi-person motion tracking via RF body reflections. In Proceedings of Usenix NSDI, 2015.

[5]

F. Adib, Z. Kabelac, D. Katabi, and R. C. Miller. 3D tracking via body radio reflections. In Proceedings of Usenix NSDI, 2013.

Digital Library

[6]

J. K. Aggarwal and S. R. Michael. Human activity analysis: A review. ACM Computing Surveys, 43(3), 2011.

Digital Library

[7]

E. Ertin, N. Stohs, S. Kumar, A. Raij, M. al'Absi, and S. Shah. AutoSense: unobtrusively wearable sensor suite for inferring the onset, causality, and consequences of stress in the field. In Proceedings of ACM Sensys, 2011.

Digital Library

[8]

J. Gjengset, J. Xiong, G. McPhillips, and K. Jamieson. Phaser: Enabling phased array signal processing on commodity WiFi access points. In Proceedings of ACM MobiCom, 2014.

Digital Library

[9]

D. Halperin, W. Hu, A. Sheth, and D. Wetherall. Tool release: Gathering 802.11n traces with channel state information. ACM SIGCOMM CCR, 41(1):53, 2011.

Digital Library

[10]

C. Han, K. Wu, Y. Wang, and L. M. Ni. Wifall: Device-free fall detection by wireless networks. In Proceedings of IEEE INFOCOM, pages 271--279, 2014.

[11]

D. Huang, R. Nandakumar, and S. Gollakota. Feasibility and limits of Wi-Fi imaging. In Proceedings of ACM SenSys, pages 266--279, 2014.

Digital Library

[12]

K. R. Joshi, S. S. Hong, and S. Katti. Pinpoint: Localizing interfering radios. In Proceedings of Usenix NSDI, pages 241--253, 2013.

Digital Library

[13]

B. Kellogg, A. Parks, S. Gollakota, J. R. Smith, and D. Wetherall. Wi-Fi backscatter: Internet connectivity for RF-powered devices. In ACM SIGCOMM, 2014.

Digital Library

[14]

B. Kellogg, V. Talla, and S. Gollakota. Bringing gesture recognition to all devices. In Proceedings of Usenix NSDI, 2014.

Digital Library

[15]

T. Kim, H. T. Attias, S.-Y. Lee, and T.-W. Lee. Blind source separation exploiting higher-order frequency dependencies. IEEE Transactions on Audio, Speech, and Language Processing, 15(1):70--79, 2007.

Digital Library

[16]

B. Lyonnet, C. Ioana, and M. G. Amin. Human gait classification using microdoppler time-frequency signal representations. In Proceedings of IEEE Radar Conference, pages 915--919, 2010.

[17]

Q. Pu, S. Gupta, S. Gollakota, and S. Patel. Whole-home gesture recognition using wireless signals. In Proceedings of ACM MobiCom, 2013.

Digital Library

[18]

L. R. Rabiner and B.-H. Juang. Fundamentals of speech recognition. Prentice Hall, 1993.

Digital Library

[19]

S. Sen, J. Lee, K.-H. Kim, and P. Congdon. Avoiding multipath to revive inbuilding WiFi localization. In Proceeding of ACM MobiSys, pages 249--262, 2013.

Digital Library

[20]

S. Sen, B. Radunovic, R. R. Choudhury, and T. Minka. You are facing the mona lisa: spot localization using phy layer information. In Proceedings of ACM MobiSys, pages 183--196, 2012.

Digital Library

[21]

S. Sigg, U. Blanke, and G. Troster. The telepathic phone: Frictionless activity recognition from WiFi-RSSI. In IEEE PerCom, pages 148--155, 2014.

[22]

S. Sigg, M. Scholz, S. Shi, Y. Ji, and M. Beigl. RF-sensing of activities from non-cooperative subjects in device-free recognition systems using ambient and local signals. IEEE Transactions on Mobile Computing, 13(4):907--920, 2014.

Digital Library

[23]

S. Sigg, S. Shi, F. Buesching, Y. Ji, and L. Wolf. Leveraging RF-channel fluctuation for activity recognition: Active and passive systems, continuous and rssi-based signal features. In Proceedings of ACM MoMM, 2013.

Digital Library

[24]

D. Tse and P. Viswanath. Fundamentals of wireless communication. Cambridge university press, 2005.

[25]

P. Van Dorp and F. Groen. Feature-based human motion parameter estimation with radar. IET Radar, Sonar & Navigation, 2(2):135--145, 2008.

[26]

G. Wang, Y. Zou, Z. Zhou, K. Wu, and L. M. Ni. We can hear you with Wi-Fi! In Proceedings of ACM MobiCom, 2014.

Digital Library

[27]

Y. Wang, J. Liu, Y. Chen, M. Gruteser, J. Yang, and H. Liu. E-eyes: In-home device-free activity identification using fine-grained WiFi signatures. In Proceedings of ACM MobiCom, 2014.

Digital Library

[28]

L. R. Welch. Hidden markov models and the baum-welch algorithm. IEEE Information Theory Society Newsletter, 53(4):10--13, 2003.

[29]

N. J. Willis. Bistatic Radar. SciTech Publishing Inc., 2005.

[30]

W. Xi, J. Zhao, X.-Y. Li, K. Zhao, S. Tang, X. Liu, and Z. Jiang. Electronic frog eye: Counting crowd using WiFi. In Proceedings of IEEE INFOCOM, 2014.

[31]

L. Yang, Y. Chen, X.-Y. Li, C. Xiao, M. Li, and Y. Liu. Tagoram: real-time tracking of mobile RFID tags to high precision using cots devices. In ACM MobiCom, pages 237--248, 2014.

Digital Library

[32]

Z. Yang, Z. Zhou, and Y. Liu. From RSSI to CSI: Indoor localization via channel response. ACM Computing Surveys, 46(2):25, 2013.

Digital Library

[33]

K. Yatani and K. N. Truong. Bodyscope: a wearable acoustic sensor for activity recognition. In Proceedings of ACM UbiComp, pages 341--350, 2012.

Digital Library

[34]

X. Zhou, Z. Zhang, Y. Zhu, Y. Li, S. Kumar, A. Vahdat, B. Y. Zhao, and H. Zheng. Mirror mirror on the ceiling: flexible wireless links for data centers. In Proceedings of ACM SIGCOMM, pages 443--454, 2012.

Digital Library

[35]

Z. Zhou, Z. Yang, C. Wu, L. Shangguan, and Y. Liu. Towards omnidirectional passive human detection. In Proceedings of IEEE INFOCOM, pages 3057--3065, 2013.

Cited By

Xie JLi ZFeng CLin JMeng X(2024)Wi-AM: Enabling Cross-Domain Gesture Recognition with Commodity Wi-FiSensors10.3390/s2405135424:5(1354)Online publication date: 20-Feb-2024
https://doi.org/10.3390/s24051354
Ye KWu SCai YZhou LXiao LZhang XZheng ZLin J(2024)Transfer-Learning-Based Human Activity Recognition Using Antenna ArrayRemote Sensing10.3390/rs1605084516:5(845)Online publication date: 28-Feb-2024
https://doi.org/10.3390/rs16050845
Chen MZhang LLiu YZhang YLiu CChen M(2024)Ship Bridge OOW Activity Status Detection Using Wi-Fi Beamforming Feedback InformationJournal of Marine Science and Engineering10.3390/jmse1206087212:6(872)Online publication date: 24-May-2024
https://doi.org/10.3390/jmse12060872
Show More Cited By

Index Terms

Understanding and Modeling of WiFi Signal Based Human Activity Recognition
1. Networks
  1. Network types
    1. Mobile networks
    2. Wireless access networks

Recommendations

Human Activity Recognition Using Gait Pattern

Vision-based human activity recognition is the process of labelling image sequences with action labels. Accurate systems for this problem are applied in areas such as visual surveillance, human computer interaction and video retrieval. The challenges ...
Device-Free Human Activity Recognition Using Commercial WiFi Devices
Since human bodies are good reflectors of wireless signals, human activities can be recognized by monitoring changes in WiFi signals. However, existing WiFi-based human activity recognition systems do not build models that can quantify the correlation ...
Recognition of Human Group Activity for Video Analytics
Proceedings, Part II, of the 16th Pacific-Rim Conference on Advances in Multimedia Information Processing -- PCM 2015 - Volume 9315

Human activity recognition is an important and challenging task for video content analysis and understanding. Individual activity recognition has been well studied recently. However, recognizing the activities of human group with more than three people ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobiCom '15: Proceedings of the 21st Annual International Conference on Mobile Computing and Networking

September 2015

638 pages

ISBN:9781450336192

DOI:10.1145/2789168

General Chairs:
Serge Fdida
UPMC/LIP6, France
,
Giovanni Pau
UPMC/LIP6, France
,
Program Chairs:
Sneha Kumar Kasera
University of Utah, USA
,
Heather Zheng
University of California, Santa Barbara, USA

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

NSFC

Conference

MobiCom'15

Sponsor:

SIGMOBILE

MobiCom'15: The 21th Annual International Conference on Mobile Computing and Networking

September 7 - 11, 2015

Paris, France

Acceptance Rates

MobiCom '15 Paper Acceptance Rate 38 of 207 submissions, 18%;

Overall Acceptance Rate 440 of 2,972 submissions, 15%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

768
Total Citations
View Citations
6,879
Total Downloads

Downloads (Last 12 months)711
Downloads (Last 6 weeks)81

Reflects downloads up to 12 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xie JLi ZFeng CLin JMeng X(2024)Wi-AM: Enabling Cross-Domain Gesture Recognition with Commodity Wi-FiSensors10.3390/s2405135424:5(1354)Online publication date: 20-Feb-2024
https://doi.org/10.3390/s24051354
Ye KWu SCai YZhou LXiao LZhang XZheng ZLin J(2024)Transfer-Learning-Based Human Activity Recognition Using Antenna ArrayRemote Sensing10.3390/rs1605084516:5(845)Online publication date: 28-Feb-2024
https://doi.org/10.3390/rs16050845
Chen MZhang LLiu YZhang YLiu CChen M(2024)Ship Bridge OOW Activity Status Detection Using Wi-Fi Beamforming Feedback InformationJournal of Marine Science and Engineering10.3390/jmse1206087212:6(872)Online publication date: 24-May-2024
https://doi.org/10.3390/jmse12060872
Dang XFan KLi FTang YGao YWang Y(2024)Multi-Person Action Recognition Based on Millimeter-Wave Radar Point CloudApplied Sciences10.3390/app1416725314:16(7253)Online publication date: 17-Aug-2024
https://doi.org/10.3390/app14167253
Teramoto KHaruyama TShimoyama TKato FMineno H(2024)Human Activity Recognition Using FixMatch-based Semi-supervised Learning with CSIJournal of Information Processing10.2197/ipsjjip.32.59632(596-604)Online publication date: 2024
https://doi.org/10.2197/ipsjjip.32.596
Yanagimoto HTokioka WHashimoto KMatsuo T(2024)Indoor Person Position Estimation with Channel State Information with Privacy Considerationプライバシーに配慮したChannel State Informationによる屋内の人の位置推定IEEJ Transactions on Electronics, Information and Systems10.1541/ieejeiss.144.955144:9(955-961)Online publication date: 1-Sep-2024
https://doi.org/10.1541/ieejeiss.144.955
Wang ZChen ZZhang YGeng CSong WSun ZGuo BYu ZChen L(2024)GrainSense: A Wireless Grain Moisture Sensing System Based on Wi-Fi SignalsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785898:3(1-25)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678589
Wang SWang XJiang WMiao CCao QWang HSun KXue HSu L(2024)Towards Smartphone-based 3D Hand Pose Reconstruction Using Acoustic SignalsACM Transactions on Sensor Networks10.1145/367712220:5(1-32)Online publication date: 26-Aug-2024
https://dl.acm.org/doi/10.1145/3677122
Cao ZLi CLiu LZhang M(2024)WiVelo: Fine-grained Wi-Fi Walking Velocity EstimationACM Transactions on Sensor Networks10.1145/366419620:4(1-21)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3664196
Hou WWu C(2024)RFBoost: Understanding and Boosting Deep WiFi Sensing via Physical Data AugmentationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596208:2(1-26)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659620
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

ePub

View this article in ePub.

Media

Figures

Other

Tables

View Table of Contents