Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3241539.3241570acmconferencesArticle/Chapter ViewAbstractPublication PagesmobicomConference Proceedingsconference-collections
research-article
Open access

CrossSense: Towards Cross-Site and Large-Scale WiFi Sensing

Published: 15 October 2018 Publication History

Abstract

We present CrossSense, a novel system for scaling up WiFi sensing to new environments and larger problems. To reduce the cost of sensing model training data collection, CrossSense employs machine learning to train, off-line, a roaming model that generates from one set of measurements synthetic training samples for each target environment. To scale up to a larger problem size, CrossSense adopts a mixture-of-experts approach where multiple specialized sensing models, or experts, are used to capture the mapping from diverse WiFi inputs to the desired outputs. The experts are trained offline and at runtime the appropriate expert for a given input is automatically chosen. We evaluate CrossSense by applying it to two representative WiFi sensing applications, gait identification and gesture recognition, in controlled single-link environments. We show that CrossSense boosts the accuracy of state-of-the-art WiFi sensing techniques from 20% to over 80% and 90% for gait identification and gesture recognition respectively, delivering consistently good performance - particularly when the problem size is significantly greater than that current approaches can effectively handle.

References

[1]
Heba Abdelnasser et almbox. 2015a. UbiBreathe: A Ubiquitous non-Invasive WiFi-based Breathing Estimator. In MobiHoc .
[2]
Heba Abdelnasser et almbox. 2015b. WiGest: A ubiquitous WiFi-based gesture recognition system. In INFOCOM .
[3]
Fadel Adib et almbox. 2014a. 3D tracking via body radio reflections. In NSDI .
[4]
Fadel Adib et almbox. 2014b. Demo: real-time breath monitoring using wireless signals. MobiCom .
[5]
Fadel Adib et almbox. 2015a. Capturing the Human Figure Through a Wall. ACM Transactions on Graphics (2015).
[6]
Fadel Adib et almbox. 2015b. Multi-Person Localization via RF Body Reflections. In NSDI .
[7]
Fadel Adib et almbox. 2015c. Smart Homes That Monitor Breathing and Heart Rate. In CHI .
[8]
Fadel Adib and Dina Katabi. 2013. See through walls with WiFi!. In SIGCOMM .
[9]
Kamran Ali et almbox. 2015. Keystroke Recognition Using WiFi Signals. In MobiCom .
[10]
Kamran Ali et almbox. 2017. Recognizing keystrokes using WiFi devices. IEEE Journal on Selected Areas in Communications (2017).
[11]
Heba Aly and Moustafa Youssef. 2015. An Analysis of Device-Free and Device-Based WiFi-Localization Systems. In IJACI .
[12]
Anthony Bagnall et almbox. 2015. Time-Series Classification with COTE: The Collective of Transformation-Based Ensembles. IEEE Transactions on Knowledge and Data Engineering (2015).
[13]
L. Chang et almbox. 2017. FitLoc: Fine-Grained and Low-Cost Device-Free Localization for Multiple Targets Over Various Areas. IEEE/ACM Transactions on Networking (2017).
[14]
Bo Chen et almbox. 2015. Tracking Keystrokes Using Wireless Signals. In MobiSys .
[15]
David A Cohn et almbox. 1996. Active learning with statistical models. Journal of Artificial Intelligence Research (1996).
[16]
Diane Cook et almbox. 2013. Transfer learning for activity recognition: A survey. Knowledge and Information Systems (2013).
[17]
Chris Cummins et almbox. 2017. End-to-end deep learning of optimization heuristics. In PACT .
[18]
Simone Di Domenico et almbox. 2016. A Trained-once Crowd Counting Method Using Differential WiFi Channel State Information. In International on Workshop on Physical Analytics .
[19]
Murali Krishna Emani and Michael O'Boyle. 2015. Celebrating Diversity: A Mixture of Experts Approach for Runtime Mapping in Dynamic Environments. In PLDI .
[20]
Wolfgang Ertel. 1994. On the definition of speedup. In International Conference on Parallel Architectures and Languages Europe .
[21]
Daniel Garcia-Romero et almbox. 2017. Speaker diarization using deep neural network embeddings. In ICASSP .
[22]
Y. Guan et almbox. 2015. On Reducing the Effect of Covariate Factors in Gait Recognition: A Classifier Ensemble Method. IEEE Transactions on Pattern Analysis and Machine Intelligence (2015).
[23]
Srinivas Gutta and Harry Wechsler. 1996. Face recognition using hybrid classifier systems. In ICNN .
[24]
Dan Halperin. {n. d.}. Linux-80211n-csitool. http://dhalperi.github.io/linux-80211n-csitool/.
[25]
Chunmei Han et almbox. 2014. WiFall: Device-free fall detection by wireless networks. In INFOCOM .
[26]
Wenfeng He et almbox. 2015. WiG: WiFi-Based Gesture Recognition System. In ICCCN .
[27]
Feng Hong et almbox. 2016. WFID: Passive Device-free Human Identification Using WiFi Signal. In MOBIQUITOUS .
[28]
Chen-Yu Hsu et almbox. 2017. Extracting Gait Velocity and Stride Length from Surrounding Radio Signals. In CHI .
[29]
Zhiping Jiang et almbox. 2013. Rejecting the attack: Source authentication for wi-fi management frames using csi information. In INFOCOM .
[30]
Michael I. Jordan and Robert A. Jacobs. 1994. Hierarchical Mixtures of Experts and the EM Algorithm. Neural Comput. (1994).
[31]
Ehud D Karnin. 1990. A simple procedure for pruning back-propagation trained neural networks. IEEE Transactions on Neural Networks (1990).
[32]
Bryce Kellogg et almbox. 2014. Bringing gesture recognition to all devices. In NSDI .
[33]
Jin Kun et almbox. 2017. Vivisnoop: Someone is snooping your typing without seeing it!. In CNS .
[34]
Mengyuan Li et almbox. 2016. When CSI Meets Public WiFi: Inferring Your Mobile Phone Password via WiFi Signals. In CCS .
[35]
Hongbo Liu et almbox. 2014. Practical User Authentication Leveraging Channel State Information (CSI). In ASIA CCS .
[36]
Xuefeng Liu et almbox. 2015. Wi-Sleep: Contactless Sleep Monitoring via WiFi Signals. In RTSS .
[37]
Bastien Lyonnet et almbox. 2010. Human gait classification using microdoppler time-frequency signal representations. In RadarConf .
[38]
B. Mager et almbox. 2013. Fall detection using RF sensor networks. In PIMRC .
[39]
Vicent Sanz Marco et almbox. 2017. Improving spark application throughput via memory aware task co-location: a mixture of experts approach. In Middleware .
[40]
Pedro Melgarejo et almbox. 2014. Leveraging directional antenna capabilities for fine-grained gesture recognition. In UbiComp .
[41]
Pavlo Molchanov et almbox. 2015. Short-range FMCW monopulse radar for hand-gesture sensing. In RadarConf .
[42]
Rajalakshmi Nandakumar et almbox. 2014. Wi-Fi Gesture Recognition on Existing Devices. Arxiv (2014).
[43]
William Ogilvie et almbox. 2014. Fast automatic heuristic construction using active learning. In LCPC .
[44]
William F Ogilvie et almbox. 2017. Minimizing the cost of iterative compilation with active learning. In CGO .
[45]
Sameera Palipana et almbox. 2018. FallDeFi: Ubiquitous Fall Detection using Commodity Wi-Fi Devices. In UbiComp .
[46]
Sinno Jialin Pan et almbox. 2008. Transfer learning via dimensionality reduction. In AAAI .
[47]
Neal Patwari et almbox. 2011. Monitoring Breathing via Signal Strength in Wireless Networks. In IEEE Transactions on Mobile Computing .
[48]
Neal Patwari et almbox. 2013. Breathfinding: A Wireless Network That Monitors and Locates Breathing in a Home. IEEE Journal of Selected Topics in Signal Processing (2013).
[49]
Fabian Pedregosa et almbox. 2011. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research (2011).
[50]
Qifan Pu et almbox. 2013. Whole-home gesture recognition using wireless signals. In MobiCom .
[51]
Kun Qian et almbox. 2017. Inferring Motion Direction using Commodity Wi-Fi for Interactive Exergames. In CHI .
[52]
Stan Salvador and Philip Chan. 2007. Toward accurate dynamic time warping in linear time and space. Intelligent Data Analysis (2007).
[53]
Muhammad Shahzad et almbox. 2017. Behavior Based Human Authentication on Touch Screen Devices Using Gestures and Signatures. IEEE Transactions on Mobile Computing (2017).
[54]
Jiacheng Shang and Jie Wu. 2017a. A Robust Sign Language Recognition System with Multiple Wi-Fi Devices. In MobiArch .
[55]
Jiacheng Shang and Jie Wu. 2017b. A Robust Sign Language Recognition System with Sparsely Labeled Instances Using Wi-Fi Signals. In MobiHoc .
[56]
Longfei Shangguan et almbox. 2017. Enabling Gesture-based Interactions with Objects. In MobiSys .
[57]
Cong Shi et almbox. 2017. Smart User Authentication through Actuation of Daily Activities Leveraging WiFi-enabled IoT. In MobiHoc .
[58]
Stephan Sigg et almbox. 2013. Leveraging RF-channel fluctuation for activity recognition: Active and passive systems, continuous and RSSI-based signal features. In MoMM .
[59]
Stephan Sigg et almbox. 2014. RF-Sensing of Activities from Non-Cooperative Subjects in Device-Free Recognition Systems Using Ambient and Local Signals. IEEE Transactions on Mobile Computing (2014).
[60]
Stephan others Sigg. 2014. The telepathic phone: Frictionless activity recognition from WiFi-RSSI. In PerCom .
[61]
Hichem Snoussi and Cédric Richard. 2006. Ensemble learning online filtering in wireless sensor networks. In ICCS .
[62]
Sheng Tan and Jie Yang. 2016. WiFinger: leveraging commodity WiFi for fine-grained finger gesture recognition. In MobiHoc .
[63]
Xiaohua Tian et almbox. 2017. Performance Analysis of RSS Fingerprinting Based Indoor Localization. IEEE Transactions on Mobile Computing (2017).
[64]
Xiaohua Tian et almbox. 2018. Improve Accuracy of Fingerprinting Localization with Temporal Correlation of the RSS. IEEE Transactions on Mobile Computing (2018).
[65]
H. T. T. Truong et almbox. 2014. Comparing and fusing different sensor modalities for relay attack resistance in Zero-Interaction Authentication. In PerCom .
[66]
Aditya Virmani and Muhammad Shahzad. 2017. Position and Orientation Agnostic Gesture Recognition Using WiFi. In MobiSys .
[67]
Guanhua Wang et almbox. 2014a. We Can Hear You with Wi-Fi!. In MobiCom .
[68]
Hao Wang et almbox. 2016a. Human respiration detection with commodity wifi devices: do user location and body orientation matter?. In UbiComp .
[69]
Ju Wang et almbox. 2016b. LiFS: low human-effort, device-free localization with fine-grained subcarrier information. In MobiCom .
[70]
Ju Wang et almbox. 2017. TagScan: Simultaneous Target Imaging and Material Identification with Commodity RFID Devices. In MobiCom .
[71]
J. Wang et almbox. 2018a. Device-free Wireless Sensing in Complex Scenarios Using Spatial Structural Information. IEEE Transactions on Wireless Communications (2018).
[72]
Jindong Wang et almbox. 2018b. Stratified Transfer Learning for Cross-domain Activity Recognition. In PerCom .
[73]
Jue Wang and Dina Katabi. 2013. Dude, where's my card?: RFID positioning that works with multipath and non-line of sight. In SIGCOMM .
[74]
Liang Wang et almbox. 2016c. Toward a Wearable RFID System for Real-Time Activity Recognition Using Radio Patterns. IEEE Transactions on Mobile Computing (2016).
[75]
Wei Wang et almbox. 2015. Understanding and Modeling of WiFi Signal Based Human Activity Recognition. In MobiCom .
[76]
Wei Wang et almbox. 2016 d. Gait recognition using wifi signals. In UbiComp .
[77]
Yan Wang et almbox. 2014b. E-eyes: device-free location-oriented activity identification using fine-grained wifi signatures. In MobiCom .
[78]
Kristen Woyach et almbox. 2006. Sensorless sensing in wireless networks: Implementation and measurements. In WiOpt .
[79]
Di Wu et almbox. 2012. One shot learning gesture recognition from rgbd images. In CVPRW .
[80]
Dan Wu et almbox. 2016. WiDir: walking direction estimation using wireless signals. In UbiComp .
[81]
Dan Wu et almbox. 2017. Device-Free WiFi Human Sensing: From Pattern-Based to Model-Based Approaches. IEEE Communications Magazine (2017).
[82]
Wei Xi et almbox. 2014. Electronic frog eye: Counting crowd using wifi. In INFOCOM .
[83]
Fu Xiao et almbox. 2018. One More Tag Enables Fine-Grained RFID Localization and Tracking. IEEE/ACM Transactions on Networking (2018).
[84]
Jiang Xiao et almbox. 2013. Pilot: Passive device-free indoor localization using channel state information. In ICDCS .
[85]
Tong Xin et almbox. 2016. FreeSense: Indoor Human Identification with Wi-Fi Signals. In GlobeCom .
[86]
Shuochao Yao et almbox. 2017. DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing. In WWW .
[87]
Jason Yosinski et almbox. 2014. How Transferable Are Features in Deep Neural Networks?. In NIPS .
[88]
Moustafa Youssef. 2016. CoSDEO 2016 Keynote: A decade later? Challenges: Device-free passive localization for wireless environments. In PerCom Workshops .
[89]
Yunze Zeng et almbox. 2014. Your AP knows how you move:fine-grained device motion recognition through WiFi. In HotWireless .
[90]
Yunze Zeng et almbox. 2016. WiWho: WiFi-Based Person Identification in Smart Spaces. In IPSN .
[91]
Cha Zhang and Yunqian Ma. 2012. Ensemble machine learning: methods and applications .Springer.
[92]
Jin Zhang et almbox. 2016. WiFi-ID: Human Identification Using WiFi Signal. In DCOSS .
[93]
Ouyang Zhang and Kannan Srinivasan. 2016. Mudra: User-friendly Fine-grained Gesture Recognition using WiFi Signals. In CoNEXT .
[94]
Mingmin Zhao et almbox. 2017. Emotion recognition using wireless signals. In MobiCom .
[95]
Zhongtang Zhao et almbox. 2011. Cross-people mobile-phone based activity recognition. In IJCAI .
[96]
Xiaolong Zheng et almbox. 2016. Smokey: Ubiquitous smoking detection with commercial WiFi infrastructures. In INFOCOM .
[97]
Zimu Zhou et almbox. 2013. Towards omnidirectional passive human detection. In INFOCOM .
[98]
Hai Zhu et almbox. 2017. R-TTWD: Robust Device-free Through-The-Wall Detection of Moving Human with WiFi. IEEE Journal on Selected Areas in Communications (2017).

Cited By

View all
  • (2025)A Survey on WiFi-based Human Identification: Scenarios, Challenges, and Current SolutionsACM Transactions on Sensor Networks10.1145/370832321:1(1-32)Online publication date: 27-Jan-2025
  • (2025)OpenFi: Open-Set WiFi Human Sensing via Virtual Embedding Confidence-AwareIEEE Transactions on Network Science and Engineering10.1109/TNSE.2024.349649612:1(344-355)Online publication date: Jan-2025
  • (2025)SANSee: A Physical-Layer Semantic-Aware Networking Framework for Distributed Wireless SensingIEEE Transactions on Mobile Computing10.1109/TMC.2024.348327224:3(1636-1653)Online publication date: Mar-2025
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MobiCom '18: Proceedings of the 24th Annual International Conference on Mobile Computing and Networking
October 2018
884 pages
ISBN:9781450359030
DOI:10.1145/3241539
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. channel state information
  2. machine learning
  3. received signal strength indicator
  4. wireless sensing

Qualifiers

  • Research-article

Funding Sources

  • National Natural Science Foundation of China
  • the China Scholarship Council
  • the Science and Technology Innovation Team Support Program of Shaanxi Province China
  • the Royal Society International Collaboration Grant
  • the UK Engineering and Physical Sciences Research Council (EPSRC)

Conference

MobiCom '18
Sponsor:

Acceptance Rates

MobiCom '18 Paper Acceptance Rate 42 of 187 submissions, 22%;
Overall Acceptance Rate 440 of 2,972 submissions, 15%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)737
  • Downloads (Last 6 weeks)71
Reflects downloads up to 19 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)A Survey on WiFi-based Human Identification: Scenarios, Challenges, and Current SolutionsACM Transactions on Sensor Networks10.1145/370832321:1(1-32)Online publication date: 27-Jan-2025
  • (2025)OpenFi: Open-Set WiFi Human Sensing via Virtual Embedding Confidence-AwareIEEE Transactions on Network Science and Engineering10.1109/TNSE.2024.349649612:1(344-355)Online publication date: Jan-2025
  • (2025)SANSee: A Physical-Layer Semantic-Aware Networking Framework for Distributed Wireless SensingIEEE Transactions on Mobile Computing10.1109/TMC.2024.348327224:3(1636-1653)Online publication date: Mar-2025
  • (2025)AdaWiFi, Collaborative WiFi Sensing for Cross-Environment AdaptationIEEE Transactions on Mobile Computing10.1109/TMC.2024.347485324:2(845-858)Online publication date: Feb-2025
  • (2025)Toward Scalable Generative Ai via Mixture of Experts in Mobile Edge NetworksIEEE Wireless Communications10.1109/MWC.003.240004632:1(142-149)Online publication date: 1-Feb-2025
  • (2025)Wi-SSR: Wi-Fi-Based Lightweight High-Resolution Model for Human Activity RecognitionIEEE Sensors Journal10.1109/JSEN.2024.352334325:4(6556-6571)Online publication date: 15-Feb-2025
  • (2024)Trajectory mapping through channel state information by triangulation method and fine-tuningJournal of Engineering and Applied Science10.1186/s44147-024-00531-671:1Online publication date: 4-Oct-2024
  • (2024)Artificial Intelligence of Things: A SurveyACM Transactions on Sensor Networks10.1145/369063921:1(1-75)Online publication date: 30-Aug-2024
  • (2024)Towards Smartphone-based 3D Hand Pose Reconstruction Using Acoustic SignalsACM Transactions on Sensor Networks10.1145/367712220:5(1-32)Online publication date: 26-Aug-2024
  • (2024)RFBoost: Understanding and Boosting Deep WiFi Sensing via Physical Data AugmentationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596208:2(1-26)Online publication date: 15-May-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

EPUB

View this article in ePub.

ePub

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media