Article

WiDeo: fine-grained device-free motion tracing using RF backscatter

Authors:

Dinesh Bharadia,

Manikanta Kotaru, and

Sachin KattiAuthors Info & Claims

NSDI'15: Proceedings of the 12th USENIX Conference on Networked Systems Design and Implementation

May 2015

Pages 189 - 204

Published: 04 May 2015 Publication History

Abstract

Could we build a motion tracing camera using wireless communication signals as the light source? This paper shows we can, we present the design and implementation of WiDeo, a novel system that enables accurate, high resolution, device free human motion tracing in indoor environments using WiFi signals and compact WiFi radios. The insight behind WiDeo is to mine the backscatter reflections from the environment that WiFi transmissions naturally produce to trace where reflecting objects are located and how they are moving. We invent novel backscatter measurement techniques that work in spite of the low bandwidth and dynamic range of WiFi radios, new algorithms that separate out the moving backscatter from the clutter that static reflectors produce and then trace the original motion that produced the backscatter in spite of the fact that it could have undergone multiple reflections. We prototype WiDeo using off-the-shelf software radios and show that it accurately traces motion even when there are multiple independent human motions occurring concurrently (up to 5) with a median error in the traced path of less than 7cm.

References

[1]

David Tse, Fundamentals Wireless Communications. http://www.eecs.berkeley.edu/~dtse/Chapters_PDF/Fundamentals_ Wireless_Communication_chapter2.pdf.

[2]

Modeling Indoor Propagation. http://www.remcom.com/examples/modeling-indoor-propagation.html.

[3]

SPEAG Hand. http://www.speag. com/products/em-phantom/hand/sho-v2-3rb-lb/.

[4]

Wii. http://en.wikipedia.org/wiki/Wii.

[5]

ADIB, F., KABELAC, Z., AND KATABI, D. Multi-Person Motion Tracking via RF Body Reflections.

[6]

ADIB, F., KABELAC, Z., KATABI, D., AND MILLER, R. C. 3D Tracking via Body Radio Reflections. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14) (Seattle, WA, Apr. 2014), USENIX Association, pp. 317-329.

Digital Library

[7]

ADIB, F., AND KATABI, D. See Through Walls with WiFi! In Proceedings of the ACM SIGCOMM 2013 Conference on SIGCOMM (New York, NY, USA, 2013), SIGCOMM '13, ACM, pp. 75-86.

Digital Library

[8]

ARSLAN, H., ET AL. Channel Estimation for Wireless OFDM Systems. IEEE Surveys and Tutorials 9, 2 (2007), 18-48.

Digital Library

[9]

BAHL, P., AND PADMANABHAN, V. RADAR: an in-building RF-based user location and tracking system. Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No. 00CH37064) 2 (2000), 775-784.

[10]

BHARADIA, D., JOSHI, K. R., AND KATTI, S. Full Duplex Backscatter. In Proceedings of the Twelfth ACM Workshop on Hot Topics in Networks (2013), ACM, p. 4.

Digital Library

[11]

BHARADIA, D., AND KATTI, S. Full Duplex MIMO Radios. In 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14) (Seattle, WA, Apr. 2014), USENIX Association, pp. 359-372.

Digital Library

[12]

BHARADIA, D., MCMILIN, E., AND KATTI, S. Full Duplex Radios. In Proceedings of the ACM SIGCOMM 2013 conference on SIGCOMM (New York, NY, USA, 2013), SIGCOMM '13, ACM, pp. 375-386.

Digital Library

[13]

BOYD, S., AND VANDENBERGHE, L. Convex Optimization. Cambridge University Press, New York, NY, USA, 2004.

[14]

CANDES, E., AND ROMBERG, J. Sparsity and Incoherence in Compressive Sampling, 2006.

[15]

CHINTALAPUDI, K., PADMANABHA IYER, A., AND PADMANABHAN, V. N. Indoor Localization Without the Pain. In Proceedings of the sixteenth annual international conference on Mobile computing and networking (2010), ACM, pp. 173-184.

Digital Library

[16]

CZINK, N., HERDIN, M., AND ZCELIK ERNST BONEK. Number of Multipath Clusters in Indoor MIMO Propagation Environments.

[17]

DONOHO, D. L. Compressed sensing. IEEE Trans. Inform. Theory 52 (2006), 1289-1306.

Digital Library

[18]

EKANADHAM, C., TRANCHINA, D., AND SIMONCELLI, E. P. Recovery of sparse translation-invariant signals with continuous basis pursuit. Signal Processing, IEEE Transactions on 59, 10 (2011), 4735-4744.

Digital Library

[19]

ERCEG, V., SCHUMACHER, L., KYRITSI, P., AND ET AL. TGn channel models. Tech. Rep. IEEE P802.11, Wireless LANs, Garden Grove, Calif, USA (2004).

[20]

GJENGSET, J., XIONG, J., MCPHILLIPS, G., AND JAMIESON, K. Phaser: Enabling Phased Array Signal Processing on Commodity WiFi Access Points. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (New York, NY, USA, 2014), MobiCom '14, ACM, pp. 153-164.

Digital Library

[21]

GOLDSMITH, A. Wireless communications. Cambridge university press, 2005.

[22]

GUPTA, S., MORRIS, D., PATEL, S., AND TAN, D. Soundwave: using the Doppler Effect to Sense Gestures. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2012), ACM, pp. 1911-1914.

Digital Library

[23]

HARRISON, C., TAN, D., AND MORRIS, D. Skinput: Appropriating the Body as an Input Surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2010), ACM, pp. 453-462.

Digital Library

[24]

JIA, Y., KONG, L., YANG, X., AND WANG, K. Through-wall-radar localization for stationary human based on life-sign detection. 2013 IEEE Radar Conference (RadarCon13), 3 (Apr. 2013), 1-4.

[25]

JOSHI, K., HONG, S., AND KATTI, S. PinPoint: Localizing Interfering Radios. In Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation (Berkeley, CA, USA, 2013), nsdi'13, USENIX Association, pp. 241-254.

Digital Library

[26]

KIM, D., HILLIGES, O., IZADI, S., BUTLER, A. D., CHEN, J., OIKONOMIDIS, I., AND OLIVIER, P. Digits: Freehand 3D Interactions Anywhere Using a Wrist-Worn Gloveless Sensor. In Proceedings of the 25th annual ACM symposium on User interface software and technology (2012), ACM, pp. 167-176.

Digital Library

[27]

KOSBA, A., SAEED, A., AND YOUSSEF, M. RASID: A robust WLAN device-free passive motion detection system. In Pervasive Computing and Communications (PerCom), 2012 IEEE International Conference on (March 2012), pp. 180-189.

[28]

KUHN, H. W. The Hungarian Method for the Assignment Problem. Naval Research Logistics Quarterly 2 (1955), 83-97.

[29]

KUMAR, S., HAMED, E., KATABI, D., AND ERRAN LI, L. LTE radio analytics made easy and accessible. Proceedings of the 2014 ACM conference on SIGCOMM - SIGCOMM '14 (2014), 211-222.

Digital Library

[30]

MAAREF, N., MILLOT, P., PICHOT, C., AND PICON, O. A Study of UWB FM-CW Radar for the Detection of Human Beings in Motion Inside a Building. Geoscience and Remote Sensing, IEEE Transactions on 47, 5 (May 2009), 1297-1300.

[31]

MALLAT, S., AND ZHANG, Z. Matching Pursuit With Time-Frequency Dictionaries. IEEE Transactions on Signal Processing 41 (1993), 3397-3415.

Digital Library

[32]

MATTINGLEY, J., AND BOYD, S. CVXGEN: a code generator for embedded convex optimization. Optimization and Engineering 13, 1 (2012), 1-27.

[33]

NARAYANAN, R. M. Through-wall radar imaging using UWB noise waveforms. Journal of the Franklin Institute 345, 6 (Sept. 2008), 659-678.

[34]

PU, Q., GUPTA, S., GOLLAKOTA, S., AND PATEL, S. Whole-Home Gesture Recognition using Wireless Signals. In Proceedings of the 19th annual international conference on Mobile computing & networking (2013), ACM, pp. 27-38.

Digital Library

[35]

RALSTON, T., CHARVAT, G., AND PEABODY, J. Real-time through-wall imaging using an ultrawideband multiple-input multiple-output (MIMO) phased array radar system. In Phased Array Systems and Technology (ARRAY), 2010 IEEE International Symposium on (Oct 2010), pp. 551-558.

[36]

SEIFELDIN, M., SAEED, A., KOSBA, A. E., ELKEYI, A., AND YOUSSEF, M. Nuzzer: A Large-Scale Device-Free Passive Localization System for Wireless Environments. IEEE Transactions on Mobile Computing 12, 7 (July 2013), 1321-1334.

Digital Library

[37]

SEN, S., CHOUDHURY, R. R., AND NELAKUDITI, S. SpinLoc: Spin Once to Know Your Location. In Proceedings of the Twelfth Workshop on Mobile Computing Systems & Applications (New York, NY, USA, 2012), HotMobile '12, ACM, pp. 12:1-12:6.

Digital Library

[38]

SEN, S., LEE, J., KIM, K.-H., AND CONGDON, P. Avoiding Multipath to Revive Inbuilding WiFi Localization. In Proceeding of the 11th Annual International Conference on Mobile Systems, Applications, and Services (New York, NY, USA, 2013), MobiSys '13, ACM, pp. 249-262.

Digital Library

[39]

SHEN, Y., AND MARTINEZ, E. Channel Estimation in OFDM Systems. Application Note, Freescale Semiconductor (2006).

[40]

TIBSHIRANI, R. Regression Shrinkage and Selection Via the Lasso. Journal of the Royal Statistical Society, Series B 58 (1994), 267-288.

[41]

TIPALDI, G. D., AND RAMOS, F. Motion clustering and estimation with conditional random fields. In Intelligent Robots and Systems, 2009. IROS 2009. IEEE/RSJ International Conference on (2009), IEEE, pp. 872-877.

Digital Library

[42]

TROPP, J. A., AND GILBERT, A. C. Signal recovery from partial information via Orthogonal Matching Pursuit. IEEE TRANS. INFORM. THEORY (2005).

[43]

WANG, J., VASISHT, D., AND KATABI, D. RFIDraw: Virtual Touch Screen in the Air Using RF Signals. In Proceedings of the 2014 ACM Conference on SIGCOMM (New York, NY, USA, 2014), SIGCOMM '14, ACM, pp. 235-246.

Digital Library

[44]

WELCH, G., AND BISHOP, G. An Introduction to the Kalman Filter. Tech. rep., Chapel Hill, NC, USA, 1995.

Digital Library

[45]

WILSON, J., AND PATWARI, N. See-Through Walls: Motion Tracking Using Variance-Based Radio Tomography Networks. IEEE Transactions on Mobile Computing 10, 5 (May 2011), 612-621.

Digital Library

[46]

XIONG, J., AND JAMIESON, K. ArrayTrack: A Fine-Grained Indoor Location System. In NSDI (2013), pp. 71-84.

Digital Library

[47]

YOUSSEF, M., AND AGRAWALA, A. The Horus WLAN Location Determination System. In Proceedings of the 3rd International Conference on Mobile Systems, Applications, and Services (New York, NY, USA, 2005), MobiSys '05, ACM, pp. 205-218.

Digital Library

[48]

YOUSSEF, M., MAH, M., AND AGRAWALA, A. Challenges: Device-free Passive Localization for Wireless Environments. In Proceedings of the 13th Annual ACM International Conference on Mobile Computing and Networking (New York, NY, USA, 2007), MobiCom '07, ACM, pp. 222-229.

Digital Library

[49]

ZETIK, R., CRABBE, S., KRAJNAK, J., PEYERL, P., SACHS, J., AND THOMA, R. Detection and localization of persons behind obstacles using M-sequence through-the-wall radar, 2006.

[50]

ZHANG, D., MA, J., CHEN, Q., AND NI, L. M. An RF-Based System for Tracking Transceiver-Free Objects. In Proceedings of the Fifth IEEE International Conference on Pervasive Computing and Communications (Washington, DC, USA, 2007), PERCOM '07, IEEE Computer Society, pp. 135-144.

Digital Library

[51]

ZHANG, Z. Microsoft Kinect Sensor and Its Effect. MultiMedia, IEEE 19, 2 (Feb 2012), 4-10.

Digital Library

Cited By

Cao ZLi CLiu LZhang M(2024)WiVelo: Fine-grained Wi-Fi Walking Velocity EstimationACM Transactions on Sensor Networks10.1145/366419620:4(1-21)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3664196
Zhang GChi GZhang YDing XYang Z(2023)Push the Limit of Millimeter-wave Radar LocalizationACM Transactions on Sensor Networks10.1145/357050519:3(1-21)Online publication date: 17-Apr-2023
https://dl.acm.org/doi/10.1145/3570505
Zhao CLi ZDing HXi WWang GZhao J(2021)Anti-Spoofing Voice CommandsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34781165:3(1-22)Online publication date: 14-Sep-2021
https://dl.acm.org/doi/10.1145/3478116
Show More Cited By

WiDeo: fine-grained device-free motion tracing using RF backscatter
1. Networks
  1. Network types

Recommendations

Revision of total hip arthroplasty: Clinical outcome of extended trochanteric osteotomy and intraoperative femoral fracture

In femoral revision arthroplasty the orthopaedic surgeon frequently has to decide between performing an extended trochanteric osteotomy or trying to remove the femoral stem without an osteotomy and taking the risk of an intraoperative fracture. As this ...
Read More
A New Low-Profile Inverted A-Shaped Patch Antenna for Multi-band Operations

This paper presents the design and analysis of a compact modified inverted-A shape multi-band patch antenna for WiMAX and C-band telecommunication satellite applications. The proposed antenna has simple geometrical structure which consist of 20 mm x 20 ...
Read More
Design of conical DRH antennas for K and Ka frequency bands

Two conical double-ridged horn (DRH) antennas for K and Ka frequency bands are presented. Detailed simulation and experimental investigations are conducted to understand their behaviors and optimize for broadband operation. The designed antennas were ...
Read More

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

NSDI'15: Proceedings of the 12th USENIX Conference on Networked Systems Design and Implementation

May 2015

620 pages

ISBN:9781931971218

Program Chairs:
Paul Barham
Google
,
Arvind Krishnamurthy
University of Washington

Sponsors

VMware
NSF: National Science Foundation
Google Inc.
Microsoft Reasearch: Microsoft Reasearch
CISCO

Publisher

USENIX Association

United States

Publication History

Published: 04 May 2015

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

34
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

Cao ZLi CLiu LZhang M(2024)WiVelo: Fine-grained Wi-Fi Walking Velocity EstimationACM Transactions on Sensor Networks10.1145/366419620:4(1-21)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3664196
Zhang GChi GZhang YDing XYang Z(2023)Push the Limit of Millimeter-wave Radar LocalizationACM Transactions on Sensor Networks10.1145/357050519:3(1-21)Online publication date: 17-Apr-2023
https://dl.acm.org/doi/10.1145/3570505
Zhao CLi ZDing HXi WWang GZhao J(2021)Anti-Spoofing Voice CommandsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/34781165:3(1-22)Online publication date: 14-Sep-2021
https://dl.acm.org/doi/10.1145/3478116
Chen XLiu JWang XLiu HJiang DChen LBhagwan RPorter G(2020)EingerprintProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388320(1101-1114)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388320
Ha ULeng JKhaddaj AAdib FBhagwan RPorter G(2020)Food and liquid sensing in practical environments using RFIDsProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388319(1083-1100)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388319
Liu XChi ZWang WYao YZhu TBhagwan RPorter G(2020)VMscatterProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388306(895-910)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388306
Dhekne AChakraborty ASundaresan KRangarajan SLorch JYu M(2019)TrackIOProceedings of the 16th USENIX Conference on Networked Systems Design and Implementation10.5555/3323234.3323295(751-764)Online publication date: 26-Feb-2019
https://dl.acm.org/doi/10.5555/3323234.3323295
Jang JAdib FWu JHall W(2019)Underwater backscatter networkingProceedings of the ACM Special Interest Group on Data Communication10.1145/3341302.3342091(187-199)Online publication date: 19-Aug-2019
https://dl.acm.org/doi/10.1145/3341302.3342091
Zheng YZhang YQian KZhang GLiu YWu CYang ZSong JKim MLane NBalan R(2019)Zero-Effort Cross-Domain Gesture Recognition with Wi-FiProceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services10.1145/3307334.3326081(313-325)Online publication date: 12-Jun-2019
https://dl.acm.org/doi/10.1145/3307334.3326081
Xie YXiong JLi MJamieson KAgarwal SGreenstein BBalasubramanian AGollakota SZhang X(2019)mD-TrackThe 25th Annual International Conference on Mobile Computing and Networking10.1145/3300061.3300133(1-16)Online publication date: 5-Aug-2019
https://dl.acm.org/doi/10.1145/3300061.3300133
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents