research-article

Duet: Estimating User Position and Identity in Smart Homes Using Intermittent and Incomplete RF-Data

Authors:

Deepak Vasisht,

Zachary Kabelac,

Dina KatabiAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 2, Issue 2

Article No.: 84, Pages 1 - 21

https://doi.org/10.1145/3214287

Published: 05 July 2018 Publication History

Abstract

Although past work on RF-based indoor localization has delivered important advances, it typically makes assumptions that hinder its adoption in smart home applications. Most localization systems assume that users carry their phones on them at home, an assumption that has been proven highly inaccurate in past measurements. The few localization systems that do not require the user to carry a device on her, cannot tell the identity of the person; yet identification is essential to most smart home applications. This paper focuses on addressing these issues so that smart homes can benefit from recent advances in indoor localization.

We introduce Duet, a multi-modal system that takes as input measurements from both device-based and device-free localization. Duet introduces a new framework that combines probabilistic inference with first order logic to reason about the users' most likely locations and identities in light of the measurements. We implement Duet and compare it with a baseline that uses state-of-art WiFi-based localization. The results of two weeks of monitoring in two smart environments show that Duet accurately localizes and identifies the users for 94% and 96% of the time in the two places. In contrast, the baseline is accurate 17% and 42% respectively.

References

[1]

Heba Abdelnasser, Reham Mohamed, Ahmed Elgohary, Moustafa Farid Alzantot, He Wang, Souvik Sen, Romit Roy Choudhury, and Moustafa Youssef. 2016. SemanticSLAM: Using Environment Landmarks for Unsupervised Indoor Localization (Transactions on Mobile Computing).

[2]

Fadel Adib, Chen-Yu Hsu, Hongzi Mao, Dina Katabi, and Fredo Durand. 2015. RF-Capture: Capturing the Human Figure Through a Wall (SIGGRAPH Asia).

[3]

Fadel Adib, Zachary Kabelac, and Dina Katabi. 2015. Multi-person Localization via RF Body Reflections (NSDI).

Digital Library

[4]

Fadel Adib, Zach Kabelac, Dina Katabi, and Robert C. Miller. 2014. 3D Tracking via Body Radio Reflections (NSDI).

Digital Library

[5]

Imad Afyouni, Cyril Ray, and Christophe Claramunt. 2012. Spatial Models for Context-Aware Indoor Navigation Systems: A Survey (JOSIS).

[6]

Martin Azizyan, Ionut Constandache, and Romit Roy Choudhury. 2009. SurroundSense: Mobile Phone Localization via Ambience Fingerprinting (ACM MobiCom).

Digital Library

[7]

Victor Bahl and Venkat Padmanabhan. 2000. RADAR: An In-Building RF-based User Location and Tracking System (INFOCOM).

[8]

Paolo Barsocchi, Stefano Chessa, Erina Ferro, Francesco Furfari, and Francesco Potorti. 2011. Context Driven Enhancement of RSS-based Localization Systems (ISCC).

Digital Library

[9]

Krishna Chintalapudi, Anand Padmanabha Iyer, and Venkata N. Padmanabhan. 2010. Indoor Localization Without the Pain (MobiCom).

Digital Library

[10]

Anind K. Dey, Katarzyna Wac, Denzil Ferreira, Kevin Tassini, Jin-Hyuk Hong, and Julian Ramos. 2011. Getting Closer: An Empirical Investigation of the Proximity of User to Their Smart Phones (UbiComp).

Digital Library

[11]

Denzil Ferreira, Jorge Goncalves, Vassilis Kostakos, Louise Barkhuus, and Anind K. Dey. 2014. Contextual Experience Sampling of Mobile Application Micro-usage (MobileHCI).

Digital Library

[12]

Andrey Finkelstein, Ron Biton, Rami Puzis, and Asaf Shabtai. 2017. Classification of Smartphone Users Using Internet Traffic. CoRR Arxiv (2017).

[13]

G. D. Forney. 1973. The Viterbi Algorithm. Proc. IEEE (1973).

[14]

Jon Gjengset, Jie Xiong, Graeme McPhillips, and Kyle Jamieson. 2014. Phaser: Enabling Phased Array Signal Processing on Commodity Wi-Fi Access Points. MobiCom (2014).

Digital Library

[15]

Kiran Joshi, Steven Hong, and Sachin Katti. 2013. PinPoint: Localizing Interfering Radios (NSDI).

Digital Library

[16]

Avinash Kalyanaraman, Dezhi Hong, Elahe Soltanaghaei, and Kamin Whitehouse. 2017. Forma Track: Tracking People Based on Body Shape. ACM IMWUT (2017).

Digital Library

[17]

Manikanta Kotaru, Kiran Joshi, Dinesh Bharadia, and Sachin Katti. 2015. SpotFi: Decimeter Level Localization Using Wi-Fi (SIGCOMM).

Digital Library

[18]

Swarun Kumar, Stephanie Gil, Dina Katabi, and Daniela Rus. 2014. Accurate Indoor Localization with Zero Start-up Cost (MobiCom).

Digital Library

[19]

Swarun Kumar, Ezzeldin Hamed, Dina Katabi, and Li Erran Li. 2014. LTE Radio Analytics Made Easy and Accessible (SIGCOMM).

Digital Library

[20]

Ye-Sheng Kuo, Pat Pannuto, Ko-Jen Hsiao, and Prabal Dutta. 2014. Luxapose: Indoor Positioning with Mobile Phones and Visible Light (ACM MobiCom).

Digital Library

[21]

Huaxin Li, Zheyu Xu, Haojin Zhu, Di Ma, Shuai Li, and Kai Xing. 2016. Demographics inference through Wi-Fi network traffic analysis (INFOCOM).

[22]

Tianxing Li, Chuankai An, Zhao Tian, Andrew T. Campbell, and Xia Zhou. 2015. Human Sensing Using Visible Light Communication (ACM MobiCom).

Digital Library

[23]

Tianxing Li, Qiang Liu, and Xia Zhou. 2016. Practical Human Sensing in the Light (ACM MobiSys).

Digital Library

[24]

Hongbo Liu, Yu Gan, Jie Yang, Simon Sidhom, Yan Wang, Yingying Chen, and Fan Ye. 2012. Push the Limit of WiFi Based Localization for Smartphones (ACM Mobicom).

Digital Library

[25]

J. Oh and J. Um. 2018. Acoustic Signal-Based Indoor Global Coordinates System for Smartphones. IEEE Sensors Journal (2018).

[26]

Shwetak N. Patel, Julie A. Kientz, Gillian R. Hayes, Sooraj Bhat, and Gregory D. Abowd. 2006. Farther Than You May Think: An Empirical Investigation of the Proximity of Users to Their Mobile Phones (UbiComp).

Digital Library

[27]

D. J. Patterson, D. Fox, H. Kautz, and M. Philipose. 2005. Fine-grained Activity Recognition by Aggregating Abstract Object Usage (ISWC).

Digital Library

[28]

Anshul Rai, Krishna Kant Chintalapudi, Venkata N. Padmanabhan, and Rijurekha Sen. 2012. Zee: Zero-effort Crowdsourcing for Indoor Localization (MobiCom).

Digital Library

[29]

Montserrat Ros, Joshua Boom, Gavin de Hosson, and Matthew D'Souza. 2012. Indoor Localisation Using a Context-Aware Dynamic Position Tracking Model (International Journal of Navigation and Observation).

[30]

Christoph Scholz, Martin Atzmueller, and Gerd Stumme. 2014. Unsupervised and Hybrid Approaches for On-line RFID Localization with Mixed Context Knowledge.

[31]

Souvik Sen, Jeongkeun Lee, Kyu-Han Kim, and Paul Congdon. 2013. Avoiding Multipath to Revive Inbuilding Wi-Fi Localization (MobiSys).

Digital Library

[32]

Suranga Seneviratne, Aruna Seneviratne, Prasant Mohapatra, and Anirban Mahanti. July 2014. Your Installed Apps Reveal Your Gender and More! SIGMOBILE Mob. CCR (July 2014).

Digital Library

[33]

Zheng Sun, Rick Farley, Telis Kaleas, Judy Ellis, and Kiran Chikkappa. 2011. Cortina: Collaborative COntext-aware Indoor Positioning Employing RSS and RToF Techniques (PERCOM).

[34]

Deepak Vasisht, Swarun Kumar, and Dina Katabi. 2016. Decimeter-Level Localization with a Single Wi-Fi Access Point (NSDI).

Digital Library

[35]

Ju Wang, Hongbo Jiang, Jie Xiong, Kyle Jamieson, Xiaojiang Chen, Dingyi Fang, and Binbin Xie. 2016. LiFS: Low Human-effort, Device-free Localization with Fine-grained Subcarrier Information (MobiCom).

Digital Library

[36]

Jue Wang and Dina Katabi. 2013. Dude, Where's My Card?: RFID Positioning That Works with Multipath and Non-line of Sight (SIGCOMM).

Digital Library

[37]

Wei Wang, Alex X. Liu, and Muhammad Shahzad. 2016. Gait Recognition Using Wi-Fi Signals (UbiComp).

Digital Library

[38]

F. Wen and C. Liang. 2015. Fine-Grained Indoor Localization Using Single Access Point With Multiple Antennas. IEEE Sensors Journal (2015).

[39]

Tong Xin, Bin Guo, Zhu Wang, Mingyang Li, and Zhiwen Yu. 2016. FreeSense: Indoor Human Identification with Wi-Fi Signals. CoRR Arxiv (2016).

[40]

Jie Xiong and Kyle Jamieson. 2013. ArrayTrack: A Fine-grained Indoor Location System (NSDI).

Digital Library

[41]

Jie Xiong, Karthikeyan Sundaresan, and Kyle Jamieson. 2015. ToneTrack: Leveraging Frequency-Agile Radios for Time-Based Indoor Wireless Localization (MobiCom).

Digital Library

[42]

Chenren Xu, Bernhard Firner, Yanyong Zhang, Richard Howard, Jun Li, and Xiaodong Lin. 2012. Improving RF-based Device-free Passive Localization in Cluttered Indoor Environments Through Probabilistic Classification Methods (IPSN).

Digital Library

[43]

Zhice Yang, Zeyu Wang, Jiansong Zhang, Chenyu Huang, and Qian Zhang. 2015. Wearables Can Afford: Light-weight Indoor Positioning with Visible Light (ACM MobiSys).

Digital Library

[44]

Moustafa Youssef and Ashok Agrawala. 2005. The Horus WLAN Location Determination System (MobiSys).

Digital Library

[45]

Moustafa Youssef, Matthew Mah, and Ashok Agrawala. 2007. Challenges: Device-free Passive Localization for Wireless Environments (MobiCom).

Digital Library

[46]

Chi Zhang and Xinyu Zhang. 2016. LiTell: Robust Indoor Localization Using Unmodified Light Fixtures. In Proceedings of the 22Nd Annual International Conference on Mobile Computing and Networking (ACM MobiCom).

Digital Library

[47]

Shilin Zhu and Xinyu Zhang. 2017. Enabling High-Precision Visible Light Localization in TodayâĂ&Zacute;s Buildings (ACM MobiSys).

Digital Library

Cited By

Xue JChen XChi QXiao W(2024)Online Learning-Based Adaptive Device-Free Localization in Time-Varying Indoor EnvironmentApplied Sciences10.3390/app1402064314:2(643)Online publication date: 12-Jan-2024
https://doi.org/10.3390/app14020643
Hu JJiang HLiu DXiao ZDustdar SLiu J(2024)A Wireless Self-Service System for Library Using Commodity RFID DevicesIEEE Internet of Things Journal10.1109/JIOT.2023.330146211:3(4998-5010)Online publication date: 1-Feb-2024
https://doi.org/10.1109/JIOT.2023.3301462
Xiao JLuo BXu LLi BChen Z(2024)A survey on application in RF signalMultimedia Tools and Applications10.1007/s11042-023-15952-383:4(11885-11908)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1007/s11042-023-15952-3
Show More Cited By

Index Terms

Duet: Estimating User Position and Identity in Smart Homes Using Intermittent and Incomplete RF-Data
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools

Recommendations

BLoc: CSI-based accurate localization for BLE tags
CoNEXT '18: Proceedings of the 14th International Conference on emerging Networking EXperiments and Technologies

Bluetooth Low Energy (BLE) tags have become very prevalent over the last decade for tracking applications in homes as well as businesses. These tags are used to track objects, navigate people, and deliver contextual advertisements. However, in spite of ...
Duet: exploring joint interactions on a smart phone and a smart watch
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

The emergence of smart devices (e.g., smart watches and smart eyewear) is redefining mobile interaction from the solo performance of a smart phone, to a symphony of multiple devices. In this paper, we present Duet -- an interactive system that explores ...
A Polygonal Method for Ranging-Based Localization in an Indoor Wireless Sensor Network

In this paper, we propose an indoor localization method in a wireless sensor network based on IEEE 802.15.4 specification. The proposed method follows a ranging-based approach using not only the measurements of received signal strength (RSS) but also ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 2, Issue 2

June 2018

741 pages

EISSN:2474-9567

DOI:10.1145/3236498

Issue’s Table of Contents

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 July 2018

Accepted: 01 April 2018

Revised: 01 April 2018

Received: 01 February 2018

Published in IMWUT Volume 2, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
644
Total Downloads

Downloads (Last 12 months)33
Downloads (Last 6 weeks)3

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xue JChen XChi QXiao W(2024)Online Learning-Based Adaptive Device-Free Localization in Time-Varying Indoor EnvironmentApplied Sciences10.3390/app1402064314:2(643)Online publication date: 12-Jan-2024
https://doi.org/10.3390/app14020643
Hu JJiang HLiu DXiao ZDustdar SLiu J(2024)A Wireless Self-Service System for Library Using Commodity RFID DevicesIEEE Internet of Things Journal10.1109/JIOT.2023.330146211:3(4998-5010)Online publication date: 1-Feb-2024
https://doi.org/10.1109/JIOT.2023.3301462
Xiao JLuo BXu LLi BChen Z(2024)A survey on application in RF signalMultimedia Tools and Applications10.1007/s11042-023-15952-383:4(11885-11908)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1007/s11042-023-15952-3
Zou QLi QLi RHuang YTyson GXiao JJiang Y(2023)IoTBeholderProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35808907:1(1-26)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580890
Hua YXie ZYe F(2023)A Study of Practical Radar-based Nighttime Respiration Monitoring at Home2023 IEEE Radar Conference (RadarConf23)10.1109/RadarConf2351548.2023.10149560(1-6)Online publication date: 1-May-2023
https://doi.org/10.1109/RadarConf2351548.2023.10149560
Xiao JChen ZLuo B(2023)A Novel Two-Stage Net for Human Body Region Segmentation via Centimeter-Wave Radar2023 3rd International Conference on Neural Networks, Information and Communication Engineering (NNICE)10.1109/NNICE58320.2023.10105808(104-107)Online publication date: 24-Feb-2023
https://doi.org/10.1109/NNICE58320.2023.10105808
Pokhrel SKua JSatish DWilliams PZaslavsky ALoke SChoi J(2023)Deakin RF-Sensing: Experiments on Correlated Knowledge Distillation for Monitoring Human Postures With RadiosIEEE Sensors Journal10.1109/JSEN.2023.332013123:22(28399-28410)Online publication date: 15-Nov-2023
https://doi.org/10.1109/JSEN.2023.3320131
Ou RChen YDeng Y(2023)WiWalk: Gait-Based Dual-User Identification Using WiFi DeviceIEEE Internet of Things Journal10.1109/JIOT.2022.322220410:6(5321-5334)Online publication date: 15-Mar-2023
https://doi.org/10.1109/JIOT.2022.3222204
Chen HMunir SLin S(2022)RFCamProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35345886:2(1-29)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3534588
Zhang XChen LFeng MJiang T(2022)Toward Reliable Non-Line-of-Sight Localization Using Multipath ReflectionsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35172446:1(1-25)Online publication date: 29-Mar-2022
https://dl.acm.org/doi/10.1145/3517244
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents