research-article

Public Access

RFCam: Uncertainty-aware Fusion of Camera and Wi-Fi for Real-time Human Identification with Mobile Devices

Authors:

Shan LinAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 6, Issue 2

Article No.: 47, Pages 1 - 29

https://doi.org/10.1145/3534588

Published: 07 July 2022 Publication History

Abstract

As cameras and Wi-Fi access points are widely deployed in public places, new mobile applications and services can be developed by connecting live video analytics to the mobile Wi-Fi-enabled devices of the relevant users. To achieve this, a critical challenge is to identify the person who carries a device in the video with the mobile device's network ID, e.g., MAC address. To address this issue, we propose RFCam, a system for human identification with a fusion of Wi-Fi and camera data. RFCam uses a multi-antenna Wi-Fi radio to collect CSI of Wi-Fi packets sent by mobile devices, and a camera to monitor users in the area. With low sampling rate CSI data, RFCam derives heterogeneous embedding features on location, motion, and user activity for each device over time, and fuses them with visual user features generated from video analytics to find the best matches. To mitigate the impacts of multi-user environments on wireless sensing, we develop video-assisted learning models for different features and quantify their uncertainties, and incorporate them with video analytics to rank moments and features for robust and efficient fusion. RFCam is implemented and tested in indoor environments for over 800 minutes with 25 volunteers, and extensive evaluation results demonstrate that RFCam achieves real-time identification average accuracy of 97.01% in all experiments with up to ten users, significantly outperforming existing solutions.

Supplementary Material

chen (chen.zip)

Supplemental movie, appendix, image and software files for, RFCam: Uncertainty-aware Fusion of Camera and Wi-Fi for Real-time Human Identification with Mobile Devices

Download
85.15 KB

References

[1]

Heba Abdelnasser, Moustafa Youssef, and Khaled A Harras. 2015. WiGest: A Ubiquitous WiFi-based Gesture Recognition System. In Proceedings of the IEEE Conference on Computer Communications (INFOCOM '15). IEEE, Orlando, USA, 1472--1480. https://doi.org/10.1109/INFOCOM.2015.7218525

[2]

Alexandre Alahi, Albert Haque, and Li Fei-Fei. 2015. RGB-W: When Vision Meets Wireless. In Proceedings of the IEEE International Conference on Computer Vision (ICCV '15). IEEE, Santiago, Chile, 3289--3297. https://doi.org/10.1109/ICCV.2015.376

Digital Library

[3]

Shefali Arora and M.P. S Bhatia. 2018. A Computer Vision System for Iris Recognition Based on Deep Learning. In Proceedings of the IEEE 8th International Advance Computing Conference (IACC '18). IEEE, Greater Noida, India, 157--161. https://doi.org/10.1109/IADCC.2018.8692114

[4]

Roshan Ayyalasomayajula, Deepak Vasisht, and Dinesh Bharadia. 2018. BLoc: CSI-based Accurate Localization for BLE Tags. In Proceedings of the 14th International Conference on emerging Networking EXperiments and Technologies (CoNEXT '18). ACM, Heraklion/Crete, Greece, 126--138. https://doi.org/10.1145/3281411.3281428

Digital Library

[5]

Cheng Bo, Lan Zhang, Xiang-Yang Li, Qiuyuan Huang, and Yu Wang. 2013. Silent Sense: Silent User Identification Via Touch and Movement Behavioral Biometrics. In Proceedings of the 19th annual international conference on Mobile computing & networking (MobiCom '13). ACM, Miami, USA, 187--190. https://doi.org/10.1145/2500423.2504572

Digital Library

[6]

Siyuan Cao and He Wang. 2018. Enabling Public Cameras to Talk to the Public. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (July 2018), 63:1--63:20. https://doi.org/10.1145/3214266

Digital Library

[7]

Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2021. OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields. IEEE Transactions on Pattern Analysis & Machine Intelligence 43, 01 (Jan. 2021), 172--186. https://doi.org/10.1109/TPAMI.2019.2929257

Digital Library

[8]

Xi Chen, Hang Li, Chenyi Zhou, Xue Liu, Di Wu, and Gregory Dudek. 2020. FiDo: Ubiquitous Fine-Grained WiFi-based Localization for Unlabelled Users via Domain Adaptation. In Proceedings of The Web Conference 2020 (WWW '20). ACM, Taipei, 23--33. https://doi.org/10.1145/3366423.3380091

Digital Library

[9]

Adriano Di Luzio, Alessandro Mei, and Julinda Stefa. 2016. Mind Your Probes: De-Anonymization of Large Crowds Through Smartphone WiFi Probe Requests. In Proceedings of the 35th Annual IEEE International Conference on Computer Communications (INFOCOM '16). IEEE, San Francisco, USA, 1--9. https://doi.org/10.1109/INFOCOM.2016.7524459

Digital Library

[10]

Shiwei Fang, Tamzeed Islam, Sirajum Munir, and Shahriar Nirjon. 2020. EyeFi: Fast Human Identification Through Vision and WiFi-based Trajectory Matching. In Proceedings of the 16th International Conference on Distributed Computing in Sensor Systems (DCOSS '20). IEEE, Los Angeles, USA, 59--68. https://doi.org/10.1109/DCOSS49796.2020.00022

[11]

Jingyun Feng, Zhi Liu, and Yusheng Ji. 2014. Wireless Channel Loss Analysis - A Case Study Using WiFi-Direct. In Proceedings of the International wireless communications and mobile computing conference (IWCMC '14). IEEE, Nicosia, Cyprus, 244--249. https://doi.org/10.1109/IWCMC.2014.6906364

[12]

Toufik Guettari, Paulo AC Aguilar, Jerome Boudy, Hamid Medjahed, Dan Istrate, Jean-Louis Baldinger, Imad Belfeki, Martin Opitz, and Matthias Maly-Persy. 2010. Multimodal Localization in the Context of a Medical Telemonitoring System. In Proceedings of the 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS '10). IEEE, Buenos Aires, Argentina, 3835--3838. https://doi.org/10.1109/IEMBS.2010.5627688

[13]

Omar Hamdoun, Fabien Moutarde, Bogdan Stanciulescu, and Bruno Steux. 2008. Person Re-identification in Multi-camera System by Signature based on Interest Point Descriptors Collected on Short Video Sequences. In the 2008 Second ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC '08). IEEE, Palo Alto, USA, 1--6. https://doi.org/10.1109/ICDSC.2008.4635689

[14]

Tian He, Chengdu Huang, Brian M Blum, John A Stankovic, and Tarek Abdelzaher. 2003. Range-Free Localization Schemes for Large Scale Sensor Networks. In Proceedings of the 9th Annual International Conference on Mobile Computing and Networking (MobiCom '03). ACM, San Diego, USA, 81--95. https://doi.org/10.1145/938985.938995

Digital Library

[15]

Feng Hong, Xiang Wang, Yanni Yang, Yuan Zong, Yuliang Zhang, and Zhongwen Guo. 2016. WFID: Passive Device-free Human Identification Using WiFi Signal. In Proceedings of the 13th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MobiQuitous '16). ACM, Hiroshima, Japan, 47--56. https://doi.org/10.1145/2994374.2994377

Digital Library

[16]

Hande Hong, Girisha Durrel De Silva, and Mun Choon Chan. 2018. CrowdProbe: Non-invasive crowd monitoring with Wi-Fi probe. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3, Article 115 (Sept. 2018), 23 pages. https://doi.org/10.1145/3264925

Digital Library

[17]

Hua Huang and Shan Lin. 2020. WiDet: Wi-Fi Based Device-Free Passive Person Detection with Deep Convolutional Neural Networks. Computer Communications 150 (Jan. 2020), 257--366. https://doi.org/10.1016/j.comcom.2019.09.016

Digital Library

[18]

Hua Huang, Chien-Chun Ni, Xiaomeng Ban, Jie Gao, Andrew T. Schneider, and Shan Lin. 2014. Connected Wireless Camera Network Deployment with Visibility Coverage. In Proceedings of the 33rd Annual IEEE Conference on Computer Communications (INFOCOM '14). IEEE, Toronto, Canada, 1204--1212. https://doi.org/10.1109/INFOCOM.2014.6848052

[19]

Agent Video Intelligence. 2021. innoVi×. https://www.agentvi.com/product/innovi/.

[20]

Md Tamzeed Islam and Shahriar Nirjon. 2020. Wi-Fringe: Leveraging Text Semantics in WiFi CSI-Based Device-Free Named Gesture Recognition. In Proceedings of the 16th International Conference on Distributed Computing in Sensor Systems (DCOSS '20). IEEE, Los Angeles, USA, 35--42. https://doi.org/10.1109/DCOSS49796.2020.00019

[21]

Dheryta Jaisinghani, Rajesh Krishna Balan, Vinayak Naik, Archan M isra, and Youngki Lee. 2018. Experiences & Challenges with Server-Side WiFi Indoor Localization Using Existing Infrastructure. In Proceedings of the 15th EAI International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MobiQuitous '18). ACM, New York, USA, 226--235. https://doi.org/10.1145/3286978.3286989

Digital Library

[22]

Chitra R Karanam, Belal Korany, and Yasamin Mostofi. 2018. Magnitude-Based Angle-of-Arrival Estimation, Localization, and Target Tracking. In Proceedings of the 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN '18). IEEE, Porto, Portugal, 254--265. https://doi.org/10.1109/IPSN.2018.00053

Digital Library

[23]

Mohammad Hadi Kefayati, Vahid Pourahmadi, and Hassan Aghaeinia. 2020. Wi2Vi: Generating Video Frames From WiFi CSI Samples. IEEE Sensors Journal 20, 19 (May 2020), 11463--11473. https://doi.org/10.1109/JSEN.2020.2996078

[24]

Benjamin Kempke, Pat Pannuto, Bradford Campbell, and Prabal Dutta. 2016. SurePoint: Exploiting Ultra Wideband Flooding and Diversity to Provide Robust, Scalable, High-Fidelity Indoor Localization. In Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems (SenSys '16). ACM, Stanford, USA, 137--149. https://doi.org/10.1145/2994551.2994570

Digital Library

[25]

Sanaz Kianoush, Stefano Savazzi, Federico Vicentini, Vittorio Rampa, and Matteo Giussani. 2016. Device-Free RF Human Body Fall Detection and Localization in Industrial Workplaces. IEEE Internet of Things Journal 4, 2 (Nov. 2016), 351--362. https://doi.org/10.1109/JIOT.2016.2624800

[26]

Belal Korany, Chitra R Karanam, Hong Cai, and Yasamin Mostofi. 2019. XModal-ID: Using WiFi for Through-Wall Person Identification from Candidate Video Footage. In Proceedings of the 25th Annual International Conference on Mobile Computing and Networking (MobiCom '19). ACM, Los Cabos, Mexico, 36:1--36:15. https://doi.org/10.1145/3300061.3345437

Digital Library

[27]

Manikanta Kotaru, Kiran Joshi, Dinesh Bharadia, and Sachin Katti. 2015. SpotFi: Decimeter Level Localization Using WiFi. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication (SIGCOMM '15). ACM, London, United Kingdom, 269--282. https://doi.org/10.1145/2785956.2787487

Digital Library

[28]

Xufeng Lin, Chang-Tsun Li, Victor Sanchez, and Carsten Maple. 2021. On the detection-to-track association for online multi-object tracking. Pattern Recognition Letters 146 (March 2021), 200--207. https://doi.org/10.1016/j.patrec.2021.03.022

[29]

Hongbo Liu, Yu Gan, Jie Yang, Simon Sidhom, Yan Wang, Yingying Chen, and Fan Ye. 2012. Push the Limit of WiFi based Localization for Smartphones. In Proceedings of the 18th annual international conference on Mobile computing and networking (MobiCom '12). ACM, Istanbul, Turkey, 305--316. https://doi.org/10.1145/2348543.2348581

Digital Library

[30]

Xiaochen Liu, Yurong Jiang, Puneet Jain, and Kyu-Han Kim. 2018. TAR: Enabling Fine-Grained Targeted Advertising in Retail Stores. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys '18). ACM, Munich, Germany, 323--336. https://doi.org/10.1145/3210240.3210342

Digital Library

[31]

Antonio Loquercio, Mattia Segu, and Davide Scaramuzza. 2020. A general framework for uncertainty estimation in deep learning. IEEE Robotics and Automation Letters 5, 2 (Feb. 2020), 3153--3160. https://doi.org/10.1109/LRA.2020.2974682

[32]

Konrad Lorincz and Matt Welsh. 2005. MoteTrack: A Robust, Decentralized Approach to RF-Based Location Tracking. In Proceedings of the International Symposium on Location-and Context-Awareness (LoCA '05). Springer, Oberpfaffenhofen, Germany, 63--82. https://doi.org/10.1007/11426646_7

Digital Library

[33]

Chris Xiaoxuan Lu, Xuan Kan, Bowen Du, Changhao Chen, Hongkai Wen, Andrew Markham, Niki Trigoni, and John Stankovic. 2019. Autonomous Learning for Face Recognition in the Wild via Ambient Wireless Cues. In Proceedings of the World Wide Web Conference (WWW '19). ACM, San Francisco, USA, 1175--1186. https://doi.org/10.1145/3308558.3313398

Digital Library

[34]

Bruce D. Lucas and Takeo Kanade. 1981. An Iterative Image Registration Technique with an Application to Stereo Vision. In Proceedings of the 7th International Joint Conference on Artificial Intelligence (IJCAI '81)- Volume 2 (Vancouver, Canada) (IJCAI'81, Vol. 2). IJCAI, San Francisco, CA, USA, 674--679.

[35]

Dimitrios Lymberopoulos, Jie Liu, Xue Yang, Romit Roy Choudhury, Vlado Handziski, and Souvik Sen. 2015. A Realistic Evaluation and Comparison of Indoor Location Technologies: Experiences and Lessons Learned. In Proceedings of the 14th international conference on information processing in sensor networks (IPSN '15). ACM, Seattle, Washington, 178--189. https://doi.org/10.1145/2737095.2737726

Digital Library

[36]

Célestin Matte, Mathieu Cunche, Franck Rousseau, and Mathy Vanhoef. 2016. Defeating MAC Address Randomization Through Timing Attacks. In Proceedings of the 9th ACM Conference on Security & Privacy in Wireless and Mobile Networks (WiSec '16). ACM, Darmstadt, Germany, 15--20. https://doi.org/10.1145/2939918.2939930

Digital Library

[37]

Sirajum Munir, Ripudaman Singh Arora, Craig Hesling, Juncheng Li, Jonathan Francis, Charles Shelton, Christopher Martin, Anthony Rowe, and Mario Berges. 2017. Real-Time Fine Grained Occupancy Estimation Using Depth Sensors on ARM Embedded Platforms. In Proceedings of the 2017 IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS '17). IEEE, Pittsburgh, USA, 295--306. https://doi.org/10.1109/RTAS.2017.8

[38]

New York Times. 2021. San Francisco Banned Facial Recognition. Will California follow? https://www.nytimes.com/2019/07/01/us/facial-recognition-san-francisco.html.

[39]

Duc Thanh Nguyen, Wanqing Li, and Philip O Ogunbona. 2016. Human detection from images and videos: A survey. Pattern Recognition 51 (March 2016), 148--175. https://doi.org/10.1016/j.patcog.2015.08.027

Digital Library

[40]

Huynh Nguyen, Archan Misra, and Youngki Lee. 2016. LightSense: Exploiting Smart Bulbs for Practical Multimodal Localization. In Proceedings of 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops). IEEE, Sydney, Australia, 1--4. https://doi.org/10.1109/PERCOMW.2016.7457054

[41]

Le T Nguyen, Yu Seung Kim, Patrick Tague, and Joy Zhang. 2014. IdentityLink: User-Device Linking through Visual and RF-signal Cues. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '14). ACM, Seattle, USA, 529--539. https://doi.org/10.1145/2632048.2636072

Digital Library

[42]

Phuc Nguyen, Taeho Kim, Jinpeng Miao, Daniel Hesselius, Erin Kenneally, Daniel Massey, Eric Frew, Richard Han, and Tam Vu. 2019. Towards RF-based localization of a drone and its controller. In Proceedings of the 5th Workshop on Micro Aerial Vehicle Networks, Systems, and Applications (DroNet '19). ACM, Seoul, Republic of Korea, 21--26. https://doi.org/10.1145/3325421.3329766

Digital Library

[43]

Jeffrey Pang, Ben Greenstein, Ramakrishna Gummadi, Srinivasan Seshan, and David Wetherall. 2007. 802.11 User Fingerprinting. In Proceedings of the 13th Annual ACM International Conference on Mobile Computing and Networking (MobiCom '07). ACM, Montréal, Canada, 99--110. https://doi.org/10.1145/1287853.1287866

Digital Library

[44]

Savvas Papaioannou, Hongkai Wen, Zhuoling Xiao, Andrew Markham, and Niki Trigoni. 2015. Accurate Positioning via Cross-Modality Training. In Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems (SenSys '15). ACM, Seoul, South Korea, 239--251. https://doi.org/10.1145/2809695.2809712

Digital Library

[45]

Avinash Parnandi, Ken Le, Pradeep Vaghela, Aalaya Kolli, Karthik Dantu, Sameera Poduri, and Gaurav S Sukhatme. 2009. Coarse in-building localization with smartphones. In Proceedings of the First International Conference on Mobile Computing, Applications, and Services (MobiCASE '09). Springer, San Diego, USA, 343--354. https://doi.org/10.1007/978-3-642-12607-9_25

[46]

Jian Qiu, David Chu, Xiangying Meng, and Thomas Moscibroda. 2011. On the Feasibility of Real-Time Phone-to-Phone 3D Localization. In Proceedings of the 9th ACM Conference on Embedded Networked Sensor Systems (SenSys '11). ACM, Seattle, USA, 190--203. https://doi.org/10.1145/2070942.2070962

Digital Library

[47]

Anshul Rai, Krishna Kant Chintalapudi, Venkata N Padmanabhan, and Rijurekha Sen. 2012. Zee: Zero-Effort Crowdsourcing for Indoor Localization. In Proceedings of the 18th annual international conference on Mobile computing and networking (Mobicom '12). ACM, Istanbul, Turkey, 293--304. https://doi.org/10.1145/2348543.2348580

Digital Library

[48]

Swati Rallapalli, Wei Dong, Lili Qiu, and Yin Zhang. 2016. WaveLoc: Wavelet Signatures for Ubiquitous Localization. In Proceedings of the IEEE 13th International Conference on Mobile Ad Hoc and Sensor Systems (MASS '16). IEEE, Brasilia, Brazil, 219--227. https://doi.org/10.1109/MASS.2016.036

[49]

Carlos Ruiz, Shijia Pan, Adeola Bannis, Ming-Po Chang, Hae Young Noh, andPei Zhang. 2020. IDIoT: Towards Ubiquitous Identification of IoT Devices through Visual and Inertial Orientation Matching During Human Activity. In Proceedings of IEEE/ACM Fifth International Conference on Internet-of-Things Design and Implementation (IoTDI '20). IEEE, Sydney, Australia, 40--52. https://doi.org/10.1109/IoTDI49375.2020.00012

[50]

Elisabeth Salomon, Leo Happ Botler, Konrad Diwold, Carlo Alberto Boano, and Kay Römer. 2021. Poster: Comparison of Channel State Information Driven and RSSI-based WiFi Distance Estimation. In Proceedings of the 2021 International Conference on Embedded Wireless Systems and Networks (EWSN '21). Junction Publishing, Delft, the Netherlands, 173--174.

Digital Library

[51]

Muhamad Risqi U Saputra, Chris Xiaoxuan Lu, Pedro PB de Gusmao, Bing Wang, Andrew Markham, and Niki Trigoni. 2021. Graph-based thermal-inertial SLAM with Probabilistic Neural Networks. IEEE Transactions on Robotics (Early Access) (Nov. 2021), 1--19. https://doi.org/10.1109/TRO.2021.3120036

[52]

Stefano Savazzi, Vittorio Rampa, Federico Vicentini, and Matteo Giussani. 2015. Device-Free Human Sensing and Localization in Collaborative Human-Robot Workspaces: A Case Study. IEEE Sensors Journal 16, 5 (March 2015), 1253--1264. https://doi.org/10.1109/JSEN.2015.2500121

[53]

Ralph Schmidt. 1986. Multiple Emitter Location and Signal Parameter Estimation. IEEE Transactions on Antennas and Propagation 34, 3 (March 1986), 276--280. https://doi.org/10.1109/TAP.1986.1143830

[54]

Longfei Shangguan, Zheng Yang, Alex X Liu, Zimu Zhou, and Yunhao Liu. 2015. Relative Localization of RFID Tags using Spatial-Temporal Phase Profiling. In Proceedings of the 12th USENIX Symposium on Networked Systems Design and Implementation (NSDI '15). USENIX Association, Oakland, USA, 251--263.

[55]

Yuanchao Shu, Cheng Bo, Guobin Shen, Chunshui Zhao, Liqun Li, and Feng Zhao. 2015. Magicol: Indoor Localization Using Pervasive Magnetic Field and Opportunistic WiFi Sensing. IEEE Journal on Selected Areas in Communications 33, 7 (May 2015), 1443--1457. https://doi.org/10.1109/JSAC.2015.2430274

Digital Library

[56]

Savina Singla and Archan Misra. 2016. Indoor Location Error-Detection via Crowdsourced Multi-Dimensional Mobile Data. In Proceedings of the first workshop on mobile data (MobiData '16). ACM, Singapore, Singapore, 19--24. https://doi.org/10.1145/2935755.2935762

Digital Library

[57]

Elahe Soltanaghaei, Avinash Kalyanaraman, and Kamin Whitehouse. 2018. Multipath Triangulation: Decimeter-level WiFi Localization and Orientation with a Single Unaided Receiver. In Proceedings of the 16th annual international conference on mobile systems, applications, and services (MobiSys '18). ACM, Munich, Germany, 376--388. https://doi.org/10.1145/3210240.3210347

Digital Library

[58]

Tzu-Chun Tai, Kate Ching-Ju Lin, and Yu-Chee Tseng. 2019. Toward Reliable Localization by Unequal AoA Tracking. In Proceedings of the 17th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys '19). ACM, Seoul, Republic of Korea, 444--456. https://doi.org/10.1145/3307334.3326103

Digital Library

[59]

Sheng Tan and Jie Yang. 2016. WiFinger: Leveraging Commodity WiFi for Fine-grained Finger Gesture Recognition. In Proceedings of the 17th ACM international symposium on mobile ad hoc networking and computing (MobiHoc '16). ACM, Paderborn, Germany, 201--210. https://doi.org/10.1145/2942358.2942393

Digital Library

[60]

Thiago Teixeira, Deokwoo Jung, and Andreas Savvides. 2010. Tasking Networked CCTV Cameras and Mobile Phones to Identify and Localize Multiple People. In Proceedings of the 12th ACM international conference on Ubiquitous computing (UbiComp '10). ACM, Copenhagen, Denmark, 213--222. https://doi.org/10.1145/1864349.1864367

Digital Library

[61]

Jin Teng, Boying Zhang, Junda Zhu, Xinfeng Li, Dong Xuan, and Yuan F Zheng. 2013. EV-Loc: Integrating Electronic and Visual Signals for Accurate Localization. IEEE/ACM Transactions on Networking 22, 4 (2013), 1285--1296. https://doi.org/10.1109/TNET.2013.2274283

Digital Library

[62]

Maoqing Tian, Shuai Yi, Hongsheng Li, Shihua Li, Xuesen Zhang, Jianping Shi, Junjie Yan, and Xiaogang Wang. 2018. Eliminating Background-Bias for Robust Person Re-Identification. In Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR '18). IEEE, Salt Lake City, USA, 5794--5803. https://doi.org/10.1109/CVPR.2018.00607

[63]

Deepak Vasisht, Anubhav Jain, Chen-Yu Hsu, Zachary Kabelac, and Dina Katabi. 2018. Duet: Estimating User Position and Identity in Smart Homes Using Intermittent and Incomplete RF-Data. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 84:1--84:21. https://doi.org/10.1145/3214287

Digital Library

[64]

Deepak Vasisht, Swarun Kumar, and Dina Katabi. 2016. Decimeter-level localization with a single WiFi access point. In Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI '16). USENIX Association, Santa Clara, USA, 165--178.

[65]

Intelligent Integrated Video. 2021. i2V VMS. http://www.i2vsys.com/video-analytic.html.

[66]

Junjue Wang, Brandon Amos, Anupam Das, Padmanabhan Pillai, Norman Sadeh, and Mahadev Satyanarayanan. 2018. Enabling Live Video Analytics with a Scalable and Privacy-Aware Framework. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 14, 3s (June 2018), 64:1--64:24. https://doi.org/10.1145/3209659

Digital Library

[67]

Ju Wang, Hongbo Jiang, Jie Xiong, Kyle Jamieson, Xiaojiang Chen, Dingyi Fang, and Binbin Xie. 2016. LiFS: Low Human-Effort, Device-Free Localization with Fine-Grained Subcarrier Information. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking (MobiCom '16). ACM, New York City, USA, 243--256. https://doi.org/10.1145/2973750.2973776

Digital Library

[68]

Wei Wang, Alex X Liu, and Muhammad Shahzad. 2016. Gait Recognition Using WiFi Signals. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, Heidelberg, Germany, 363--373. https://doi.org/10.1145/2971648.2971670

Digital Library

[69]

Di Wu and Ling Shao. 2012. Silhouette Analysis-Based Action Recognition Via Exploiting Human Poses. IEEE Transactions on Circuits and Systems for Video Technology 23, 2 (June 2012), 236--243. https://doi.org/10.1109/TCSVT.2012.2203731

Digital Library

[70]

Kaishun Wu, Jiang Xiao, Youwen Yi, Dihu Chen, Xiaonan Luo, and Lionel M Ni. 2012. CSI-Based Indoor Localization. IEEE Transactions on Parallel and Distributed Systems 24, 7 (July 2012), 1300--1309. https://doi.org/10.1109/TPDS.2012.214

Digital Library

[71]

Tong Xin, Bin Guo, Zhu Wang, Mingyang Li, Zhiwen Yu, and Xingshe Zhou. 2016. FreeSense: Indoor Human Identification with Wi-Fi Signals. In Proceedings of the 2016 IEEE Global Communications Conference (GLOBECOM '16). IEEE, Washington, DC, USA, 1---7. https://doi.org/10.1109/GLOCOM.2016.7841847

Digital Library

[72]

Jie Xiong and Kyle Jamieson. 2013. ArrayTrack: A Fine-Grained Indoor Location System. In Proceedings of the 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). USENIX Association, Lombard, USA, 71--84.

[73]

Chenren Xu, Bernhard Firner, Yanyong Zhang, Richard Howard, Jun Li, and Xiaodong Lin. 2012. Improving RF-Based Device-Free Passive Localization In Cluttered Indoor Environments Through Probabilistic Classification Methods. In Proceedings of the ACM/IEEE 11th International Conference on Information Processing in Sensor Networks (IPSN '12). IEEE, Beijing, China, 209--220. https://doi.org/10.1109/IPSN.2012.6920958

[74]

Chenren Xu, Mingchen Gao, Bernhard Firner, Yanyong Zhang, Richard Howard, and Jun Li. 2012. Poster Abstract: Towards Robust Device-Free Passive Localization Through Automatic Camera-Assisted Recalibration. In Proceedings of the 10th ACM Conference on Embedded Network Sensor Systems (SenSys '12). ACM, Toronto, Canada, 339--340. https://doi.org/10.1145/2426656.2426697

Digital Library

[75]

Jingao Xu, Hengjie Chen, Kun Qian, Erqun Dong, Min Sun, Chenshu Wu, Li Zhang, and Zheng Yang. 2019. iVR: Integrated Vision and Radio Localization with Zero Human Effort. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1--22. https://doi.org/10.1145/3351272

Digital Library

[76]

Jingao Xu, Guoxuan Chi, Zheng Yang, Danyang Li, Qian Zhang, Qiang Ma, and Xin Miao. 2021. FollowUpAR: Enabling Follow-up Effects in Mobile AR Applications. In Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys '21). ACM, Virtual event, 1--13. https://doi.org/10.1145/3458864.3467675

Digital Library

[77]

Jie Yang and Yingying Chen. 2009. Indoor Localization Using Improved RSS-Based Lateration Methods. In Proceedings of the 2009 IEEE Global Telecommunications Conference (GLOBECOM '09). IEEE, Hawaii, USA, 1--6. https://doi.org/10.1109/GLOCOM.2009.5425237

[78]

Mingyu Yang, Li-Xuan Chuo, Karan Suri, Lu Liu, Hao Zheng, and Hun-Seok Kim. 2019. iLPS: Local Positioning System with Simultaneous Localization and Wireless Communication. In Proceedings of the 38th IEEE Conference on Computer Communications (INFOCOM '19). IEEE, Paris, France, 379--387. https://doi.org/10.1109/INFOCOM.2019.8737569

Digital Library

[79]

Zheng Yang, Zimu Zhou, and Yunhao Liu. 2013. From RSSI to CSI: Indoor Localization via Channel Response. ACM Computing Surveys (CSUR) 46, 2 (2013), 25:1--25:32. https://doi.org/10.1145/2543581.2543592

Digital Library

[80]

Xiaoqing Yin, Xinchao Wang, Jun Yu, Maojun Zhang, Pascal Fua, and Dacheng Tao. 2018. FishEyeRecNet: A Multi-Context Collaborative Deep Network for Fisheye Image Rectification. In Proceedings of the European Conference on Computer Vision (ECCV '18). Springer, Munich, Germany, 469--484.

Digital Library

[81]

Cheng Zhang, Wu Liu, Huadong Ma, and Huiyuan Fu. 2016. Siamese Neural Network Based Gait Recognition for Human Identification. In Proceedings of the 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '16). IEEE, Shanghai, China, 2832--2836. https://doi.org/10.1109/ICASSP.2016.7472194

Digital Library

[82]

Jin Zhang, Bo Wei, Wen Hu, and Salil S Kanhere. 2016. WiFi-ID: Human Identification Using WiFi Signal. In Proceedings of the 2016 International Conference on Distributed Computing in Sensor Systems (DCOSS '16). IEEE, Washington, DC, USA, 75--82. https://doi.org/10.1109/DCOSS.2016.30

[83]

Qingxue Zhang, Dian Zhou, and Xuan Zeng. 2017. HeartID: A Multiresolution Convolutional Neural Network for ECG-Based Biometric Human Identification in Smart Health Applications. IEEE Access 5 (May 2017), 11805--11816. https://doi.org/10.1109/ACCESS.2017.2707460

[84]

Shengkai Zhang, Wei Wang, Ning Zhang, and Tao Jiang. 2020. RF Backscatter-based State Estimation for Micro Aerial Vehicles. In Proceedings of IEEE Conference on Computer Communications (INFOCOM '20). IEEE, Virtual event, 209--217. https://doi.org/10.1109/INFOCOM41043.2020.9155463

Digital Library

[85]

Xie Zhang, Chengpei Tang, Kang Yin, and Qingqian Ni. 2021. WiFi-based Cross-Domain Gesture Recognition via Modified Prototypical Networks. IEEE Internet of Things Journal (Early Access) (2021), 1--13. https://doi.org/10.1109/JIOT.2021.3114309

[86]

Zhengyou Zhang. 2000. A Flexible New Technique for Camera Calibration. IEEE Transactions on pattern analysis and machine intelligence 22, 11 (Nov. 2000), 1330--1334. https://doi.org/10.1109/34.888718

Digital Library

[87]

Han Zou, Baoqi Huang, Xiaoxuan Lu, Hao Jiang, and Lihua Xie. 2016. A Robust Indoor Positioning System Based on the Procrustes Analysis and Weighted Extreme Learning Machine. IEEE Transactions on Wireless Communications 15, 2 (Oct. 2016), 1252--1266. https://doi.org/10.1109/TWC.2015.2487963

Digital Library

[88]

Han Zou, Yuxun Zhou, Jianfei Yang, Weixi Gu, Lihua Xie, and Costas Spanos. 2017. Multiple Kernel Representation Learning for WiFi-Based Human Activity Recognition. In Proceedings of the 16th IEEE International Conference on Machine Learning and Applications (ICMLA '17). IEEE, Cancun, Mexico, 268--274. https://doi.org/10.1109/ICMLA.2017.0-148

Cited By

Cao YDhekne AAmmar M(2024)SigningRing: Signature-based Authentication using Inertial Sensors on a Ring Form-factorProceedings of the Workshop on Body-Centric Computing Systems10.1145/3662009.3662019(11-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3662009.3662019
Gupta CSridhar SMatthies DJouffrais CNanayakkara S(2024)SonicVista: Towards Creating Awareness of Distant Scenes through SonificationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596098:2(1-32)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659609
Li YYu DChen SXing GChen HOkoshi TKo JLiKamWa R(2024)Demo: EmoMarker: A Privacy-Preserving, Multi-Modal Sensing System for Dyadic Digital Biomarkers of Expressed Emotions for Patients with DementiaProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661844(614-615)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661844
Show More Cited By

Index Terms

RFCam: Uncertainty-aware Fusion of Camera and Wi-Fi for Real-time Human Identification with Mobile Devices
1. Human-centered computing
  1. Ubiquitous and mobile computing
    1. Ubiquitous and mobile computing systems and tools
2. Networks
  1. Network types
    1. Cyber-physical networks
      1. Sensor networks

Recommendations

WiFi Sensing with Channel State Information: A Survey

With the high demand for wireless data traffic, WiFi networks have experienced very rapid growth, because they provide high throughput and are easy to deploy. Recently, Channel State Information (CSI) measured by WiFi networks is widely used for ...
Activity monitoring by fusion of optical and mechanical tracking technologies for user behavior analysis
PETRA '09: Proceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments

Patient monitoring by camera surveillance within the private surrounding suffers on privacy issues as well as high requirements on sensor technology and infrastructure. Because of those limitations there is not much knowledge on user activities and ...
IMS Network Architecture
ICFCC '09: Proceedings of the 2009 International Conference on Future Computer and Communication

There is a rapid growth and evolution in the area of telecommunications and network operators are expected to provide seamless integration of all communication applications on a single system. In these circumstances IMS has emerged out as a key player. ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 6, Issue 2

July 2022

1551 pages

EISSN:2474-9567

DOI:10.1145/3547347

Issue’s Table of Contents

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 July 2022

Published in IMWUT Volume 6, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Science Foundation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
827
Total Downloads

Downloads (Last 12 months)351
Downloads (Last 6 weeks)44

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cao YDhekne AAmmar M(2024)SigningRing: Signature-based Authentication using Inertial Sensors on a Ring Form-factorProceedings of the Workshop on Body-Centric Computing Systems10.1145/3662009.3662019(11-16)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3662009.3662019
Gupta CSridhar SMatthies DJouffrais CNanayakkara S(2024)SonicVista: Towards Creating Awareness of Distant Scenes through SonificationProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596098:2(1-32)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659609
Li YYu DChen SXing GChen HOkoshi TKo JLiKamWa R(2024)Demo: EmoMarker: A Privacy-Preserving, Multi-Modal Sensing System for Dyadic Digital Biomarkers of Expressed Emotions for Patients with DementiaProceedings of the 22nd Annual International Conference on Mobile Systems, Applications and Services10.1145/3643832.3661844(614-615)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3643832.3661844
Xu ZLiu TJiang RHu PGuo ZLiu C(2024)AFaceProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435108:1(1-33)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643510
Kaur JDas S(2024)RSPP: Restricted Static Pseudo-Partitioning for Mitigation of Cross-Core Covert Channel AttacksACM Transactions on Design Automation of Electronic Systems10.1145/363722229:2(1-22)Online publication date: 15-Jan-2024
https://dl.acm.org/doi/10.1145/3637222
Stray JHalevy AAssar PHadfield-Menell DBoutilier CAshar ABakalar CBeattie LEkstrand MLeibowicz CMoon Sehat CJohansen SKerlin LVickrey DSingh SVrijenhoek SZhang AAndrus MHelberger NProutskova PMitra TVasan N(2024)Building Human Values into Recommender Systems: An Interdisciplinary SynthesisACM Transactions on Recommender Systems10.1145/36322972:3(1-57)Online publication date: 5-Jun-2024
https://dl.acm.org/doi/10.1145/3632297
Zhang TZhang DWang GLi YHu Ysun QChen Y(2024)RLocProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314377:4(1-28)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631437
Han MYang HNi TDuan DRuan MChen YZhang JXu W(2024)mmSign: mmWave-based Few-Shot Online Handwritten Signature VerificationACM Transactions on Sensor Networks10.1145/360594520:4(1-31)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3605945
Nguyen LSusarla PMukherjee ACañellas MCasado CWu XSilvén OJayagopi DLópez M(2024)Non-contact multimodal indoor human monitoring systems: A surveyInformation Fusion10.1016/j.inffus.2024.102457110(102457)Online publication date: Oct-2024
https://doi.org/10.1016/j.inffus.2024.102457
Dedema MRosenbaum H(2024)Socio‐technical issues in the platform‐mediated gig economyJournal of the Association for Information Science and Technology10.1002/asi.2486875:3(344-374)Online publication date: 8-Jan-2024
https://dl.acm.org/doi/10.1002/asi.24868
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents