research-article

IDSense: A Human Object Interaction Detection System Based on Passive UHF RFID

Authors:

Can Ye, and

Alanson P. SampleAuthors Info & Claims

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

April 2015

Pages 2555 - 2564

https://doi.org/10.1145/2702123.2702178

Published: 18 April 2015 Publication History

Abstract

In order to enable unobtrusive human object interaction detection, we propose a minimalistic approach to instrumenting everyday objects with passive (i.e. battery-free) UHF RFID tags. By measuring the changes in the physical layer of the communication channel between the RFID tag and reader (such as RSSI, RF phase, and read rate) we are able to classify, in real time, tag/object motion events along with two types of touch events. Through a user study, we demonstrate that our real-time classification engine is able to simultaneously track 20 objects and identify four movement classes with 93% accuracy. To demonstrate how robust this general-purpose interaction mechanism is, we investigate three usage scenarios 1) interactive storytelling with toys 2) inference of daily activities in the home 3) identification of customer browsing habits in a retail setting.

Supplementary Material

suppl.mov (pn0361-file3.mp4)

Supplemental video

Download
84.38 MB

References

[1]

Bao, L. and Intille, S.S. Activity Recognition from UserAnnotated Acceleration Data. Pervasive Computing, (2004), 1--17.

[2]

Buettner, M., Prasad, R., Philipose, M., and Wetherall, D. Recognizing Daily Activities with RFID-Based Sensors. Ubicomp, (2009), 51--60.

Digital Library

[3]

Chang, C.-C. and Lin, C.-J. Libsvm. ACM Transactions on Intelligent Systems and Technology 2, 3 (2011), 1--27.

Digital Library

[4]

Dimitriou, A.G., Bletsas, A., Polycarpou, A.C., and Sahalos, J.N. On Efficient UHF RFID Coverage inside a Room. 2010 Proceedings of the Fourth European Conference on Antennas and Propagation (EuCAP), (2010), 1--5

[5]

Fishkin, K.P., Jiang, B., Philipose, M., and Roy, S. I Sense a Disturbance in the Force: Unobtrusive Detection of Interactions with RFID-tagged Objects. UbiComp, (2004), 268--282.

[6]

Gaëtanne Haché, Edward D. Lemaire, N.B. Wearable mobility monitoring using a multimedia smartphone platform. IEEE Transactions on Instrumentation and Measurement 60, 9 (2011), 3153--3161.

[7]

Hodges, S., Thorne, A., Mallinson, H., and Floerkemeier, C. Assessing and optimizing the range of UHF RFID to enable real-world pervasive computing applications. Pervasive Computing, (2007), 280--297.

Digital Library

[8]

Meli, J. and Morenza-cinos, M. Enhancing the shopping experience through RFID in an actual retail store. UbiComp, (2013), 1029--1035.

Digital Library

[9]

Nikitin, P. V., Martinez, R., Ramamurthy, S., Leland, H., Spiess, G., and Rao, K.V.S. Phase based spatial identification of UHF RFID tags. RFID 2010: International IEEE Conference on RFID, (2010), 102--109.

[10]

Parlak, S. and Marsic, I. Detecting Object Motion Using Passive RFID: A Trauma Resuscitation Case Study. IEEE Transactions on Instrumentation and Measurement 62, 9 (2013), 2430--2437.

[11]

Philipose, M. "Large-scale human activity recognition using ultra-dense sensing." The Bridge, National Academy of Engineering 35, 4 (2005).

[12]

Ren, X. Egocentric recognition of handled objects: Benchmark and analysis. 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, (2009), 1--8.

[13]

Tapia, E.M., Intille, S.S., and Larson, K. Activity Recognition in the Home Using Simple and Ubiquitous Sensors. Springer Berlin Heidelberg, (2004), 158--175.

[14]

Ward, J. a, Lukowicz, P., Tröster, G., and Starner, T.E. Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 10 (2006), 1553--1567.

Digital Library

[15]

Weiser, M. The Computer for the Twenty-First Century. Scientific American 265, 3 (1991), 94--104.

Cited By

Nolan JQian KZhang X(2024)KeyStubProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314427:4(1-23)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631442
Wang LShi ZZhao YJing N(2024)AirLock: Unlock in-air via hand rotation recognitionExpert Systems with Applications10.1016/j.eswa.2024.124330(124330)Online publication date: May-2024
https://doi.org/10.1016/j.eswa.2024.124330
Wang GHan LChang YShi YQian CZhao CDing HXi WZhao CZhao J(2023)Cross-technology Communication between Visible Light and Battery-free RFIDsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108837:3(1-20)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610883
Show More Cited By

Index Terms

IDSense: A Human Object Interaction Detection System Based on Passive UHF RFID
1. Human-centered computing

Recommendations

RIO: A Pervasive RFID-based Touch Gesture Interface
MobiCom '17: Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking

In this paper, we design and develop RIO, a novel battery-free touch sensing user interface (UI) primitive for future IoT and smart spaces. RIO enables UIs to be constructed using off-the-shelf RFID readers and tags, and provides a unique approach to ...
Read More
Recognizing daily activities with RFID-based sensors
UbiComp '09: Proceedings of the 11th international conference on Ubiquitous computing

We explore a dense sensing approach that uses RFID sensor network technology to recognize human activities. In our setting, everyday objects are instrumented with UHF RFID tags called WISPs that are equipped with accelerometers. RFID readers detect when ...
Read More
Frictional widgets: enhancing touch interfaces with programmable friction
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

Touch interactions occur through flat surfaces that lack the tactile richness of physical interfaces. We explore the design possibilities offered by augmenting touchscreens with programmable surface friction. Four exemplar applications -- an alarm clock,...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

April 2015

4290 pages

ISBN:9781450331456

DOI:10.1145/2702123

General Chairs:
Bo Begole
Huawei, USA
,
Jinwoo Kim
Yonsei University, Korea
,
Program Chairs:
Kori Inkpen
Microsoft Research, USA
,
Woontack Woo
KAIST, Korea

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Disney Research Pittsburgh

Conference

CHI '15

Sponsor:

SIGCHI

CHI '15: CHI Conference on Human Factors in Computing Systems

April 18 - 23, 2015

Seoul, Republic of Korea

Acceptance Rates

CHI '15 Paper Acceptance Rate 486 of 2,120 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI PLAY '24

Sponsor:
sigchi

The Annual Symposium on Computer-Human Interaction in Play

October 14 - 17, 2024

Tampere , Finland

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

127
Total Citations
View Citations
1,261
Total Downloads

Downloads (Last 12 months)81
Downloads (Last 6 weeks)2

Other Metrics

View Author Metrics

Citations

Cited By

Nolan JQian KZhang X(2024)KeyStubProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314427:4(1-23)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631442
Wang LShi ZZhao YJing N(2024)AirLock: Unlock in-air via hand rotation recognitionExpert Systems with Applications10.1016/j.eswa.2024.124330(124330)Online publication date: May-2024
https://doi.org/10.1016/j.eswa.2024.124330
Wang GHan LChang YShi YQian CZhao CDing HXi WZhao CZhao J(2023)Cross-technology Communication between Visible Light and Battery-free RFIDsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108837:3(1-20)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610883
Yang XSayono JZhang Y(2023)CubeSense++: Smart Environment Sensing with Interaction-Powered Corner Reflector MechanismsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606744(1-12)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606744
Gupta APark DBashar SGirerd CBhat NMundhra SMorimoto TBharadia D(2023)ForceStickerProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35807937:1(1-32)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580793
Huang XMiller KSample ABanovic N(2023)StructureSenseProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35703436:4(1-25)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3570343
Waghmare ABen Taleb YChatterjee INarendra APatel S(2023)Z-Ring: Single-Point Bio-Impedance Sensing for Gesture, Touch, Object and User RecognitionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581422(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581422
Iravantchi YZhao YKin KSample A(2023)SAWSense: Using Surface Acoustic Waves for Surface-bound Event RecognitionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580991(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580991
Williams KHammer JHudson S(2023)The IoT Codex: A Book of Programmable Stickers for Authoring and Composing Embedded Computing Applications2023 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VL-HCC57772.2023.00009(1-11)Online publication date: 3-Oct-2023
https://doi.org/10.1109/VL-HCC57772.2023.00009
Moghaddam MShirehjini AShirmohammadi S(2023)A WiFi-Based Method for Recognizing Fine-Grained Multiple-Subject Human ActivitiesIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2023.328954772(1-13)Online publication date: 2023
https://doi.org/10.1109/TIM.2023.3289547
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents