research-article

UbiquiTouch: Self Sustaining Ubiquitous Touch Interfaces

Authors:

Anandghan Waghmare,

Dingtian Zhang,

Nivedita Arora,

Gregory D AbowdAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 4, Issue 1

Article No.: 27, Pages 1 - 22

https://doi.org/10.1145/3380989

Published: 18 March 2020 Publication History

Abstract

We present UbiquiTouch, an ultra low power wireless touch interface. With an average power consumption of 30.91μW, UbiquiTouch can run on energy harvested from ambient light. It achieves this performance through low power touch sensing and passive communication to a nearby smartphone using ambient FM backscatter. This approach allows UbiquiTouch to be deployed in mobile situations both in indoor and outdoor locations, without the need for any additional infrastructure for operation. To demonstrate the potential of this technology, we evaluate it in several different and realistic scenarios. Finally, we address the future application space for this technology.

Supplementary Material

waghmare (waghmare.zip)

Supplemental movie, appendix, image and software files for, UbiquiTouch: Self Sustaining Ubiquitous Touch Interfaces

Download
286.11 MB

References

[1]

Thomas Augsten, Konstantin Kaefer, René Meusel, Caroline Fetzer, Dorian Kanitz, Thomas Stoff, Torsten Becker, Christian Holz, and Patrick Baudisch. 2010. Multitoe: high-precision interaction with back-projected floors based on high-resolution multi-touch input. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 209--218.

Digital Library

[2]

Dinesh Bharadia, Kiran Raj Joshi, Manikanta Kotaru, and Sachin Katti. 2015. Backfi: High throughput wifi backscatter. ACM SIGCOMM Computer Communication Review 45, 4 (2015), 283--296.

Digital Library

[3]

Alex Butler, Shahram Izadi, and Steve Hodges. 2008. SideSight: multi-touch interaction around small devices. In Proceedings of the 21st annual ACM symposium on User interface software and technology. ACM, 201--204.

Digital Library

[4]

Gabe Cohn, Erich Stuntebeck, Jagdish Pandey, Brian Otis, Gregory D Abowd, and Shwetak N Patel. 2010. SNUPI: sensor nodes utilizing powerline infrastructure. In Proceedings of the 12th ACM international conference on Ubiquitous computing. ACM, 159--168.

Digital Library

[5]

Analog Devices. 2017. ADG901/ADG902. Retrieved April 1, 2019 from https://www.analog.com/media/en/technical-documentation/data-sheets/ADG901_902.pdf

[6]

Geddes LA. Fish RM. 2009. Conduction of electrical current to and through the human body: a review. Eplasty (2009).

[7]

Chuhan Gao, Yilong Li, and Xinyu Zhang. 2018. LiveTag: Sensing Human-Object Interaction through Passive Chipless WiFi Tags. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI 18). USENIX Association, Renton, WA, 533--546. https://www.usenix.org/conference/nsdi18/presentation/gao

[8]

April Gaser. 2016. YOUR PHONE HAS AN FM CHIP. SO WHY CAN'T YOU LISTEN TO THE RADIO? Retrieved April 1, 2019 from https://www.wired.com/2016/07/phones-fm-chips-radio-smartphone/

[9]

Google. 2016. JACQUARD by Google. Retrieved April 1, 2019 from https://atap.google.com/jacquard/

[10]

Martin A Green, Yoshihiro Hishikawa, Ewan D Dunlop, Dean H Levi, Jochen Hohl-Ebinger, and Anita WY Ho-Baillie. 2018. Solar cell efficiency tables (version 52). Progress in Photovoltaics 26, 7 (2018).

[11]

Tobias Grosse-Puppendahl, Sebastian Herber, Raphael Wimmer, Frank Englert, Sebastian Beck, Julian von Wilmsdorff, Reiner Wichert, and Arjan Kuijper. 2014. Capacitive near-field communication for ubiquitous interaction and perception. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 231--242.

Digital Library

[12]

Chris Harrison and Scott E Hudson. 2008. Scratch input: creating large, inexpensive, unpowered and mobile finger input surfaces. In Proceedings of the 21st annual ACM symposium on User interface software and technology. ACM, 205--208.

Digital Library

[13]

David Holman, Nicholas Fellion, and Roel Vertegaal. 2014. Sensing touch using resistive graphs. In Proceedings of the 2014 conference on Designing interactive systems. ACM, 195--198.

Digital Library

[14]

Texas Instruments. 2015. TLV3691. Retrieved April 1, 2019 from http://www.ti.com/lit/ds/symlink/tlv3691.pdf

[15]

Behailu Kibret, Assefa Teshome, and Daniel Lai. 2014. Human body as antenna and its effect on human body communications. Progress In Electromagnetics Research 148 (08 2014), 193--207. https://doi.org/10.2528/PIER14061207

[16]

Sunkook Kim, Hyuk-Jun Kwon, Sunghun Lee, Hongshik Shim, Youngtea Chun, Woong Choi, Jinho Kwack, Dongwon Han, MyoungSeop Song, Sungchul Kim, et al. 2011. Low Power Flexible Organic Light-Emitting Diode Display Device. Advanced Materials 23, 31 (2011), 3511--3516.

[17]

Gierad Laput, Karan Ahuja, Mayank Goel, and Chris Harrison. 2018. Ubicoustics: Plug-and-Play Acoustic Activity Recognition. In The 31st Annual ACM Symposium on User Interface Software and Technology. ACM, 213--224.

Digital Library

[18]

Gierad Laput, Eric Brockmeyer, Scott E Hudson, and Chris Harrison. 2015. Acoustruments: Passive, acoustically-driven, interactive controls for handheld devices. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2161--2170.

Digital Library

[19]

Hanchuan Li, Eric Brockmeyer, Elizabeth J Carter, Josh Fromm, Scott E Hudson, Shwetak N Patel, and Alanson Sample. 2016. PaperID: A technique for drawing functional battery-free wireless interfaces on paper. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5885--5896.

Digital Library

[20]

Hanchuan Li, Can Ye, and Alanson P Sample. 2015. IDSense: A human object interaction detection system based on passive UHF RFID. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2555--2564.

Digital Library

[21]

Vincent Liu, Aaron Parks, Vamsi Talla, Shyamnath Gollakota, David Wetherall, and Joshua R Smith. 2013. Ambient backscatter: wireless communication out of thin air. In ACM SIGCOMM Computer Communication Review, Vol. 43. ACM, 39--50.

Digital Library

[22]

Elke Mackensen, Matthias Lai, and Thomas M Wendt. 2012. Bluetooth Low Energy (BLE) based wireless sensors. In SENSORS, 2012 IEEE. IEEE, 1--4.

[23]

Gaurav Mathur, Peter Desnoyers, Paul Chukiu, Deepak Ganesan, and Prashant Shenoy. 2009. Ultra-low power data storage for sensor networks. ACM Transactions on Sensor Networks (TOSN) 5, 4 (2009), 33.

Digital Library

[24]

Nobuyuki Matsushita and Jun Rekimoto. 1997. HoloWall: designing a finger, hand, body, and object sensitive wall. In Proceedings of the 10th annual ACM symposium on User interface software and technology. ACM, 209--210.

Digital Library

[25]

Philipp Mayer, Raphael Strebel, and Michele Magno. 2019. ZeroPowerTouch: Zero-Power Smart Receiver for Touch Communication and Sensing in Wearable Applications. In 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE). IEEE, 944--947.

[26]

Saman Naderiparizi, Mehrdad Hessar, Vamsi Talla, Shyamnath Gollakota, and Joshua R Smith. 2018. Towards battery-free {HD} video streaming. In 15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18). 233--247.

[27]

Nexperia. 2016. 74HC597 8-bit shift register. Retrieved April 1, 2019 from https://assets.nexperia.com/documents/data-sheet/74HC_HCT597.pdf

[28]

Alex Olwal, Jon Moeller, Greg Priest-Dorman, Thad Starner, and Ben Carroll. 2018. I/O Braid: Scalable Touch-Sensitive Lighted Cords Using Spiraling, Repeating Sensing Textiles and Fiber Optics. In The 31st Annual ACM Symposium on User Interface Software and Technology. ACM, 485--497.

[29]

Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2013. Touch & activate: adding interactivity to existing objects using active acoustic sensing. In Proceedings of the 26th annual ACM symposium on User interface software and technology. ACM, 31--40.

Digital Library

[30]

Aaron N Parks, Angli Liu, Shyamnath Gollakota, and Joshua R Smith. 2014. Turbocharging ambient backscatter communication. In ACM SIGCOMM Computer Communication Review, Vol. 44. ACM, 619--630.

Digital Library

[31]

Massoud Pedram and Jan M Rabaey. 2002. Power aware design methodologies. Springer Science & Business Media.

[32]

DT Pham, Z Ji, O Peyroutet, M Yang, Z Wang, and M Al-Kutubi. 2006. Localisation of impacts on solid objects using the Wavelet Transform and Maximum Likelihood Estimation. In Intelligent Production Machines and Systems. Elsevier, 541--547.

[33]

Ivan Poupyrev, Chris Harrison, and Munehiko Sato. 2012. Touché: touch and gesture sensing for the real world. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing. ACM, 536--536.

Digital Library

[34]

Swadhin Pradhan, Eugene Chai, Karthikeyan Sundaresan, Lili Qiu, Mohammad A Khojastepour, and Sampath Rangarajan. 2017. Rio: A pervasive rfid-based touch gesture interface. In Proceedings of the 23rd Annual International Conference on Mobile Computing and Networking. ACM, 261--274.

Digital Library

[35]

Vaishnavi Ranganathan, Sidhant Gupta, Jonathan Lester, Joshua R Smith, and Desney Tan. 2018. RF Bandaid: A Fully-Analog and Passive Wireless Interface for Wearable Sensors. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 2 (2018), 79.

Digital Library

[36]

Alanson P Sample, Daniel J Yeager, Pauline S Powledge, Alexander V Mamishev, Joshua R Smith, et al. 2008. Design of an RFID-based battery-free programmable sensing platform. IEEE transactions on instrumentation and measurement 57, 11 (2008), 2608.

[37]

Valkyrie Savage, Xiaohan Zhang, and Björn Hartmann. 2012. Midas: fabricating custom capacitive touch sensors to prototype interactive objects. In Proceedings of the 25th annual ACM symposium on User interface software and technology. ACM, 579--588.

Digital Library

[38]

Illuminating Engineering Society. 2011. IES Handbook. Retrieved Janurary 25, 2020 from https://www.ies.org/product/the-lighting-handbook-10th-edition

[39]

Custom Silicon Solutions. 2009. CSS555 Timer. Retrieved April 1, 2019 from http://www.customsiliconsolutions.com/downloads/Revised%20Standard%20products/CSS555_Spec.pdf

[40]

Andrew Spielberg, Alanson Sample, Scott E Hudson, Jennifer Mankoff, and James McCann. 2016. RapID: A framework for fabricating low-latency interactive objects with RFID tags. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 5897--5908.

Digital Library

[41]

Thad Starner. 2001. The challenges of wearable computing: Part 1. Ieee Micro 21, 4 (2001), 44--52.

Digital Library

[42]

Raphael Strebel and Michele Magno. 2018. Zero-power receiver for touch communication and touch sensing. In 2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). IEEE, 150--151.

[43]

Vamsi Talla, Bryce Kellogg, Shyamnath Gollakota, and Joshua R Smith. 2017. Battery-Free Cellphone. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 2 (2017), 25.

Digital Library

[44]

Anran Wang, Vikram Iyer, Vamsi Talla, Joshua R Smith, and Shyamnath Gollakota. 2017. FM Backscatter: Enabling Connected Cities and Smart Fabrics. In 14th USENIX Symposium on Networked Systems Design and Implementation NSDI 17. 243--258.

[45]

Yuntao Wang, Jianyu Zhou, Hanchuan Li, Tengxiang Zhang, Minxuan Gao, Zhuolin Cheng, Chun Yu, Shwetak Patel, and Yuanchun Shi. 2019. FlexTouch: Enabling Large-Scale Interaction Sensing Beyond Touchscreens Using Flexible and Conductive Materials. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 109 (Sept. 2019), 20 pages. https://doi.org/10.1145/3351267

Digital Library

[46]

Mark Weiser. 1991. The Computer for the 21st Century. Scientific American 265, 3 (1991), 94--105.

Digital Library

[47]

Raphael Wimmer. 2010. FlyEye: grasp-sensitive surfaces using optical fiber. In Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction. ACM, 245--248.

Digital Library

[48]

Raphael Wimmer and Patrick Baudisch. 2011. Modular and deformable touch-sensitive surfaces based on time domain reflectometry. In Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, 517--526.

Digital Library

[49]

Daniel J Yeager, Alanson P Sample, Joshua R Smith, and Joshua R Smith. 2008. Wisp: A passively powered uhf rfid tag with sensing and computation. RFID handbook: Applications, technology, security, and privacy (2008), 261--278.

[50]

Pengyu Zhang, Dinesh Bharadia, Kiran Joshi, and Sachin Katti. 2016. Hitchhike: Practical backscatter using commodity wifi. In Proceedings of the 14th ACM Conference on Embedded Network Sensor Systems CD-ROM. ACM, 259--271.

Digital Library

[51]

Yang Zhang and Chris Harrison. 2018. Pulp Nonfiction: Low-Cost Touch Tracking for Paper. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 117.

Digital Library

[52]

Yang Zhang, Gierad Laput, and Chris Harrison. 2017. Electrick: Low-cost touch sensing using electric field tomography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 1--14.

Digital Library

[53]

Yang Zhang, Chouchang Jack Yang, Scott E Hudson, Chris Harrison, and Alanson Sample. 2018. Wall++: Room-Scale Interactive and Context-Aware Sensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 273.

Digital Library

Cited By

Waghmare AChatterjee IIyer VPatel S(2024)WatchLink: Enhancing Smartwatches with Sensor Add-Ons via ECG InterfaceProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676329(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676329
Reddy CGulati MVarshney A(2023)Beyond BroadcastingProceedings of the 11th International Workshop on Energy Harvesting & Energy-Neutral Sensing Systems10.1145/3628353.3628546(30-36)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3628353.3628546
Mamish JGuo ACohen TRichey JZhang YHester J(2023)Interaction HarvestingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108807:3(1-31)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610880
Show More Cited By

Index Terms

UbiquiTouch: Self Sustaining Ubiquitous Touch Interfaces
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
  2. Ubiquitous and mobile computing

Recommendations

A study on touch & hover based interaction for zooming
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

Proximity is a useful medium for interaction with high interactive digital contents. It can be used in different contexts such as for navigation through depth in 3D space in zoomable interfaces. In this paper, we propose hover-based zoom interaction as ...
Energy Scavenging for Mobile and Wireless Electronics

Different techniques exist for harvesting power to augment or replace batteries in mobile and low-power electronics. From historical inventions to current research, energy harvesting has grown from long-established concepts into devices aimed at ...
Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices
CHI '09: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Zooming user interfaces are increasingly popular on mobile devices with touch screens. Swiping and pinching finger gestures anywhere on the screen manipulate the displayed portion of a page, and taps open objects within the page. This makes navigation ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 4, Issue 1

March 2020

1006 pages

EISSN:2474-9567

DOI:10.1145/3388993

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 March 2020

Published in IMWUT Volume 4, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
1,023
Total Downloads

Downloads (Last 12 months)102
Downloads (Last 6 weeks)16

Reflects downloads up to 10 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Waghmare AChatterjee IIyer VPatel S(2024)WatchLink: Enhancing Smartwatches with Sensor Add-Ons via ECG InterfaceProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676329(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676329
Reddy CGulati MVarshney A(2023)Beyond BroadcastingProceedings of the 11th International Workshop on Energy Harvesting & Energy-Neutral Sensing Systems10.1145/3628353.3628546(30-36)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3628353.3628546
Mamish JGuo ACohen TRichey JZhang YHester J(2023)Interaction HarvestingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108807:3(1-31)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610880
Waghmare ABen Taleb YChatterjee INarendra APatel S(2023)Z-Ring: Single-Point Bio-Impedance Sensing for Gesture, Touch, Object and User RecognitionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581422(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581422
Song KPaulos E(2023)Vim: Customizable, Decomposable Electrical Energy StorageProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581110(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581110
Nakagawa YMaeda TUchiyama AHigashino T(2022)BAAS: Backscatter as a Sensor for Ultra-Low-Power Context RecognitionJournal of Information Processing10.2197/ipsjjip.30.13030(130-139)Online publication date: 2022
https://doi.org/10.2197/ipsjjip.30.130
Yang XSayono JXu JLi JHester JZhang Y(2022)MiniKersProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35502876:3(1-22)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550287
Parilusyan BTeyssier MMartinez-Missir VDuhart CSerrano M(2022)SensurfacesProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35346166:2(1-19)Online publication date: 7-Jul-2022
https://dl.acm.org/doi/10.1145/3534616
Li FLiu MZhang YCarrington P(2022)Freedom to Choose: Understanding Input Modality Preferences of People with Upper-body Motor Impairments for Activities of Daily LivingProceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3544814(1-16)Online publication date: 23-Oct-2022
https://dl.acm.org/doi/10.1145/3517428.3544814
Takahashi RYukita WYokota TSomeya TKawahara Y(2022)Meander Coil++: A Body-scale Wireless Power Transmission Using Safe-to-body and Energy-efficient Transmitter CoilProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502119(1-12)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502119
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents