research-article

The sound of touch: on-body touch and gesture sensing based on transdermal ultrasound propagation

Authors:

Adiyan Mujibiya,

Shwetak N. Patel,

Jun RekimotoAuthors Info & Claims

ITS '13: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces

Pages 189 - 198

https://doi.org/10.1145/2512349.2512821

Published: 06 October 2013 Publication History

Abstract

Recent work has shown that the body provides an interesting interaction platform. We propose a novel sensing technique based on transdermal low-frequency ultrasound propagation. This technique enables pressure-aware continuous touch sensing as well as arm-grasping hand gestures on the human body. We describe the phenomena we leverage as well as the system that produces ultrasound signals on one part of the body and measures this signal on another. The measured signal varies according to the measurement location, forming distinctive propagation profiles which are useful to infer on-body touch locations and on-body gestures. We also report on a series of experimental studies with 20 participants that characterize the signal, and show robust touch and gesture classification along the forearm.

References

[1]

Cui, J., Wei, Y., & Wang, H. The Study of Low-frequency Ultrasound to Enhance Transdermal Drug Delivery. Complex Medical Engineering, 2007, 1221--1224.

[2]

Cohn, G., Morris, D., Patel, S. N., & Tan, D. S. Humantenna: Using the Body as an Antenna for Real-Time Whole Body Interaction. CHI '12, 1901--10.

Digital Library

[3]

Cohn, G., Morris, D., Patel, S. N., & Tan, D. S. Your Noise is My Command: Sensing Gestures Using the Body as an Antenna. CHI '11, 791--800.

Digital Library

[4]

Ghomi, E., Faure, G., Huot, S., Chapuis, O., and Beaudouin-Lafon, M. Using Rhythmic Patterns as an Input Method. CHI '12, 1253--1262.

Digital Library

[5]

Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, I. H. The Weka Data Mining Software: an Update. SIGKDD Explor. Newsl. 11, 1 (Nov. 2009), 10--18.

Digital Library

[6]

Harrison, C., Tan, D. S., & Morris, D. Skinput: Appropriating the Body as an Input Surface. CHI '10, 453--462.

Digital Library

[7]

Lin, S.-Y., Su, C.-H., Cheng, K.-Y., Liang, R.-H., Kuo, T.-H., and Chen, B.-Y. PUB - Point Upon Body: Exploring Eyes-Free Interaction and Methods on an Arm. UIST '11, 481--488.

Digital Library

[8]

Liang, R.-H., Lin, S.-Y., Su, C.-H., Cheng, K.-Y., Chen, B.-Y., and Yang, D.-N. 201 SonarWatch: appropriating the forearm as a slider bar. In SIGGRAPH Asia 2011 Emerging Technologies (SA '11). Article 5, 1 page.

Digital Library

[9]

Lord Rayleigh. On Waves Propagated along the Plane Surface of an Elastic Solid. Proc. London Math. Soc. s1--17 (1)(1885), 4--11.

[10]

Mitragotri, S., Blankschtein, D., and Langer, R. Transdermal Drug Delivery Using Low-frequency Sonophoresis. Pharmaceutical Research 13 (1996), 411--420.

[11]

Mitragotri, S., Farrell, J., Tang, H., Terahara, T., Kost, J., and Langer, R. Determination of Threshold Energy Dose for Ultrasound-induced Transdermal Drug Transport. Controlled Release 63, 1--2 (2000), 41--52.

[12]

Ogura, I., Kidikoro, T., Iinuma, K., Takehara, Y., Tanaka, K., and Matsuda, A. Measurement of Acoustic Impedance of Skin. Ultrasound in Medicine 4, RC 78.7, U4 A 5a (1978), 535.

[13]

Saponas, T. S., Tan, D. S., Morris, D., Balakrishnan, R., Turner, J., and Landay, J. A. Enabling Always-available Input with Muscle-Computer Interfaces. UIST '09, 167--176.

Digital Library

[14]

Sato, M., Poupyrev, I., Harrison, C. Touché: Enhancing Touch Interaction on Humans, Screens, Liquids, and Everyday Objects. CHI '12, 483--492.

Digital Library

[15]

Non-Ionizing Radiation Section Bureau of Radiation and Medical Devices Department of National Health and Welfare. Guidelines for the safe use of ultrasound: Part II - Industrial and Commercial applications. Available online at: http://www.hc-sc.gc.ca/ewh-semt/pubs/radiation/safety-code_24-securite/index_e.html. Accessed at April 5th, 2013.

[16]

Shung, K. K., Thieme, G. A., and Dunn, F. Ultrasonic Scattering in Biological Tissues. Journal of the Acoustical Society of America 94 (1993), 3033.

[17]

Suchkova, V., Siddiqi, F. N., Carstensen, E. L., Dalecki, D., Child, S., & Francis, C. W. Enhancement of Fibrinolysis with 40-khz Ultrasound. Circulation 98, 10, 1030--1035.

[18]

Takemura, K., Ito, A., Takamatsu, J., and Ogasawara, T. Active bone-conducted sound sensing for wearable in-terfaces. UIST '11 Posters. 53--54.

Digital Library

[19]

Terahara, T., Mitragotri, S., Kost, J., and Langer, R. Dependence of Low-frequency Sonophoresis on Ultra-sound Parameters; Distance of the Horn and Intensity. International Journal of Pharmaceutics 235, 1--2 (2002), 35--42.

[20]

Wells, P. Physics of ultrasound. Ultrasonic Exposimetry. Ziskin, M. and Lewin, P., eds). 35.

[21]

Zimmerman, T. G. Personal Area Networks: Near-Field Intrabody Communication. IBM Systems Journal 35, 3.4, 609--617.

Digital Library

[22]

Zimmerman, T. G., Smith, J. R., Paradiso, J. A., Allport, D., and Gershenfeld, N. Applying Electric Field Sensing to Human-Computer Interfaces. CHI '95, 280--287.

Digital Library

Cited By

Konishi TChoi MShizuki B(2024)Active Acoustic Sensing Based Authentication System Using a Door HandleProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701587(324-330)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701587
Darbar RHu XYan XWei YLiang HXu WSarcar S(2024)OnArmQWERTY: An Empirical Evaluation of On-Arm Tap Typing for AR HMDsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682084(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682084
Kim DWhitmire EBoldu RKienzle WBenko HKostakos VKay JHoang T(2024)SoundScroll: Robust Finger Slide Detection Using Friction Sound and Wrist-Worn MicrophonesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676614(63-70)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676614
Show More Cited By

Index Terms

The sound of touch: on-body touch and gesture sensing based on transdermal ultrasound propagation
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

Touch & activate: adding interactivity to existing objects using active acoustic sensing
UIST '13: Proceedings of the 26th annual ACM symposium on User interface software and technology

In this paper, we present a novel acoustic touch sensing technique called Touch & Activate. It recognizes a rich context of touches including grasp on existing objects by attaching only a vibration speaker and a piezo-electric microphone paired as a ...
What caused that touch?: expressive interaction with a surface through fiduciary-tagged gloves
ITS '10: ACM International Conference on Interactive Tabletops and Surfaces

The hand has incredible potential as an expressive input device. Yet most touch technologies imprecisely recognize limited hand parts (if at all), usually by inferring the hand part from the touch shapes. We introduce the fiduciary-tagged glove as a ...
The sound of one hand: a wrist-mounted bio-acoustic fingertip gesture interface
CHI EA '02: CHI '02 Extended Abstracts on Human Factors in Computing Systems

Two hundred and fifty years ago the Japanese Zen master Hakuin asked the question, "What is the Sound of the Single Hand?" This koan has long served as an aid to meditation but it also describes our new interaction techinique. We discovered that gentle ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ITS '13: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces

October 2013

514 pages

ISBN:9781450322713

DOI:10.1145/2512349

General Chairs:
Aaron Quigley
University of St. Andrews, UK
,
Giulio Jacucci
HIIT / University of Helsinki, Finland
,
Program Chairs:
Michael Horn
Northwestern University, USA
,
Miguel Nacenta
University of St. Andrews, UK

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 October 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ITS '13

Sponsor:

SIGCHI

ITS '13: The ACM International Conference on Interactive Tabletops and Surfaces

October 6 - 9, 2013

St. Andrews, Scotland, United Kingdom

Acceptance Rates

ITS '13 Paper Acceptance Rate 35 of 121 submissions, 29%;

Overall Acceptance Rate 119 of 418 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

88
Total Citations
View Citations
1,443
Total Downloads

Downloads (Last 12 months)80
Downloads (Last 6 weeks)15

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Konishi TChoi MShizuki B(2024)Active Acoustic Sensing Based Authentication System Using a Door HandleProceedings of the International Conference on Mobile and Ubiquitous Multimedia10.1145/3701571.3701587(324-330)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1145/3701571.3701587
Darbar RHu XYan XWei YLiang HXu WSarcar S(2024)OnArmQWERTY: An Empirical Evaluation of On-Arm Tap Typing for AR HMDsProceedings of the 2024 ACM Symposium on Spatial User Interaction10.1145/3677386.3682084(1-12)Online publication date: 7-Oct-2024
https://dl.acm.org/doi/10.1145/3677386.3682084
Kim DWhitmire EBoldu RKienzle WBenko HKostakos VKay JHoang T(2024)SoundScroll: Robust Finger Slide Detection Using Friction Sound and Wrist-Worn MicrophonesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676614(63-70)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676614
Fujii AMurao KKostakos VKay JHoang T(2024)Water Level Recognition by Analyzing the Sound when Pouring WaterCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3678440(464-469)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3678440
Mollyn VHarrison C(2024)EgoTouch: On-Body Touch Input Using AR/VR Headset CamerasProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676455(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676455
Yang YChen THuang YGuo XShangguan L(2024)MAF: Exploring Mobile Acoustic Field for Hand-to-Face Gesture InteractionsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642437(1-20)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642437
Kawasaki YSugiura Y(2023)Identification and Authentication using Clavicles2023 62nd Annual Conference of the Society of Instrument and Control Engineers (SICE)10.23919/SICE59929.2023.10354211(1141-1145)Online publication date: 6-Sep-2023
https://doi.org/10.23919/SICE59929.2023.10354211
Kim JKim MLee WYoon S(2023)VibAware: Context-Aware Tap and Swipe Gestures Using Bio-Acoustic SensingProceedings of the 2023 ACM Symposium on Spatial User Interaction10.1145/3607822.3614544(1-12)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1145/3607822.3614544
Iwakiri SMurao K(2023)User Authentication Method for Wearable Ring Devices using Active Acoustic SensingProceedings of the 2023 ACM International Symposium on Wearable Computers10.1145/3594738.3611357(17-21)Online publication date: 8-Oct-2023
https://dl.acm.org/doi/10.1145/3594738.3611357
Chen WWang ZQuan PPeng ZLin SSrivastava MMatusik WStankovic J(2023)Robust Finger Interactions with COTS Smartwatches via Unsupervised Siamese AdaptationProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606794(1-14)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606794
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten