research-article

On the tip of my tongue: a non-invasive pressure-based tongue interface

Authors:

Jingyuan Cheng,

Albrecht Schmidt,

Koichi KiseAuthors Info & Claims

AH '14: Proceedings of the 5th Augmented Human International Conference

Article No.: 12, Pages 1 - 4

https://doi.org/10.1145/2582051.2582063

Published: 07 March 2014 Publication History

Abstract

Mobile and wearable devices became pervasive in daily life. The dominant input techniques for mobile and wearable technology are touch and speech. Both approaches are not appropriate in all settings. Therefore, we propose a novel interface that is controlled through the tongue. It is based on an array of textile pressure sensors attached to the user's cheek. It can be easily integrated into helmets or face masks in a non-invasive way. In an initial study, we investigate gestures for tongue-based interface. Six participants repeatedly performed five simple tongue gestures. We show that gestures can be recognized with 98% accuracy. Based on feedback from participants, we discuss potential use cases and provide an outlook on further improvement of the system.

References

[1]

Cheng, J., Lukowicz, P., Henze, N., Schmidt, A., Amft, O., Salvatore, G. A., and Troster, G. Smart textiles: From niche to mainstream. Pervasive Computing (2013).

Digital Library

[2]

Coren, S., Ward, L. M., and Enns, J. T. Sensation and perception. John Wiley & Sons, 2004.

[3]

Kunze, K., Wagner, F., Kartal, E., Kluge, E. M., and Lukowicz, P. Does context matter?-a quantitative evaluation in a real world maintenance scenario. In Pervasive Computing. 2009.

Digital Library

[4]

Liu, L., Niu, S., Ren, J., and Zhang, J. Tongible: a non-contact tongue-based interaction technique. In Conference on Computers and accessibility (2012).

Digital Library

[5]

Lund, M. E., Christiensen, H. V., Caltenco, H. A., Lontis, E. R., Bentsen, B., and Andreasen Struijk, L. Inductive tongue control of powered wheelchairs. In Conference on Engineering in Medicine and Biology (2010).

[6]

Monczak, L., Shapiro, D., Borisenko, A., Draghici, O., and Bolic, M. Characterization of piezoelectric film sensors for tongue-computer interface. In Workshop on Medical Measurements and Applications (2011).

[7]

Park, H., Gosselin, B., Kiani, M., Lee, H.-M., Kim, J., Huo, X., and Ghovanloo, M. A wireless magnetoresistive sensing system for an intra-oral tongue-computer interface. In Conference on Solid-State Circuits (2012).

[8]

Saponas, T. S., Kelly, D., Parviz, B. A., and Tan, D. S. Optically sensing tongue gestures for computer input. In Symposium on User interface software and technology (2009).

Digital Library

[9]

Shneiderman, B. The limits of speech recognition. Communications ACM (2000).

Digital Library

[10]

Starner, T. E. The role of speech input in wearable computing. Pervasive Computing (2002).

Digital Library

[11]

Struijk, L. N. A. An inductive tongue computer interface for control of computers and assistive devices. Transactions on Biomedical Engineering (2006).

[12]

Tang, H., and Beebe, D. J. An ultra-flexible electrotactile display for the roof mouth. In Conference on Engineering in Medicine and Biology and Meeting Biomedical Engineering Soc. (1999).

[13]

Vuillerme, N., Pinsault, N., Chenu, O., Fleury, A., Payan, Y., and Demongeot, J. A wireless embedded tongue tactile biofeedback system for balance control. Pervasive and Mobile Computing (2009).

Digital Library

[14]

Wang, Y. K., Nash, M. P., Pullan, A. J., Kieser, J. A., and Röhrle, O. Model-based identification of motion sensor placement for tracking retraction and elongation tongue. Biomechanics and modeling in mechanobiology (2013).

[15]

Witt, H., Nicolai, T., and Kenn, H. Designing a wearable user interface for hands-free interaction in maintenance applications. In Conference on Pervasive Computing and Communications (2006).

Digital Library

[16]

Yousefi, B., Huo, X., Veledar, E., and Ghovanloo, M. Quantitative and comparative assessment of learning in a tongue-operated computer input device. Transactions on Information Technology in Biomedicine (2011).

Digital Library

[17]

Zhou, B., Cheng, J., Sundholm, M., and Lukowicz, P. From smart clothing to smart table cloth: Design and implementation of a large scale, textile pressure matrix sensor. In Conference on Architecture of Computing Systems (2014).

Digital Library

Cited By

Tomaru STakaki KMurakami HKim DNarumi KKamezaki MKawahara Y(2024)Micro-Gesture Recognition of Tongue via Bone Conduction SoundAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686336(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686336
Wong DChou P(2023)TongueMendous: IR-Based Tongue-Gesture Interface with Tiny Machine LearningProceedings of the 8th international Workshop on Sensor-Based Activity Recognition and Artificial Intelligence10.1145/3615834.3615843(1-8)Online publication date: 21-Sep-2023
https://dl.acm.org/doi/10.1145/3615834.3615843
Gemicioglu TWinters RWang YGable TTashev I(2023)TongueTap: Multimodal Tongue Gesture Recognition with Head-Worn DevicesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614120(564-573)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614120
Show More Cited By

Index Terms

On the tip of my tongue: a non-invasive pressure-based tongue interface
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Signal processing systems
2. Human-centered computing

Recommendations

TongueTap: Multimodal Tongue Gesture Recognition with Head-Worn Devices
ICMI '23: Proceedings of the 25th International Conference on Multimodal Interaction

Mouth-based interfaces are a promising new approach enabling silent, hands-free and eyes-free interaction with wearable devices. However, interfaces sensing mouth movements are traditionally custom-designed and placed near or within the mouth. TongueTap ...
Tongue Gestures for Hands-Free Interaction in Head Worn Displays
UbiComp/ISWC '22 Adjunct: Adjunct Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2022 ACM International Symposium on Wearable Computers

Head worn displays are often used in situations where users’ hands may be occupied or otherwise unusable due to permanent or situational movement impairments. Hands-free interaction methods like voice recognition and gaze tracking allow accessible ...
Gaze & Tongue: A Subtle, Hands-Free Interaction for Head-Worn Devices
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

Gaze tracking allows hands-free and voice-free interaction with computers, and has gained more use recently in virtual and augmented reality headsets. However, it traditionally uses dwell time for selection tasks, which suffers from the Midas Touch ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AH '14: Proceedings of the 5th Augmented Human International Conference

March 2014

249 pages

ISBN:9781450327619

DOI:10.1145/2582051

General Chair:
Tsutomu Terada
Kobe University, Japan
,
Program Chairs:
Masahiko Inami
Keio University, Japan
,
Kai Kunze
Osaka Prefecture University, Japan
,
Takuya Nojima
University of Electro-communications, Japan

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

MEET IN KOBE 21st Century: MEET IN KOBE 21st Century

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Seventh Framework Programme

Conference

AH '14

Sponsor:

MEET IN KOBE 21st Century

AH '14: 5th Augmented Human International Conference

March 7 - 8, 2014

Kobe, Japan

Acceptance Rates

Overall Acceptance Rate 121 of 306 submissions, 40%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
457
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)1

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Tomaru STakaki KMurakami HKim DNarumi KKamezaki MKawahara Y(2024)Micro-Gesture Recognition of Tongue via Bone Conduction SoundAdjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3672539.3686336(1-3)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3672539.3686336
Wong DChou P(2023)TongueMendous: IR-Based Tongue-Gesture Interface with Tiny Machine LearningProceedings of the 8th international Workshop on Sensor-Based Activity Recognition and Artificial Intelligence10.1145/3615834.3615843(1-8)Online publication date: 21-Sep-2023
https://dl.acm.org/doi/10.1145/3615834.3615843
Gemicioglu TWinters RWang YGable TTashev I(2023)TongueTap: Multimodal Tongue Gesture Recognition with Head-Worn DevicesProceedings of the 25th International Conference on Multimodal Interaction10.1145/3577190.3614120(564-573)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3577190.3614120
Jingu ATanaka YLopes P(2023)LipIO: Enabling Lips as both Input and Output SurfaceProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580775(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580775
Shen XYan YYu CShi Y(2022)ClenchClickProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35503276:3(1-26)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3550327
Sarsenbayeva ZVan Berkel NVelloso EGoncalves JKostakos V(2022)Methodological Standards in Accessibility Research on Motor Impairments: A SurveyACM Computing Surveys10.1145/354350955:7(1-35)Online publication date: 15-Dec-2022
https://dl.acm.org/doi/10.1145/3543509
Davanzo NAvanzini F(2021)Resin: a Vocal Tract Resonances and Head Based Accessible Digital Musical InstrumentProceedings of the 16th International Audio Mostly Conference10.1145/3478384.3478403(280-283)Online publication date: 1-Sep-2021
https://dl.acm.org/doi/10.1145/3478384.3478403
Chen VXu XLi RShi YPatel SWang Y(2021)Understanding the Design Space of Mouth MicrogesturesProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462004(1068-1081)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462004
Prakash JYang ZWei YHassanieh HChoudhury R(2020)EarSenseProceedings of the 26th Annual International Conference on Mobile Computing and Networking10.1145/3372224.3419197(1-13)Online publication date: 16-Apr-2020
https://dl.acm.org/doi/10.1145/3372224.3419197
Masai KKunze KSakamoto DSugiura YSugimoto M(2020)Face Commands - User-Defined Facial Gestures for Smart Glasses2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR50242.2020.00064(374-386)Online publication date: Nov-2020
https://doi.org/10.1109/ISMAR50242.2020.00064
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents