TOFI: Designing Intraoral Computer Interfaces for Gamified Myofunctional Therapy
Authors: 
Luke Franzke, Jonas Gartmann, Dominik Bachmann, Tino Töpper, Karmen FraninovićAuthors Info & Claims
Luke Franzke, Jonas Gartmann, Dominik Bachmann, Tino Töpper, Karmen FraninovićAuthors Info & ClaimsArticle No.: 401, Pages 1 - 8
Abstract
In the last two decades, there have been several proposals for Intraoral Computer Interfaces (ICI), with demonstrations of novel technologies mostly aimed at assistive devices or in hand-free scenarios. This paper demonstrates a case study for wearable ICIs that allows users to train their tongue muscles with gamified myofunctional therapy: a method that can reduce snoring and mild sleep apnea. This demonstrates a novel application of ICIs together with new design and technological solutions for fabricating such devices. We also discuss the various challenges associated with the design of ICIs and ICI based interactions to lay the groundwork for future research, prototypes and a broader exploration of ICI application areas.
Supplementary Material
Pre-recorded Video Presentation
- Download
- 206.56 MB
References
[1]
Aiken, C.A. and Becker, K.A. 2022. Utilising an internal focus of attention during preparation and an external focus during execution may facilitate motor learning. European journal of sport science: EJSS: official journal of the European College of Sport Science. (Mar. 2022), 1–8.
[2]
AlGhanim, N., Comondore, V.R., Fleetham, J., Marra, C.A. and Ayas, N.T. 2008. The economic impact of obstructive sleep apnea. Lung. 186, 1 (Jan. 2008), 7–12.
[3]
Bach-y-Rita and Kaczmarek. 2003. A tongue-based tactile display for portrayal of environmental characteristics. Virtual and adaptive environments
[4]
Bach-y-Rita, Kaczmarek and Meier. 1998. The tongue as a man-machine interface: Proceeding of the 1998 international symposium on information theory and its applications.
[5]
Bach-y-Rita, P., Collins, C.C., Saunders, F.A., White, B. and Scadden, L. 1969. Vision substitution by tactile image projection. Nature. 221, 5184 (Mar. 1969), 963–964.
[6]
Bach-y-Rita, P., Kaczmarek, K.A., Tyler, M.E. and Garcia-Lara, J. 1998. Form perception with a 49-point electrotactile stimulus array on the tongue: a technical note. Journal of rehabilitation research and development. 35, 4 (Oct. 1998), 427–430.
[7]
Bach-y-Rita, P. and Tyler, M.E. 2000. Tongue man-machine interface. Studies in health technology and informatics. 70, (2000), 17–19.
[8]
Baltzan, M.A., Elkholi, O. and Wolkove, N. 2009. Evidence of interrelated side effects with reduced compliance in patients treated with nasal continuous positive airway pressure. Sleep medicine. 10, 2 (Feb. 2009), 198–205.
[9]
Borsoi, L., Armeni, P., Donin, G., Costa, F. and Ferini-Strambi, L. 2022. The invisible costs of obstructive sleep apnea (OSA): Systematic review and cost-of-illness analysis. PloS one. 17, 5 (May 2022), e0268677.
[10]
Caltenco, H.A., Breidegard, B. and Struijk, L.N.S.A. 2014. On the tip of the tongue: learning typing and pointing with an intra-oral computer interface. Disability and rehabilitation. Assistive technology. 9, 4 (Jul. 2014), 307–317.
[11]
Canadian Agency for Drugs and Technologies in Health (CADTH) 2010. Oral appliances for treatment of snoring and obstructive sleep apnea: a review of clinical effectiveness. CADTH technology overviews. 1, 1 (Mar. 2010), e0107.
[12]
Cascón, P. 2019. ChewIt: An Intraoral Interface for Discreet Interactions.
[13]
Chacin, A.C. 2012. Play-A-Grill: Music To Your Teeth. NIME.
[14]
Chen, V., Xu, X., Li, R., Shi, Y., Patel, S. and Wang, Y. 2021. Understanding the Design Space of Mouth Microgestures. Designing Interactive Systems Conference 2021 (New York, NY, USA, Jun. 2021), 1068–1081.
[15]
Coleman, J. A. 2003. Pathophisiology of snoring and obstructive sleep apnea. Snoring and obstructive sleep apnea. 3th ed.
[16]
Cooper, A. 1996. Goal-directed Design. InContext Enterprises Incorporated.
[17]
Djajadiningrat, T., Overbeeke, K. and Wensveen, S. 2002. But how, Donald, tell us how? Proceedings of the conference on Designing interactive systems processes, practices, methods, and techniques - DIS ’02.
[18]
de Felício, C.M., da Silva Dias, F.V. and Trawitzki, L.V.V. 2018. Obstructive sleep apnea: focus on myofunctional therapy. Nature and science of sleep. 10, (Sep. 2018), 271–286.
[19]
Feng, Y. and Wang, X. 2019. Ultrasound Tongue Image Classification using Transfer Learning. Proceedings of the 2019 2nd International Conference on Digital Medicine and Image Processing (New York, NY, USA, Nov. 2019), 38–42.
[20]
Georgalas, C. 2011. The role of the nose in snoring and obstructive sleep apnoea: an update. European archives of oto-rhino-laryngology: official journal of the European Federation of Oto-Rhino-Laryngological Societies : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery. 268, 9 (Sep. 2011), 1365–1373.
[21]
Google trends: https://trends.google.com/trends/explore?date=all&q=sleep%20quality. Accessed: 2022-10-12.
[22]
Hori, K., Ono, T., Tamine, K.-I., Kondo, J., Hamanaka, S., Maeda, Y., Dong, J. and Hatsuda, M. 2009. Newly developed sensor sheet for measuring tongue pressure during swallowing. Journal of prosthodontic research. 53, 1 (Jan. 2009), 28–32.
[23]
Huo, X., Park, H. and Ghovanloo, M. 2012. Dual-mode tongue drive system: using speech and tongue motion to improve computer access for people with disabilities. Proceedings of the conference on Wireless Health (New York, NY, USA, Oct. 2012), 1–8.
[24]
Ieto, V., Kayamori, F., Montes, M.I., Hirata, R.P., Gregório, M.G., Alencar, A.M., Drager, L.F., Genta, P.R. and Lorenzi-Filho, G. 2015. Effects of Oropharyngeal Exercises on Snoring: A Randomized Trial. Chest. 148, 3 (Sep. 2015), 683–691.
[25]
Kaczmarek, K.A. 2011. The tongue display unit (TDU) for electrotactile spatiotemporal pattern presentation. Scientia Iranica. Transactions D, Computer science & engineering, electrical engineering. 18, 6 (Dec. 2011), 1476–1485.
[26]
Kencana, A.P. and Heng, J. 2007. Experiment on a novel user input for computer interface utilizing tongue input for severely disabled. Proceedings of the 1st international convention on Rehabilitation engineering & assistive technology: in conjunction with 1st Tan Tock Seng Hospital Neurorehabilitation Meeting (New York, NY, USA, Apr. 2007), 114–117.
[27]
Kielhofner, G., Marotzki, U. and Mentrup, C. 2005. Model of Human Occupation (MOHO): Grundlagen für die Praxis. Springer Berlin Heidelberg.
[28]
Kim, J., Hegland, K., Vann, W., Berry, R. and Davenport, P.W. 2019. Measurement of maximum tongue protrusion force (MTPF) in healthy young adults. Physiological reports. 7, 13 (Jul. 2019), e14175.
[29]
Lauga, E., Pipe, C.J. and Le Révérend, B. 2016. Sensing in the Mouth: A Model for Filiform Papillae as Strain Amplifiers. Frontiers in Physics.
[30]
Lee Electropalatography. Manual of clinical phonetics.
[31]
Li, Z., Robucci, R., Banerjee, N. and Patel, C. 2015. Tongue-n-cheek: non-contact tongue gesture recognition. Proceedings of the 14th International Conference on Information Processing in Sensor Networks (New York, NY, USA, Apr. 2015), 95–105.
[32]
Lontis, E.R., Bentsen, B., Gaihede, M. and Andreasen Struijk, L.N.S. 2016. Sensor Activation for Wheelchair Driving in Confined Spaces with a Tongue Controlled Oral Interface. Proceedings of the international Convention on Rehabilitation Engineering & Assistive Technology (Midview City, SGP, Jul. 2016), 1–4.
[33]
Maeyama, T. and Plattig, K.-H. 1989. Minimal two-point discrimination in human tongue and palate. American Journal of Otolaryngology.
[34]
Maia, A.V., Furlan, R.M.M.M., Moraes, K.O., Amaral, M.S., Medeiros, A.M. de and Motta, A.R. 2019. Tongue strength rehabilitation using biofeedback: a case report. CoDAS. 31, 5 (Oct. 2019), e20180163.
[35]
Miyashita, H. 2020. Norimaki Synthesizer: Taste Display Using Ion Electrophoresis in Five Gels. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems.
[36]
Nam, H.Y. and DiSalvo, C. 2010. Tongue music: the sound of a kiss. CHI ’10 Extended Abstracts on Human Factors in Computing Systems (New York, NY, USA, Apr. 2010), 4805–4808.
[37]
Narumi, T. 2016. Multi-sensorial virtual reality and augmented human food interaction. Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food Interaction.
[38]
Ono, T., Hori, K., Tamine, K.-I. and Maeda, Y. 2009. Evaluation of tongue motor biomechanics during swallowing—From oral feeding models to quantitative sensing methods. The Japanese dental science review. 45, 2 (Sep. 2009), 65–74.
[39]
Gimpel, H., Nissen, M., & Görlitz, R. 2013. Quantifying the Quantified Self: A study on the motivation of patients to track their own health: https://core.ac.uk/download/pdf/301361222.pdf. Accessed: 2022-10-12.
[40]
Ranasinghe, N. and Do, E.Y.-L. 2016. Virtual Sweet. Proceedings of the 29th Annual Symposium on User Interface Software and Technology.
[41]
Ranasinghe, N., Jain, P., Karwita, S. and Do, E.Y.-L. 2017. Virtual Lemonade. Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction.
[42]
Richardson, M.L., Lloyd-Esenkaya, T., Petrini, K. and Proulx, M.J. 2020. Reading with the Tongue: Individual Differences Affect the Perception of Ambiguous Stimuli with the BrainPort. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, Apr. 2020), 1–10.
[43]
Sakurai, S., Aoyama, K., Miyamoto, N., Mizukami, M., Furukawa, M., Maeda, T. and Ando, H. 2016. Mechanism of inhibitory effect of cathodal current tongue stimulation on five basic tastes. 2016 IEEE Virtual Reality (VR).
[44]
Salem, C. and Zhai, S. 1997. An isometric tongue pointing device. Proceedings of the ACM SIGCHI Conference on Human factors in computing systems (New York, NY, USA, Mar. 1997), 538–539.
[45]
Saponas, T.S., Kelly, D., Parviz, B.A. and Tan, D.S. 2009. Optically sensing tongue gestures for computer input. Proceedings of the 22nd annual ACM symposium on User interface software and technology (New York, NY, USA, Oct. 2009), 177–180.
[46]
Shao, Y., Hayward, V. and Visell, Y. 2016. Spatial patterns of cutaneous vibration during whole-hand haptic interactions. Proceedings of the National Academy of Sciences of the United States of America. 113, 15 (Apr. 2016), 4188–4193.
[47]
Shen, V., Shultz, C. and Harrison, C. 2022. Mouth Haptics in VR using a Headset Ultrasound Phased Array. Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, Apr. 2022), 1–14.
[48]
Shepherd, G.M. 2015. Neuroenology: how the brain creates the taste of wine. Flavour. 4, 1 (Mar. 2015), 1–5.
[49]
Slyper, R., Lehman, J., Forlizzi, J. and Hodgins, J. 2011. A tongue input device for creating conversations. Proceedings of the 24th annual ACM symposium on User interface software and technology (New York, NY, USA, Oct. 2011), 117–126.
[50]
Van Boven, R.W. and Johnson, K.O. 1994. The limit of tactile spatial resolution in humans: grating orientation discrimination at the lip, tongue, and finger. Neurology. 44, 12 (Dec. 1994), 2361–2366.
[51]
Website: https://snoregym.com/about-snoregym/". Accessed: 2022-10-12.
[52]
Young, T., Palta, M., Dempsey, J., Peppard, P.E., Nieto, F.J. and Hla, K.M. 2009. Burden of sleep apnea: rationale, design, and major findings of the Wisconsin Sleep Cohort study. WMJ: official publication of the State Medical Society of Wisconsin. 108, 5 (Aug. 2009), 246–249.
[53]
Zhang, Q., Gollakota, S., Taskar, B. and Rao, R.P.N. 2014. Non-intrusive tongue machine interface. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA, Apr. 2014), 2555–2558.
Index Terms
- TOFI: Designing Intraoral Computer Interfaces for Gamified Myofunctional Therapy
Recommendations
Interfaces as specifications in the MIDAS user interface development systems
This paper describes an evolving User Interface Development System called MIDAS (for Merging Interface Development with Application Specification) which allows interface/systems designers to develop an application-specific user interface interactively, ...
A novel programmable waveform generator for ultrasound therapy machine using FPGA
Proceedings of the 15th WSEAS international conference on SystemsThe current ultrasound therapy machines are implementing continuous waveform, which in fact, is not an optimum technique for therapy treatment process. Apparently, pulse waveform appearing as a more effectively way of signal generation in terms of its ...
A Prototype Design for Gamified Blood Donation App Using Blockchain Technology, IPFS and NFTs
SenSys '22: Proceedings of the 20th ACM Conference on Embedded Networked Sensor SystemsDonating blood is a common practice that has a positive effect on the lives of several individuals. Daily, the number of people in urgent need of blood continues to rise substantially. It is often challenging to find a suitable donor in case of ...
Comments
Information & Contributors
Information
Published In
April 2023
3914 pages
ISBN:9781450394222
DOI:10.1145/3544549
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 April 2023
Check for updates
Author Tags
Qualifiers
- Extended-abstract
- Research
- Refereed limited
Conference
CHI '23
Sponsor:
Acceptance Rates
Overall Acceptance Rate 6,164 of 23,696 submissions, 26%
Upcoming Conference
CHI 2025
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 291Total Downloads
- Downloads (Last 12 months)169
- Downloads (Last 6 weeks)56
Reflects downloads up to 23 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format