Work in Progress

BREATHTURES: A First Step Towards Breathing Gestures as Distinct Input Modality

Authors:

Lisa Anneke Burr,

Julia Mayrhauser,

Alexander MeschtscherjakovAuthors Info & Claims

CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

Article No.: 60, Pages 1 - 6

https://doi.org/10.1145/3544549.3585787

Published: 19 April 2023 Publication History

Abstract

The use of breath as interaction modality has sparked some interest recently in HCI. Research in this field actively explored breathing interaction (e.g., guidance and feedback) in different contexts. So far, very little systems can be found that systematically use defined breathing gestures as distinct input modality. In this work, we describe the design, development and implementation of five distinct breathing gestures (BREATHTURES), that can be applied as defined input modality to interact with an application. We present a qualitative user study (n=7) focusing on usability and user experience of the developed BREATHTURES when applied in a game-like application. Results indicate an overall positive rating in terms of fun and usability. Some BREATHTURES were perceived harder to perform and to detect than others. Further iterations of our work will require refined BREATHTURE detection. Overall, our work demonstrates the design, implementation and application of pre-defined breathing gestures as distinct input modality.

Supplementary Material

MP4 File (3544549.3585787-talk-video.mp4)

Pre-recorded Video Presentation

Download
13.12 MB

References

[1]

Fadel Adib, Zachary Kabelac, Hongzi Mao, Dina Katabi, and Robert C. Miller. 2014. Demo: Real-Time Breath Monitoring Using Wireless Signals. In Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (Maui, Hawaii, USA) (MobiCom ’14). Association for Computing Machinery, New York, NY, USA, 261–262. https://doi.org/10.1145/2639108.2641756

Digital Library

[2]

Vasundhara Agrawal, Varnika Naik, Mayuri Duggirala, and Sandeep Athavale. 2020. Calm a mobile based deep breathing game with biofeedback. In Extended Abstracts of the 2020 Annual Symposium on Computer-Human Interaction in Play. 153–157.

Digital Library

[3]

Ahmet Baydur, Rodney H Adkins, and Joseph Milic-Emili. 2001. Lung mechanics in individuals with spinal cord injury: effects of injury level and posture. Journal of Applied Physiology 90, 2 (2001), 405–411.

[4]

Gila Benchetrit. 2000. Breathing pattern in humans: diversity and individuality. Respiration physiology 122, 2-3 (2000), 123–129.

[5]

Lisa Burr, Nick Betzlbacher, Alexander Meschtscherjakov, and Manfred Tscheligi. 2022. Breathing Training on the Run: Exploring Users Perception on a Gamified Breathing Training Application During Treadmill Running. In Persuasive Technology: 17th International Conference, PERSUASIVE 2022, Virtual Event, March 29–31, 2022, Proceedings (Doha, Qatar). Springer-Verlag, Berlin, Heidelberg, 58–74. https://doi.org/10.1007/978-3-030-98438-0_5

Digital Library

[6]

Wei-Hung Chen. 2015. Blowatch: Blowable and hands-free interaction for smartwatches. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on human factors in computing systems. 103–108.

Digital Library

[7]

Yeqing Chen, Yulong Bian, Wei Gai, and Chenglei Yang. 2020. Adaptive Blowing Interaction Method Based on a Siamese Network. IEEE Access 8 (2020), 115486–115500.

[8]

Youngjun Cho, Nadia Bianchi-Berthouze, and Simon J Julier. 2017. DeepBreath: Deep learning of breathing patterns for automatic stress recognition using low-cost thermal imaging in unconstrained settings. In 2017 seventh international conference on affective computing and intelligent interaction (acii). IEEE, 456–463.

[9]

Jérémy Frey, May Grabli, Ronit Slyper, and Jessica R Cauchard. 2018. Breeze: Sharing biofeedback through wearable technologies. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[10]

N Garcia-Hernandez, I Muñoz-Pepi, F Villafranca-Martinez, and V Parra-Vega. 2022. Usability and Effectiveness Evaluation of a Game-Based Biofeedback System to Strengthen Respiratory Muscles. International Journal of Human–Computer Interaction (2022), 1–12.

[11]

Eric Harbour, Michael Lasshofer, Matteo Genitrini, and Hermann Schwameder. 2021. Enhanced breathing pattern detection during running using wearable sensors. Sensors 21, 16 (2021), 5606.

[12]

Eric Harbour, Thomas Stöggl, Hermann Schwameder, and Thomas Finkenzeller. 2022. Breath Tools: A Synthesis of Evidence-Based Breathing Strategies to Enhance Human Running. Frontiers in Physiology (2022), 233.

[13]

Oo Jin Heng and Quek Albert. 2020. Bubble Tower: Breathing Based Virtual Reality Action Game. In Proceedings of the 2020 the 4th International Conference on Big Data and Internet of Things. 33–37.

Digital Library

[14]

Rohan Hundia and Aaron Quigley. 2019. BreathIn: A breath pattern sensing approach for user computer interaction. In Proceedings of the 31st Australian Conference on Human-Computer-Interaction. 581–584.

Digital Library

[15]

Annkatrin Jung, Miquel Alfaras, Pavel Karpashevich, William Primett, and Kristina Höök. 2021. Exploring Awareness of Breathing through Deep Touch Pressure. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 263, 15 pages. https://doi.org/10.1145/3411764.3445533

Digital Library

[16]

Jong-Hyun Kim and Jung Lee. 2020. Controlling your contents with the breath: Interactive breath interface for VR, games, and animations. Plos one 15, 10 (2020), e0241498.

[17]

Takahiro Kusabuka and Takuya Indo. 2020. IBUKI: Gesture Input Method Based on Breathing. In Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology. 102–104.

Digital Library

[18]

James R Lewis. 2006. Usability testing. Handbook of human factors and ergonomics 12 (2006), e30.

[19]

Ryoma Ogawa, Kyosuke Futami, and Kazuya Murao. 2021. NasalBreathInput: A Hands-Free Input Method by Nasal Breath Gestures using a Glasses Type Device. In The 23rd International Conference on Information Integration and Web Intelligence. 620–624.

Digital Library

[20]

Ryoya Onishi, Tao Morisaki, Shun Suzuki, Saya Mizutani, Takaaki Kamigaki, Masahiro Fujiwara, Yasutoshi Makino, and Hiroyuki Shinoda. 2021. DualBreath: Input Method Using Nasal and Mouth Breathing. In Augmented Humans Conference 2021. 283–285.

[21]

Pablo E Paredes, Yijun Zhou, Nur Al-Huda Hamdan, Stephanie Balters, Elizabeth Murnane, Wendy Ju, and James A Landay. 2018. Just breathe: In-car interventions for guided slow breathing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1 (2018), 1–23.

Digital Library

[22]

Shwetak N Patel and Gregory D Abowd. 2007. Blui: low-cost localized blowable user interfaces. In Proceedings of the 20th annual ACM symposium on User interface software and technology. 217–220.

Digital Library

[23]

Rakesh Patibanda, Florian’Floyd’ Mueller, Matevz Leskovsek, and Jonathan Duckworth. 2017. Life tree: understanding the design of breathing exercise games. In Proceedings of the annual symposium on computer-human interaction in play. 19–31.

Digital Library

[24]

Michael Brent Phillips, Jason Beach, Michael Cathey, Jake Lockert, and William Satterfield. 2017. Reliability and validity of the Hexoskin wearable body metrics telemetry shirt. Journal of Sport and Human Performance 5, 2 (2017).

[25]

Mirjana Prpa, Ekaterina R. Stepanova, Thecla Schiphorst, Bernhard E. Riecke, and Philippe Pasquier. 2020. Inhaling and Exhaling: How Technologies Can Perceptually Extend Our Breath Awareness. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–15. https://doi.org/10.1145/3313831.3376183

Digital Library

[26]

Gabriel Reyes, Dingtian Zhang, Sarthak Ghosh, Pratik Shah, Jason Wu, Aman Parnami, Bailey Bercik, Thad Starner, Gregory D Abowd, and W Keith Edwards. 2016. Whoosh: non-voice acoustics for low-cost, hands-free, and rapid input on smartwatches. In Proceedings of the 2016 ACM International Symposium on Wearable Computers. 120–127.

Digital Library

[27]

Daniela Roditi and Michael E Robinson. 2011. The role of psychological interventions in the management of patients with chronic pain. Psychology research and behavior management 4 (2011), 41.

[28]

Jeff Sauro. 2012. things to know about the Single Ease Question (SEQ). Measuring U 2012 (2012).

[29]

Misha Sra, Xuhai Xu, and Pattie Maes. 2018. Breathvr: Leveraging breathing as a directly controlled interface for virtual reality games. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[30]

Markus Tatzgern, Michael Domhardt, Martin Wolf, Michael Cenger, Gerlinde Emsenhuber, Radomir Dinic, Nathalie Gerner, and Arnulf Hartl. 2022. AirRes Mask: A Precise and Robust Virtual Reality Breathing Interface Utilizing Breathing Resistance as Output Modality. In CHI Conference on Human Factors in Computing Systems. 1–14.

Digital Library

[31]

Paul Tennent, Duncan Rowland, Joe Marshall, Stefan Rennick Egglestone, Alexander Harrison, Zachary Jaime, Brendan Walker, and Steve Benford. 2011. Breathalising games: understanding the potential of breath control in game interfaces. In Proceedings of the 8th international conference on advances in computer entertainment technology. 1–8.

Digital Library

[32]

Robby van Delden, Danny Plass-Oude Bos, Antje Jacoba Vivian de With, Koen Vogel, Randy Klaassen, Nynke Zwart, Joyce Faber, Boony Thio, and Mattienne van der Kamp. 2020. SpiroPlay, a Suite of Breathing Games for Spirometry by Kids & Experts. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play. 400–413.

Digital Library

[33]

Vincent Van Rheden, Eric Harbour, Thomas Finkenzeller, Lisa Anneke Burr, Alexander Meschtscherjakov, and Manfred Tscheligi. 2021. Run, Beep, Breathe: Exploring the Effects on Adherence and User Experience of 5 Breathing Instruction Sounds while Running. In Proceedings of the 16th International Audio Mostly Conference, AM 2021(ACM International Conference Proceeding Series). Association for Computing Machinery, 16–23. https://doi.org/10.1145/3478384.3478412 Publisher Copyright: © 2021 ACM.; 16th International Audio Mostly Conference, AM 2021 ; Conference date: 01-09-2021 Through 03-09-2021.

Digital Library

[34]

X Rosalind Wang, Joseph T Lizier, Amalia Z Berna, Florence G Bravo, and Stephen C Trowell. 2015. Human breath-print identification by E-nose, using information-theoretic feature selection prior to classification. Sensors and Actuators B: Chemical 217 (2015), 165–174.

[35]

Motoji Yamamoto, Takeshi Ikeda, and Yoshinobu Sasaki. 2008. Real-time analog input device using breath pressure for the operation of powered wheelchair. In 2008 IEEE International Conference on Robotics and Automation. IEEE, 3914–3919.

[36]

Andrea Zaccaro, Andrea Piarulli, Marco Laurino, Erika Garbella, Danilo Menicucci, Bruno Neri, and Angelo Gemignani. 2018. How Breath-Control Can Change Your Life: A Systematic Review on Psycho-Physiological Correlates of Slow Breathing. Frontiers in human neuroscience 12 (2018), 353. https://doi.org/10.3389/fnhum.2018.00353

Cited By

Brooks JMazursky AHixon JLopes P(2024)Augmented Breathing via Thermal Feedback in the NoseProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676438(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676438
Min TXia CYamamoto TSugiura Y(2023)Seeing the Wind: An Interactive Mist Interface for Airflow InputProceedings of the ACM on Human-Computer Interaction10.1145/36264807:ISS(398-419)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626480

Index Terms

BREATHTURES: A First Step Towards Breathing Gestures as Distinct Input Modality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. Usability testing
    2. Interaction techniques
      1. Gestural input
  2. Interaction design
    1. Interaction design process and methods
      1. User interface design

Recommendations

Breathero: Not Another Slow Breathing Game — Exploring Faster-Paced VR Breathing Exercise Games
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

BreatHero is a faster-paced Virtual Reality (VR) action game that explores the potential of combining breathing techniques learning with the combat elements of action games. BreatHero uses breathing techniques as various skills for attacking and ...
HRV Assessment Using Finger-tip Photoplethysmography (PulseRate) as Compared to ECG on Healthy Subjects During Different Postures and Fixed Breathing Pattern
Abstract
Heart Rate Variability (HRV) is a well-known method to assess the human Autonomic Nervous System (ANS) functions. Currently, in the health care information system, HRV properties are very useful to provide medical and other vital signs of the ...
A First Step Towards Considering Nonverbal Communicative Cues in Dialog Systems
PETRA '24: Proceedings of the 17th International Conference on PErvasive Technologies Related to Assistive Environments

Currently, spoken dialogue systems mostly consider only voice interactions and do not consider nonverbal cues. This work aims to explore the domain of interaction with conversational assistants, taking into account not only verbal cues, but also the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

April 2023

3914 pages

ISBN:9781450394222

DOI:10.1145/3544549

Editors:
Albrecht Schmidt
LMU Munich, Germany
,
Kaisa Väänänen
Tampere University, Finland
,
Tesh Goyal
Google Research, USA
,
Per Ola Kristensson
University of Cambridge, UK
,
Anicia Peters
University of Namibia, Namibia

Copyright © 2023 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Check for updates

Author Tags

Qualifiers

Work in progress
Research
Refereed limited

Conference

CHI '23

Sponsor:

SIGCHI

CHI '23: CHI Conference on Human Factors in Computing Systems

April 23 - 28, 2023

Hamburg, Germany

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
208
Total Downloads

Downloads (Last 12 months)132
Downloads (Last 6 weeks)24

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Brooks JMazursky AHixon JLopes P(2024)Augmented Breathing via Thermal Feedback in the NoseProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676438(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676438
Min TXia CYamamoto TSugiura Y(2023)Seeing the Wind: An Interactive Mist Interface for Airflow InputProceedings of the ACM on Human-Computer Interaction10.1145/36264807:ISS(398-419)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626480

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View full text|Download PDF

View Table of Contents