Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3173574.3174219acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Breeze: Sharing Biofeedback through Wearable Technologies

Published: 21 April 2018 Publication History

Abstract

Digitally presenting physiological signals as biofeedback to users raises awareness of both body and mind. This paper describes the effectiveness of conveying a physiological signal often overlooked for communication: breathing. We present the design and development of digital breathing patterns and their evaluation along three output modalities: visual, audio, and haptic. We also present Breeze, a wearable pendant placed around the neck that measures breathing and sends biofeedback in real-time. We evaluated how the breathing patterns were interpreted in a fixed environment and gathered qualitative data on the wearable device's design. We found that participants intentionally modified their own breathing to match the biofeedback, as a technique for understanding the underlying emotion. Our results describe how the features of the breathing patterns and the feedback modalities influenced participants' perception. We include guidelines and suggested use cases, such as Breeze being used by loved ones to increase connectedness and empathy.

Supplementary Material

suppl.mov (pn4873-file3.mp4)
Supplemental video
MP4 File (pn4873.mp4)

References

[1]
Fadel Adib, Hongzi Mao, Zachary Kabelac, Dina Katabi, and Robert C. Miller. 2015. Smart Homes that Monitor Breathing and Heart Rate. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15 (2015), 837--846.
[2]
F. Q. Al-Khalidi, R. Saatchi, D. Burke, H. Elphick, and S. Tan. 2011. Respiration rate monitoring methods: A review. Pediatric Pulmonology 46, January (2011), 523--529.
[3]
Judith Amores and Pattie Maes. 2017. Essence : Olfactory Interfaces for Unconscious Influence of Mood and Cognitive Performance. In CHI '17. 28--34.
[4]
Daniel L. Ashbrook, James R. Clawson, Kent Lyons, Thad E. Starner, and Nirmal Patel. 2008. Quickdraw: The Impact of Mobility and On-body Placement on Device Access Time. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, New York, NY, USA, 219--222.
[5]
Ilhan Aslan, Hadrian Burkhardt, Julian Kraus, and Elisabeth André. 2016. Hold my Heart and Breathe with Me: Tangible Somaesthetic Designs. Proceedings of the 9th Nordic Conference on Human-Computer Interaction NordiCHI '16 (2016), 1--6.
[6]
Elizabeth Bales, Kevin A Li, and William Griswold. 2011. CoupleVIBE: Mobile Implicit Communication to Improve Awareness for (Long-Distance) Couples. In CHI '11. 65--74.
[7]
Lyn Bartram, Abhisekh Patra, and Maureen Stone. 2017. Affective Color in Visualization. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '17. ACM Press, New York, New York, USA, 1364--1374.
[8]
Frans A. Boiten. 1998. The effects of emotional behaviour on components of the respiratory cycle. Biological Psychology 49, 1--2 (1998), 29--51.
[9]
Frans A. Boiten, Nico H. Frijda, and Cornelis J E Wientjes. 1994. Emotions and respiratory patterns: review and critical analysis. International Journal of Psychophysiology 17, 2 (1994), 103--128.
[10]
Margaret M. Bradley and Peter J Lang. 1994. Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry 25, 1 (mar 1994), 49--59.
[11]
Stephen Brewster and Lorna M. Brown. 2004. Tactons: Structured Tactile Messages for Non-visual Information Display. In Proceedings of the Fifth Conference on Australasian User Interface - Volume 28 (AUIC '04). Australian Computer Society, Inc., Darlinghurst, Australia, Australia, 15--23. http://dl.acm.org/citation.cfm?id=976310.976313
[12]
Stephen P. Brooks and Andrew Gelman. 1998. General Methods for Monitoring Convergence of Iterative Simulations. Journal of Computational and Graphical Statistics 7, 4 (dec 1998), 434.
[13]
Sophia Brueckner. 2014. Out of Network: Technologies to Connect with Strangers. (2014). http://hdl.handle.net/1721.1/95592
[14]
Paul Bucci, Xi Laura Cang, Anasazi Valair, David Marino, Lucia Tseng, Merel Jung, Jussi Rantala, Oliver Schneider, and Karon MacLean. 2017. Sketching CuddleBits: Coupled Prototyping of Body and Behaviour for an Affective Robot Pet. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems CHI '17 (2017), 3681--3692.
[15]
Jessica R. Cauchard, Janette L. Cheng, Thomas Pietrzak, and James A. Landay. 2016. ActiVibe: Design and Evaluation of Vibrations for Progress Monitoring. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 3261--3271.
[16]
Guillaume Chanel and Christian Mühl. 2015. Connecting Brains and Bodies: Applying Physiological Computing to Support Social Interaction. Interacting with Computers (2015).
[17]
Jean Costa, Alexander T. Adams, Malte F. Jung, François Guimbretière, and Tanzeem Choudhury. 2016. EmotionCheck: Leveraging Bodily Signals and False Feedback to Regulate Our Emotions. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16). ACM, New York, NY, USA, 758--769.
[18]
Norman Farb, Jennifer Daubenmier, Cynthia J. Price, Tim Gard, Catherine Kerr, Barnaby D. Dunn, Anne Carolyn Klein, Martin P. Paulus, and Wolf E. Mehling. 2015. Interoception, contemplative practice, and health. Frontiers in Psychology 6, June (2015), 763.
[19]
Renaud Gervais, Jérémy Frey, Alexis Gay, Fabien Lotte, and Martin Hachet. 2016. Tobe: Tangible Out-of-Body Experience. In TEI '16.
[20]
Asma Ghandeharioun and Rosalind Picard. 2017. BrightBeat: Effortlessly Influencing Breathing for Cultivating Calmness and Focus. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '17. ACM Press, New York, New York, USA, 1624--1631.
[21]
Patrick Gomez, Dimitra Filippou, Bruno Pais, Armin von Gunten, and Brigitta Danuser. 2016. Breathing and affective picture processing across the adult lifespan. Biological Psychology 119 (2016), 101--111.
[22]
Rebecca A Grier. 2015. How High Is High ? A Meta-Analysis of Nasa-Tlx Global Workload Scores. 59th Annual Meeting of the Human Factors and Ergonomics Society (2015), 1727--1731.
[23]
Jarrod D. Hadfield. 2010. MCMC methods for multi-response generalized linear mixed models: The MCMCglmm R package. Journal of Statistical Software 33, 2 (2010), 1--22.
[24]
Chris Harrison, Brian Y. Lim, Aubrey Shick, and Scott E. Hudson. 2009. Where to Locate Wearable Displays? Reaction Time Performance of Visual Alerts from Tip to Toe. Proceedings of the 27th Annual SIGCHI Conference on Human Factors in Computing Systems (2009), 941--944.
[25]
Sandra G. Hart and Lowell E. Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. In Human mental workload. Elsevier B.V., 139--183.
[26]
Javier Hernandez, Yin Li, James M. Rehg, and Rosalind W. Picard. 2015. Cardiac and Respiratory Parameter Estimation Using Head-mounted Motion-sensitive Sensors. EAI Endorsed Transactions on Pervasive Health and Technology 1, 1 (May 2015), e2.
[27]
Javier Hernandez and Rosalind W Picard. 2015. BioWatch : Estimation of Heart and Breathing Rates from Wrist Motions. Pervasive Health '15 (2015).
[28]
Ikuo Homma and Yuri Masaoka. 2008. Breathing rhythms and emotions. Experimental physiology 93, 9 (2008), 1011--21.
[29]
Noura Howell, Laura Devendorf, Rundong Kevin Tian, Tomás Vega Galvez, Nan-wei Gong, Ivan Poupyrev, Eric Paulos, Kimiko Ryokai, and U C Berkeley. 2016. Biosignals as Social Cues : Ambiguity and Emotional Interpretation in Social Displays of Skin Conductance. DIS '16 (2016), 865--870.
[30]
Idin Karuei, Karon E. MacLean, Zoltan Foley-Fisher, Russell MacKenzie, Sebastian Koch, and Mohamed El-Zohairy. 2011. Detecting Vibrations Across the Body in Mobile Contexts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 3267--3276.
[31]
P. E. Keller, G. Novembre, and M. J. Hove. 2014. Rhythm in joint action: psychological and neurophysiological mechanisms for real-time interpersonal coordination. Philosophical Transactions of the Royal Society B: Biological Sciences 369, 1658 (2014), 20130394--20130394.
[32]
J Kim, Y.-W. Park, and T.-J. Nam. 2015. BreathingFrame: An inflatable frame for remote breath signal sharing. TEI 2015 - Proceedings of the 9th International Conference on Tangible, Embedded, and Embodied Interaction (2015), 109--112.
[33]
Kevin A. Li, Patrick Baudisch, William G. Griswold, and James D. Hollan. 2008. Tapping and Rubbing: Exploring New Dimensions of Tactile Feedback with Voice Coil Motors. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (UIST '08). ACM, New York, NY, USA, 181--190.
[34]
Sebastian O H Madgwick. 2010. An efficient orientation filter for inertial and inertial/magnetic sensor arrays. Report x-io and University of Bristol (UK) (2010). https://www.samba.org/tridge/UAV/madgwick_internal_report.pdf
[35]
Joe Marshall, Duncan Rowland, Stefan Rennick Egglestone, Steve Benford, Brendan Walker, and Derek McAuley. 2011. Breath control of amusement rides. In CHI '11. 73--82.
[36]
Yuri Masaoka, Masahiko Izumizaki, and Ikuo Homma. 2014. Where is the rhythm generator for emotional breathing? (1 ed.). Vol. 209. Elsevier B.V. 367--377 pages.
[37]
Nick Merrill and Coye Cheshire. 2017. Trust Your Heart: Assessing Cooperation and Trust with Biosignals in Computer-Mediated Interactions. CSCW '17 Proceedings of the ACM 2017 conference on Computer Supported Cooperative Work (2017), 2--12.
[38]
Stuart Moran, Nils Jäger, Holger Schnädelbach, and Kevin Glover. 2016. ExoPranayama: a biofeedback-driven actuated environment for supporting yoga breathing practices. Personal and Ubiquitous Computing 20, 2 (2016), 261--275.
[39]
Lennart Erik Nacke, Michael Kalyn, Calvin Lough, and Regan Lee Mandryk. 2011. Biofeedback Game Design: Using Direct and Indirect Physiological Control to Enhance Game Interaction. CHI '11 (2011), 103--112.
[40]
Pierre Philippot, Gaëtane Chapelle, and Sylvie Blairy. 2002. Respiratory feedback in the generation of emotion. Cognition & Emotion 16, 5 (2002), 605--627.
[41]
Charles A Poynton. 1993. "Gamma" and Its Disguises: The Nonlinear Mappings of Intensity in Perception, CRTs, Film, and Video. SMPTE Journal 102, December (1993), 1099 -- 1108.
[42]
Nimesha Ranasinghe, Kasun Karunanayaka, Adrian David Cheok, Owen Noel Newton Fernando, Hideaki Nii, and Ponnampalam Gopalakrishnakone. 2011. Digital Taste and Smell Communication. In Proceedings of the 6th International Conference on Body Area Networks (BodyNets '11). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, Belgium, 78--84. http://dl.acm.org/citation.cfm?id=2318776.2318795
[43]
Ruth Ravichandran, Elliot Saba, Ke-Yu Chen, Mayank Goel, Sidhant Gupta, and Shwetak N. Patel. 2015. WiBreathe: Estimating respiration rate using wireless signals in natural settings in the home. In 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom), Vol. 16. IEEE, 131--139.
[44]
T. Reinvuo, M. Hannula, H. Sorvoja, E. Alasaarela, and R. Myllyla. 2006. Measurement of respiratory rate with high-resolution accelerometer and emfit pressure sensor. Proceedings of the 2006 IEEE Sensors Applications Symposium, 2006. February (2006), 7--9.
[45]
Yanzhi Ren, Chen Wang, Yingying Chen, and Jie Yang. 2014. Poster: Hearing Your Breathing: Fine-grained Sleep Monitoring Using Smartphones. Proceedings of the 20th Annual International Conference on Mobile Computing and Networking (2014), 409--412.
[46]
Kara Rennert and Evangelos Karapanos. 2013. Faceit: supporting reflection upon social anxiety events with lifelogging. CHI'13 Extended Abstracts on Human Factors ... (2013), 457--462. http://dl.acm.org/citation.cfm?id=2468437
[47]
A. Rochet-Capellan and S. Fuchs. 2014. Take a breath and take the turn: how breathing meets turns in spontaneous dialogue. Philosophical Transactions of the Royal Society B: Biological Sciences 369, 1658 (2014), 20130399--20130399.
[48]
Joan Sol Roo, Renaud Gervais, Jérémy Frey, and Martin Hachet. 2017. Inner Garden: Connecting Inner States to a Mixed Reality Sandbox for Mindfulness. In CHI '17.
[49]
Elaine Sedenberg, Richmond Wong, and John Chuang. 2017. A Window into the Soul: Biosensing in Public. In Surveillance, Privacy, and Public Space, Bryce Newell and Tjerk Timan (Eds.). Routledge, 1--24. https://arxiv.org/abs/1702.04235
[50]
Hasti Seifi, Kailun Zhang, and Karon E. MacLean. 2015. VibViz: Organizing, visualizing and navigating vibration libraries. IEEE World Haptics Conference, WHC 2015 (2015), 254--259.
[51]
Ghufran Shafiq and Kalyana Chakravarthy Veluvolu. 2017. Multimodal chest surface motion data for respiratory and cardiovascular monitoring applications. Scientific Data (2017), 1--11.
[52]
Ranganatha Sitaram, Tomas Ros, Luke Stoeckel, Sven Haller, Frank Scharnowski, Jarrod Lewis-Peacock, Nikolaus Weiskopf, Maria Laura Blefari, Mohit Rana, Ethan Oblak, Niels Birbaumer, and James Sulzer. 2016. Closed-loop brain training: the science of neurofeedback. Nature Reviews Neuroscience 18, 2 (dec 2016), 86--100.
[53]
Evan Strasnick, Jessica R. Cauchard, and James A. Landay. 2017. BrushTouch: Exploring an Alternative Tactile Method for Wearable Haptics. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3120--3125.
[54]
Xiao Sun, Li Qiu, Yibo Wu, Yeming Tang, and Guohong Cao. 2017. SleepMonitor: Monitoring Respiratory Rate and Body Position During Sleep Using Smartwatch XIAO. In PACM Interact. Mob. Wearable Ubiquitous Technol.
[55]
I Van Diest, W Winters, S Devriese, E Vercamst, J N Han, K P Van de Woestijne, and O Van den Bergh. 2001. Hyperventilation beyond fight/flight: respiratory responses during emotional imagery. Psychophysiology 38, 6 (2001), 961--968.
[56]
Wouter Walmink, Danielle Wilde, and Florian Floyd Mueller. 2014. Displaying Heart Rate Data on a Bicycle Helmet to Support Social Exertion Experiences. In TEI '14.
[57]
Graham Wilson, Dobromir Dobrev, and Stephen A. Brewster. 2016a. Hot Under the Collar: Mapping Thermal Feedback to Dimensional Models of Emotion. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 4838--4849.
[58]
Graham Wilson, Euan Freeman, and Stephen A Brewster. 2016b. Multimodal Affective Feedback: Combining Thermal, Vibrotactile, Audio and Visual Signals. In ICMI '16. 400--401.
[59]
Naoto Yoshida and Tomoko Yonezawa. 2016. Investigating Breathing Expression of a Stuffed-Toy Robot Based on Body-Emotion Model. Proceedings of the Fourth International Conference on Human Agent Interaction - HAI '16 (2016), 139--144.
[60]
Jesang Yu, Ji Hoon Choi, Sun Young Ma, Tae Sig Jeung, and Sangwook Lim. 2015. Comparison between audio-only and audiovisual biofeedback for regulating patients' respiration during four-dimensional radiotherapy. Radiation Oncology Journal 33, 3 (2015), 250--255.
[61]
Clint Zeagler. 2017. Where to Wear It: Functional, Technical, and Social Considerations in On-body Location for Wearable Technology 20 Years of Designing for Wearability. International Symposium on Wearable Computers (2017).

Cited By

View all
  • (2024)Inertial Sensors-Based Assessment of Human Breathing Pattern: A Systematic Literature ReviewAlgorithms10.3390/a1706022317:6(223)Online publication date: 23-May-2024
  • (2024)HACKLES: Simulating and Visually Representing the Anxiety of Walking AloneProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633392(1-15)Online publication date: 11-Feb-2024
  • (2024)Just a Breath Away: Investigating Interactions with and Perceptions of Mediated Breath via a Haptic CushionProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633384(1-19)Online publication date: 11-Feb-2024
  • Show More Cited By

Index Terms

  1. Breeze: Sharing Biofeedback through Wearable Technologies

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems
    April 2018
    8489 pages
    ISBN:9781450356206
    DOI:10.1145/3173574
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 April 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. affective computing
    2. breathing
    3. physiological computing
    4. signal processing
    5. wearables

    Qualifiers

    • Research-article

    Conference

    CHI '18
    Sponsor:

    Acceptance Rates

    CHI '18 Paper Acceptance Rate 666 of 2,590 submissions, 26%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)202
    • Downloads (Last 6 weeks)23
    Reflects downloads up to 23 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Inertial Sensors-Based Assessment of Human Breathing Pattern: A Systematic Literature ReviewAlgorithms10.3390/a1706022317:6(223)Online publication date: 23-May-2024
    • (2024)HACKLES: Simulating and Visually Representing the Anxiety of Walking AloneProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633392(1-15)Online publication date: 11-Feb-2024
    • (2024)Just a Breath Away: Investigating Interactions with and Perceptions of Mediated Breath via a Haptic CushionProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633384(1-19)Online publication date: 11-Feb-2024
    • (2024)breatHaptics: Enabling Granular Rendering of Breath Signals via Haptics using Shape-Changing Soft InterfacesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633372(1-11)Online publication date: 11-Feb-2024
    • (2024)ExBreath: Explore the Expressive Breath System as Nonverbal Signs towards Semi-unintentional ExpressionExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650870(1-7)Online publication date: 11-May-2024
    • (2024)EmoEcho: Designing Emotion Mimicry Mechanics for Enhancing Social Engagement in Digital GamesExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650864(1-6)Online publication date: 11-May-2024
    • (2024)“Can you be with that feeling?”: Extending Design Strategies for Interoceptive Awareness for the Context of Mental HealthProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3643054(1-21)Online publication date: 11-May-2024
    • (2024)Sharing Frissons among Online Video Viewers: Exploring the Design of Affective Communication for Aesthetic ChillsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642818(1-19)Online publication date: 11-May-2024
    • (2024)Perceived Empathy of Technology Scale (PETS): Measuring Empathy of Systems Toward the UserProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642035(1-18)Online publication date: 11-May-2024
    • (2024)Artificial intelligence based cognitive state prediction in an e-learning environment using multimodal dataMultimedia Tools and Applications10.1007/s11042-023-18021-xOnline publication date: 16-Jan-2024
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media