Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Public Access

Supporting Social Interactions with an Expressive Heart Rate Sharing Application

Published: 11 September 2017 Publication History

Abstract

The present work explores the social dynamics of expressive biosignals: leveraging wearable technologies to introduce sensed physiological data as a means of clarifying the emotional or psychological processes underlying our subjective experiences. We developed an Android application that linked to a wearable heart rate sensor and allowed for the direct sharing and real-time broadcasting of users’ heart rate via text messaging. We deployed this application in a two-week field study to investigate the contextual triggers, perceptions, and consequences of users’ sharing behaviors. The study (N=13) utilized a combination of Experience Sampling Methodology (ESM) and qualitative interviews to discover the situations in which users were more or less likely to share their heart rate with contacts, and the subsequent interactions that occurred after sharing. The results revealed that participants used heart rate sharing as a means to express emotions and provide daily updates, as well as simply a novel and playful form of communication. They reported a variety of communicative consequences of their sharing as well as specific logistical and psychological barriers to sharing. The implications of these results for the design of expressive biosignal sharing systems for supporting positive social interactions are discussed.

References

[1]
2016. Muse. http://www.choosemuse.com/. (2016). Accessed: 2017-07-13.
[2]
2017. Mio Alpha 2. https://www.mioglobal.com/en-us/Mio-ALPHA-2-Heart-Rate-Sport-Watch/Product.aspx. (2017). Accessed: 2017-05-12.
[3]
2017. Monitor stress, seizures, activity, sleep. https://www.empatica.com/product-embrace. (2017). Accessed: 2017-07-13.
[4]
Keith Anderson, Elisabeth André, Tobias Baur, Sara Bernardini, Mathieu Chollet, Evi Chryssafidou, Ionut Damian, Cathy Ennis, Arjan Egges, Patrick Gebhard, et al. 2013. The TARDIS framework: intelligent virtual agents for social coaching in job interviews. In Advances in computer entertainment. Springer, 476--491.
[5]
Chris Berka, Daniel J Levendowski, Milenko M Cvetinovic, Miroslav M Petrovic, Gene Davis, Michelle N Lumicao, Vladimir T Zivkovic, Miodrag V Popovic, and Richard Olmstead. 2004. Real-time analysis of EEG indexes of alertness, cognition, and memory acquired with a wireless EEG headset. International Journal of Human-Computer Interaction 17, 2 (2004), 151--170.
[6]
Prashant Bordia. 1997. Face-to-face versus computer-mediated communication: A synthesis of the experimental literature. The Journal of Business Communication (1973) 34, 1 (1997), 99--118.
[7]
Sunny Consolvo, Ian E Smith, Tara Matthews, Anthony LaMarca, Jason Tabert, and Pauline Powledge. 2005. Location disclosure to social relations: why, when, 8 what people want to share. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 81--90.
[8]
Sunny Consolvo and Miriam Walker. 2003. Using the experience sampling method to evaluate ubicomp applications. IEEE Pervasive Computing 2, 2 (2003), 24--31.
[9]
Jean Costa, Alexander T Adams, Malte F Jung, François Guimbetiere, and Tanzeem Choudhury. 2016. EmotionCheck: leveraging bodily signals and false feedback to regulate our emotions. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 758--769.
[10]
Franco Curmi, Maria Angela Ferrario, Jen Southern, and Jon Whittle. 2013. HeartLink: open broadcast of live biometric data to social networks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1749--1758.
[11]
Daantje Derks, Agneta H Fischer, and Arjan ER Bos. 2008. The role of emotion in computer-mediated communication: A review. Computers in Human Behavior 24, 3 (2008), 766--785.
[12]
Rana El Kaliouby, Rosalind Picard, and Simon Baron-Cohen. 2006. Affective computing and autism. Annals of the New York Academy of Sciences 1093, 1 (2006), 228--248.
[13]
Clark Elliott, Jeff Rickel, and James Lester. 1999. Lifelike pedagogical agents and affective computing: An exploratory synthesis. In Artificial intelligence today. Springer, 195--211.
[14]
Daniel A Epstein, Bradley H Jacobson, Elizabeth Bales, David W McDonald, and Sean A Munson. 2015. From nobody cares to way to go!: A Design Framework for Social Sharing in Personal Informatics. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work 8 Social Computing. ACM, 1622--1636.
[15]
Muhammad Fahim, Iram Fatima, Sungyoung Lee, and Young-Koo Lee. 2012. Daily life activity tracking application for smart homes using android smartphone. In Advanced Communication Technology (ICACT), 2012 14th International Conference on. IEEE, 241--245.
[16]
Denzil Ferreira, Vassilis Kostakos, and Anind K Dey. 2015. AWARE: mobile context instrumentation framework. Frontiers in ICT 2 (2015), 6.
[17]
Jérémy Frey. 2016. Remote Heart Rate Sensing and Projection to Renew Traditional Board Games and Foster Social Interactions. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 1865--1871.
[18]
Laurent George and Anatole Lécuyer. 2010. An overview of research on” passive” brain-computer interfaces for implicit human-computer interaction. In International Conference on Applied Bionics and Biomechanics ICABB 2010-Workshop W1” Brain-Computer Interfacing and Virtual Reality”.
[19]
Avik Ghose, Priyanka Sinha, Chirabrata Bhaumik, Aniruddha Sinha, Amit Agrawal, and Anirban Dutta Choudhury. 2013. UbiHeld: ubiquitous healthcare monitoring system for elderly and chronic patients. In Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication. ACM, 1255--1264.
[20]
Erin Griffiths, T Scott Saponas, and AJ Brush. 2014. Health chair: implicitly sensing heart and respiratory rate. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 661--671.
[21]
Mariam Hassib, Daniel Buschek, Pawel W. Wozniak, and Florian Alt. 2017. HeartChat: Heart Rate Augmented Mobile Chat to Support Empathy and Awareness. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 2239--2251.
[22]
Mariam Hassib, Stefan Schneegass, Philipp Eiglsperger, Niels Henze, Albrecht Schmidt, and Florian Alt. 2017. EngageMeter: A System for Implicit Audience Engagement Sensing Using Electroencephalography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 5114--5119.
[23]
Jennifer A Healey and Rosalind W Picard. 2005. Detecting stress during real-world driving tasks using physiological sensors. IEEE Transactions on intelligent transportation systems 6, 2 (2005), 156--166.
[24]
Javier Hernandez, Ivan Riobo, Agata Rozga, Gregory D Abowd, and Rosalind W Picard. 2014. Using electrodermal activity to recognize ease of engagement in children during social interactions. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 307--317.
[25]
Karen Hovsepian, Mustafa al’Absi, Emre Ertin, Thomas Kamarck, Motohiro Nakajima, and Santosh Kumar. 2015. cStress: towards a gold standard for continuous stress assessment in the mobile environment. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 493--504.
[26]
Noura Howell, Laura Devendorf, Rundong Kevin Tian, Tomás Vega Galvez, Nan-Wei Gong, Ivan Poupyrev, Eric Paulos, and Kimiko Ryokai. 2016. Biosignals as Social Cues: Ambiguity and Emotional Interpretation in Social Displays of Skin Conductance. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems. ACM, 865--870.
[27]
Joris H Janssen, Jeremy N Bailenson, Wijnand A IJsselsteijn, and Joyce HDM Westerink. 2010. Intimate heartbeats: Opportunities for affective communication technology. IEEE Transactions on Affective Computing 1, 2 (2010), 72--80.
[28]
Dacher Keltner and Jonathan Haidt. 1999. Social functions of emotions at four levels of analysis. Cognition 8 Emotion 13, 5 (1999), 505--521.
[29]
Eileen Kennedy-Moore and Jeanne C Watson. 2001. How and when does emotional expression help? Review of General Psychology 5, 3 (2001), 187.
[30]
Sara Kiesler, Jane Siegel, and Timothy W McGuire. 1984. Social psychological aspects of computer-mediated communication. American psychologist 39, 10 (1984), 1123.
[31]
Reuben Kirkham, Sebastian Mellor, David Green, Jiun-Shian Lin, Karim Ladha, Cassim Ladha, Daniel Jackson, Patrick Olivier, Peter Wright, and Thomas Ploetz. 2013. The break-time barometer: an exploratory system forworkplace break-time social awareness. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 73--82.
[32]
Evdokimos I Konstantinidis, Magda Hitoglou-Antoniadou, Andrej Luneski, Panagiotis D Bamidis, and Maria M Nikolaidou. 2009. Using affective avatars and rich multimedia content for education of children with autism. In Proceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 58.
[33]
Reed Larson and Mihaly Csikszentmihalyi. 1983. The experience sampling method. New Directions for Methodology of Social 8 Behavioral Science (1983).
[34]
Robert W Levenson and Anna M Ruef. 1997. Physiological aspects of emotional knowledge and rapport. (1997).
[35]
Danielle Lottridge, Nicolas Masson, and Wendy Mackay. 2009. Sharing empty moments: design for remote couples. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2329--2338.
[36]
Xuan Lu, Wei Ai, Xuanzhe Liu, Qian Li, Ning Wang, Gang Huang, and Qiaozhu Mei. 2016. Learning from the ubiquitous language: an empirical analysis of emoji usage of smartphone users. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 770--780.
[37]
Diana MacLean, Asta Roseway, and Mary Czerwinski. 2013. MoodWings: a wearable biofeedback device for real-time stress intervention. In Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 66.
[38]
Paolo Massa, Chiara Leonardi, Bruno Lepri, Fabio Pianesi, and Massimo Zancanaro. 2015. If you are happy and you know it, say “I’m here”: investigating parents’ location-sharing preferences. In Human-Computer Interaction. Springer, 315--332.
[39]
Nick Merrill and Coye Cheshire. 2016. Habits of the Heart (rate): Social Interpretation of Biosignals in Two Interaction Contexts. In Proceedings of the 19th International Conference on Supporting Group Work. ACM, 31--38.
[40]
Nick Merrill and Coye Cheshire. 2017. Trust Your Heart: Assessing Cooperation and Trust with Biosignals in Computer-Mediated Interactions. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 2--12.
[41]
Hannah Jean Miller, Jacob Thebault-Spieker, Shuo Chang, Isaac Johnson, Loren Terveen, and Brent Hecht. 2016. “Blissfully Happy” or “Ready to Fight”: Varying Interpretations of Emoji. In Proceedings of the 10th International Conference on Web and Social Media.
[42]
Hyeryung Christine Min and Tek-Jin Nam. 2014. Biosignal sharing for affective connectedness. In Proceedings of the 2014 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2191--2196.
[43]
Florian Mueller, Frank Vetere, Martin R Gibbs, Darren Edge, Stefan Agamanolis, and Jennifer G Sheridan. 2010. Jogging over a distance between Europe and Australia. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 189--198.
[44]
Pablo Pancardo, JA Hernández-Nolasco, Francisco D Acosta, and Miguel A Wister. 2016. Personalizing Physical Effort Estimation in Workplaces Using a Wearable Heart Rate Sensor. In Ubiquitous Computing and Ambient Intelligence: 10th International Conference, UCAmI 2016, San Bartolomé de Tirajana, Gran Canaria, Spain, November 29--December 2, 2016, Part II 10. Springer, 111--122.
[45]
Helmut Prendinger and Mitsuru Ishizuka. 2005. The empathic companion: A character-based interface that addresses users’affective states. Applied Artificial Intelligence 19, 3-4 (2005), 267--285.
[46]
John Rooksby, Mattias Rost, Alistair Morrison, and Matthew Chalmers Chalmers. 2014. Personal tracking as lived informatics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1163--1172.
[47]
Jonathan Rubin, Hoda Eldardiry, Rui Abreu, Shane Ahern, Honglu Du, Ashish Pattekar, and Daniel G Bobrow. 2015. Towards a mobile and wearable system for predicting panic attacks. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 529--533.
[48]
Johnny Saldaña. 2015. The coding manual for qualitative researchers. Sage.
[49]
Akane Sano and Rosalind W Picard. 2013. Stress recognition using wearable sensors and mobile phones. In Affective Computing and Intelligent Interaction (ACII), 2013 Humaine Association Conference on. IEEE, 671--676.
[50]
Holger Schnädelbach, Stefan Rennick Egglestone, Stuart Reeves, Steve Benford, Brendan Walker, and Michael Wright. 2008. Performing thrill: designing telemetry systems and spectator interfaces for amusement rides. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1167--1176.
[51]
Petr Slovák, Joris Janssen, and Geraldine Fitzpatrick. 2012. Understanding heart rate sharing: towards unpacking physiosocial space. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 859--868.
[52]
Ian Smith, Sunny Consolvo, Anthony Lamarca, Jeffrey Hightower, James Scott, Timothy Sohn, Jeff Hughes, Giovanni Iachello, and Gregory D Abowd. 2005. Social disclosure of place: From location technology to communication practices. In Proceedings of the 3rd International Conference on Pervasive Computing. Springer, 134--151.
[53]
Jaime Snyder, Mark Matthews, Jacqueline Chien, Pamara F Chang, Emily Sun, Saeed Abdullah, and Geri Gay. 2015. Moodlight: Exploring personal and social implications of ambient display of biosensor data. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work 8 Social Computing. ACM, 143--153.
[54]
Mayu Sumida, Teruhiro Mizumoto, and Keiichi Yasumoto. 2013. Estimating heart rate variation during walking with smartphone. In Proceedings of the 2013 ACM International Joint conference on Pervasive and Ubiquitous Computing. ACM, 245--254.
[55]
Chiew Seng Sean Tan, Johannes Schöning, Kris Luyten, and Karin Coninx. 2014. Investigating the effects of using biofeedback as visual stress indicator during video-mediated collaboration. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 71--80.
[56]
Karen P Tang, Jialiu Lin, Jason I Hong, Daniel P Siewiorek, and Norman Sadeh. 2010. Rethinking location sharing: exploring the implications of social-driven vs. purpose-driven location sharing. In Proceedings of the 12th ACM International Conference on Ubiquitous Computing. ACM, 85--94.
[57]
Gerben A Van Kleef. 2009. How emotions regulate social life: The emotions as social information (EASI) model. Current directions in psychological science 18, 3 (2009), 184--188.
[58]
Jo Vermeulen, Lindsay MacDonald, Johannes Schöning, Russell Beale, and Sheelagh Carpendale. 2016. Heartefacts: Augmenting mobile video sharing using wrist-worn heart rate sensors. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems. ACM, 712--723.
[59]
Dhaval Vyas, Marek van de Watering, Anton Eliëns, and Gerrit van der Veer. 2007. Engineering social awareness in work environments. Universal Access in Human-Computer Interaction. Ambient Interaction (2007), 254--263.
[60]
Wouter Walmink, Danielle Wilde, and Florian’Floyd’ Mueller. 2014. Displaying heart rate data on a bicycle helmet to support social exertion experiences. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction. ACM, 97--104.
[61]
Julia Werner, Reto Wettach, and Eva Hornecker. 2008. United-pulse: feeling your partner’s pulse. In Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services. ACM, 535--538.
[62]
Jason Wiese, Patrick Gage Kelley, Lorrie Faith Cranor, Laura Dabbish, Jason I Hong, and John Zimmerman. 2011. Are you close with me? are you nearby?: investigating social groups, closeness, and willingness to share. In Proceedings of the 13th International Conference on Ubiquitous Computing. ACM, 197--206.
[63]
Svetlana Yarosh, Panos Markopoulos, and Gregory D Abowd. 2014. Towards a questionnaire for measuring affective benefits and costs of communication technologies. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work 8 Social Computing. ACM, 84--96.

Cited By

View all
  • (2024)Detecting Leadership Opportunities in Group Discussions Using Off-the-Shelf VR HeadsetsSensors10.3390/s2408253424:8(2534)Online publication date: 15-Apr-2024
  • (2024)EmoEcho: Designing Emotion Mimicry Mechanics for Enhancing Social Engagement in Digital GamesExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650864(1-6)Online publication date: 11-May-2024
  • (2024)Sharing Frissons among Online Video Viewers: Exploring the Design of Affective Communication for Aesthetic ChillsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642818(1-19)Online publication date: 11-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 1, Issue 3
September 2017
2023 pages
EISSN:2474-9567
DOI:10.1145/3139486
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 September 2017
Accepted: 01 July 2017
Received: 01 May 2017
Published in IMWUT Volume 1, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Wearable sensors
  2. experience sampling
  3. heart rate
  4. interpersonal communication
  5. physiological signals
  6. psychological states

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)174
  • Downloads (Last 6 weeks)23
Reflects downloads up to 17 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Detecting Leadership Opportunities in Group Discussions Using Off-the-Shelf VR HeadsetsSensors10.3390/s2408253424:8(2534)Online publication date: 15-Apr-2024
  • (2024)EmoEcho: Designing Emotion Mimicry Mechanics for Enhancing Social Engagement in Digital GamesExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650864(1-6)Online publication date: 11-May-2024
  • (2024)Sharing Frissons among Online Video Viewers: Exploring the Design of Affective Communication for Aesthetic ChillsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642818(1-19)Online publication date: 11-May-2024
  • (2024)AniBalloons: Animated chat balloons as affective augmentation for social messaging and chatbot interactionInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103365(103365)Online publication date: Oct-2024
  • (2023)Affective Affordance of Message Balloon Animations: An Early Exploration of AniBalloonsCompanion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing10.1145/3584931.3607017(138-143)Online publication date: 14-Oct-2023
  • (2023)Designing Reflective Derived Metrics for Fitness TrackersProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694756:4(1-19)Online publication date: 11-Jan-2023
  • (2023)Investigating the Psychological Impact of Emotion Visualization and Heart Rate Sharing in Online CommunicationDistributed, Ambient and Pervasive Interactions10.1007/978-3-031-34668-2_12(169-184)Online publication date: 9-Jul-2023
  • (2022)Keep Calm and Do Not Carry-Forward: Toward Sensor-Data Driven AI Agent to Enhance Human LearningFrontiers in Artificial Intelligence10.3389/frai.2021.7131764Online publication date: 12-Jan-2022
  • (2022)SnapPI: Understanding Everyday Use of Personal Informatics Data Stickers on Ephemeral Social MediaProceedings of the ACM on Human-Computer Interaction10.1145/35556526:CSCW2(1-27)Online publication date: 11-Nov-2022
  • (2022)Revisiting Piggyback Prototyping: Examining Benefits and Tradeoffs in Extending Existing Social Computing SystemsProceedings of the ACM on Human-Computer Interaction10.1145/35555576:CSCW2(1-28)Online publication date: 11-Nov-2022
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media