Sharing Heartbeat: Toward Conducting Heartrate and Speech Rhythm through Tactile Presentation of Pseudo-heartbeats
Authors: 
Mizuki Yabutani, Yuichi Mashiba, Homura Kawamura, Suzuha Harada, Keiichi ZempoAuthors Info & Claims
Mizuki Yabutani, Yuichi Mashiba, Homura Kawamura, Suzuha Harada, Keiichi ZempoAuthors Info & ClaimsArticle No.: 18, Pages 1 - 4
Abstract
Currently, the ongoing COVID-19 pandemic makes physical contact, such as handshakes, difficult. However, physical contact is effective in strengthening the bonds between people. In this study, we aim to compensate for the physical contact lost during the COVID-19 pandemic by presenting a pseudo-heartbeat through a speaker to reproduce entrainment and the synchronized state of heartbeats induced by physiological synchronization. We evaluated the effects of the device in terms of speech rhythm and heart rate. The experimental results showed that a presentation of 80 BPM significantly reduced the difference in heart rate between the two participants, bringing them closer to a synchronized heart rate state. The heart rates of participants were significantly lower when 45 BPM and 80 BPM were presented than when no stimulus was given. Furthermore, when 45 BPM was presented, the silent periods between conversations were significantly more extended than when no stimulus was given. This result indicates that this device can intentionally create the entrainment phenomenon and a synchronized heart rate state, thereby producing the same effect of physical contact communication without contact.
References
[1]
2011. Association between interoception and empathy: Evidence from heartbeat-evoked brain potential. International Journal of Psychophysiology 79, 2 (2011), 259–265.
[2]
Rick Baaren, Rob Holland, Bregje Steenaert, and Ad Knippenberg. 2003. Mimicry for money: Behavioral consequences of imitation. Journal of Experimental Social Psychology 39 (07 2003), 393–398. https://doi.org/10.1016/S0022-1031(03)00014-3
[3]
J. Bailenson and N. Yee. 2005. Digital chameleons: Automatic assimilation of nonverbal gestures in immersive virtual environments. Psychological Science 16 (01 2005), 814–819.
[4]
Dale Barr and Boaz Keysar. 2006. Chapter 23. Perspective Taking and the Coordination of Meaning in Language Use. 901–938. https://doi.org/10.1016/B978-012369374-7/50024-9
[5]
Sara Bögels, Marisa Casillas, and Stephen C. Levinson. 2018. Planning versus comprehension in turn-taking: Fast responders show reduced anticipatory processing of the question. Neuropsychologia 109(2018), 295–310.
[6]
Sara Bögels, Lilla Magyari, and Stephen C Levinson. 2015. Neural signatures of response planning occur midway through an incoming question in conversation. Scientific reports 5, 1 (2015), 1–11.
[7]
Angela Chang, M. Sile O’Modhrain, Robert J. K. Jacob, Eric Gunther, and Hiroshi Ishii. 2002. ComTouch: design of a vibrotactile communication device. In DIS ’02.
[8]
Tanya L Chartrand and John A Bargh. 1999. The chameleon effect: the perception–behavior link and social interaction.Journal of personality and social psychology 76, 6(1999), 893–910.
[9]
Jonas Chatel-Goldman, Marco Congedo, Christian Jutten, and jean-luc Schwartz. 2014. Touch increases autonomic coupling between romantic partners. Frontiers in behavioral neuroscience 8 (03 2014), 95. https://doi.org/10.3389/fnbeh.2014.00095
[10]
Jonas Chatel-Goldman, Marco Congedo, Christian Jutten, and jean-luc Schwartz. 2014. Touch increases autonomic coupling between romantic partners. Frontiers in behavioral neuroscience 8 (03 2014), 95. https://doi.org/10.3389/fnbeh.2014.00095
[11]
Adrian David Cheok and Emma Yann Zhang. 2019. Kissenger: Transmitting Kiss Through the Internet. Human–Robot Intimate Relationships(2019).
[12]
Kyung Yun Choi and Hiroshi Ishii. 2020. ambienBeat: Wrist-worn Mobile Tactile Biofeedback for Heart Rate Rhythmic Regulation. 17–30. https://doi.org/10.1145/3374920.3374938
[13]
Martin Clayton. 2012. What is Entrainment? Definition and applications in musical research. Empirical Musicology Review 7 (2012), 49–56.
[14]
Martin Clayton, Rebecca Darlene Sager, and Udo Will. 2004. The concept of entrainment and its significance for ethnomusicology.
[15]
Jason R. Franz, Carrie A. Francis, Matthew S. Allen, and Darryl G. Thelen. 2017. Visuomotor Entrainment and the Frequency-Dependent Response of Walking Balance to Perturbations. IEEE Transactions on Neural Systems and Rehabilitation Engineering 25, 8(2017), 1135–1142. https://doi.org/10.1109/TNSRE.2016.2603340
[16]
Gijs Huisman. 2017. Social Touch Technology: A Survey of Haptic Technology for Social Touch. IEEE Transactions on Haptics PP (01 2017), 1–1. https://doi.org/10.1109/TOH.2017.2650221
[17]
Masahiro Kawasaki, Yohei Yamada, Yosuke Ushiku, Eri Miyauchi, and Yoko Yamaguchi. 2013. Inter-brain synchronization during coordination of speech rhythm in human-to-human social interaction. Scientific reports 3 (04 2013), 1692. https://doi.org/10.1038/srep01692
[18]
Kaiko Kuwamura, Kurima Sakai, Takashi Minato, Shuichi Nishio, and Hiroshi Ishiguro. 2013. Hugvie: A medium that fosters love. 2013 IEEE RO-MAN (2013), 70–75.
[19]
Stephen C Levinson. 2016. Turn-taking in human communication–origins and implications for language processing. Trends in cognitive sciences 20, 1 (2016), 6–14.
[20]
Lilla Magyari, Marcel CM Bastiaansen, Jan P De Ruiter, and Stephen C Levinson. 2014. Early anticipation lies behind the speed of response in conversation. Journal of Cognitive Neuroscience 26, 11 (2014), 2530–2539.
[21]
Therese Connell Meehan. 1998. Therapeutic touch as a nursing intervention.Journal of advanced nursing 28 1 (1998), 117–25.
[22]
Panagiotis Mitkidis, John McGraw, Andreas Roepstorff, and Sebastian Wallot. 2015. Building Trust: Heart Rate Synchrony and Arousal During Joint Action Increased by Public Goods Game. Physiology & Behavior (06 2015), 101–106. https://doi.org/10.1016/j.physbeh.2015.05.033
[23]
Toshio Mori and Shoichi Kai. 2002. Noise-induced entrainment and stochastic resonance in human brain waves.Physical review letters 88 21 (2002), 218101.
[24]
Narihiro Nishimura, Asuka Ishi, Michi Sato, Shogo Fukushima, and Hiroyuki Kajimoto. 2012. Facilitation of Affection by Tactile Feedback of False Heratbeat. In CHI ’12 Extended Abstracts on Human Factors in Computing Systems (Austin, Texas, USA) (CHI EA ’12). Association for Computing Machinery, New York, NY, USA, 2321–2326. https://doi.org/10.1145/2212776.2223796
[25]
Jessica Phillips-Silver, C. Athena Aktipis, and Gregory A. Bryant. 2010. The ecology of entrainment: Foundations of coordinated rhythmic movement.Music perception 28 1(2010), 3–14.
[26]
Jessica Phillips-Silver and Peter E. Keller. 2012. Searching for Roots of Entrainment and Joint Action in Early Musical Interactions. Frontiers in Human Neuroscience 6 (2012).
[27]
Michael J. Richardson, Kerry L. Marsh, Robert W. Isenhower, Justin R L Goodman, and Richard C. Schmidt. 2007. Rocking together: dynamics of intentional and unintentional interpersonal coordination.Human movement science 26 6 (2007), 867–91.
[28]
Maya Rossignac-Milon, Niall Bolger, Katherine S. Zee, Erica J. Boothby, and Edward Tory Higgins. 2020. Merged minds: Generalized shared reality in dyadic relationships.Journal of personality and social psychology (2020).
[29]
Carsten Schäfer, Michael Rosenblum, Jürgen Kurths, and H H Abel. 1998. Heartbeat synchronized with ventilation. Nature 392(1998), 239–240.
[30]
H. Seidel and H. herzel. 1998. Analyzing entrainment of heartbeat and respiration with surrogates. IEEE Engineering in Medicine and Biology Magazine 17, 6 (1998), 54–57. https://doi.org/10.1109/51.731321
[31]
Michihiro Shimada, Kazunori Yamauchi, Takashi Minato, Hiroshi Ishiguro, and Shoji Itakura. 2008. Studying the influence of the chameleon effect on humans using an android. 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems (2008), 767–772.
[32]
Heather Stokes, Jessica Thompson, and Jason Franz. 2017. The Neuromuscular Origins of Kinematic Variability during Perturbed Walking. Nature: Scientific Reports 7 (11 2017). https://doi.org/10.1038/s41598-017-00942-x
[33]
Emma M. Templeton, Luke J. Chang, Elizabeth A. Reynolds, Marie D. Cone LeBeaumont, and Thalia Wheatley. 2022. Fast response times signal social connection in conversation. Proceedings of the National Academy of Sciences of the United States of America 119(2022).
[34]
Alexander Toet. 2015. Social Touch in Human–Computer Interaction. Frontiers in Digital Humanities 2 (05 2015), 1–13. https://doi.org/10.3389/fdigh.2015.00002
[35]
Stuart Valins. 1966. Cognitive effects of false heart-rate feedback.Journal of personality and social psychology 4 4 (1966), 400–8.
[36]
Scott Wiltermuth and Chip Heath. 2009. Synchrony and Cooperation. Psychological science 20 (02 2009), 1–5. https://doi.org/10.1111/j.1467-9280.2008.02253.x
Index Terms
- Sharing Heartbeat: Toward Conducting Heartrate and Speech Rhythm through Tactile Presentation of Pseudo-heartbeats
Recommendations
A noninvasive heartbeat, respiration, and body movement monitoring system for neonates
Long-term monitoring of heart rate, respiratory rate, and body movement in neonates would be useful for preventing illnesses, such as respiratory disorders. However, currently, there is no noninvasive monitoring system available for neonates. Therefore, ...
Electronic Stethoscope for Heartbeat Abnormality Detection
Smart Computing and CommunicationAbstractCardiovascular diseases (CVD) are one of the main causes of death and disability in most countries of the world. However, most countries do not currently have a comprehensive mass identification of risk factors and an overall assessment of the ...
A deep convolutional neural network model to classify heartbeats
The electrocardiogram (ECG) is a standard test used to monitor the activity of the heart. Many cardiac abnormalities will be manifested in the ECG including arrhythmia which is a general term that refers to an abnormal heart rhythm. The basis of ...
Comments
Information & Contributors
Information
Published In
October 2022
413 pages
ISBN:9781450393218
DOI:10.1145/3526114
Copyright © 2022 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 28 October 2022
Check for updates
Author Tags
Qualifiers
- Poster
- Research
- Refereed limited
Conference
UIST '22: The 35th Annual ACM Symposium on User Interface Software and Technology
October 29 - November 2, 2022
OR, Bend, USA
Acceptance Rates
Overall Acceptance Rate 842 of 3,967 submissions, 21%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 143Total Downloads
- Downloads (Last 12 months)42
- Downloads (Last 6 weeks)4
Reflects downloads up to 06 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format