EmoFlow: Visualizing Emotional Changes in Video Chat - Preliminary Study
Article No.: 5, Pages 1 - 7
Abstract
We propose EmoFlow, a prototype service that can recognize the emotional changes of users in video chat and provide a text-based summary along with various visualizations. We present design concepts to represent users’ emotional flow on the mobile messenger application in three types: Emoji, Color, and Shape visualizations. Through a user study with 60 voluntary participants, we found that the Emoji type received the highest score in terms of conveying emotions and design preferences. Also, 65 percent of the participants responded they are willing to use the proposed service if several points are enhanced in the future. The survey results suggest that the proposed service would help users understand and manage their emotional status.
References
[1]
Toshiki Aoki, Rintaro Chujo, Katsufumi Matsui, Saemi Choi, and Ari Hautasaari. 2022. EmoBalloon - Conveying Emotional Arousal in Text Chats with Speech Balloons. In CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3491102.3501920
[2]
Genavee Brown and Patricia M. Greenfield. 2021. Staying connected during stay-at-home: Communication with family and friends and its association with well-being. Human Behavior and Emerging Technologies 3, 1 (Jan. 2021), 147–156. https://doi.org/10.1002/hbe2.246
[3]
Qinyue Chen, Yuchun Yan, and Hyeon-Jeong Suk. 2021. Bubble Coloring to Visualize the Speech Emotion. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3411763.3451698
[4]
Roger Yat-Nork Chung and Minnie Ming Li. 2020. Anti-Chinese sentiment during the 2019-nCoV outbreak. The Lancet 395, 10225 (Feb. 2020), 686–687. https://doi.org/10.1016/s0140-6736(20)30358-5
[5]
Eylül Ertay, Hao Huang, Zhanna Sarsenbayeva, and Tilman Dingler. 2021. Challenges of Emotion Detection Using Facial Expressions and Emotion Visualisation in Remote Communication. In Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers. ACM. https://doi.org/10.1145/3460418.3479341
[6]
Helen Gilburt, Diana Rose, and Mike Slade. 2008. The importance of relationships in mental health care: A qualitative study of service users' experiences of psychiatric hospital admission in the UK. BMC Health Services Research 8, 1 (April 2008). https://doi.org/10.1186/1472-6963-8-92
[7]
Jiaxiong Hu, Qianyao Xu, Limin Paul Fu, and Yingqing Xu. 2019. Emojilization. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. ACM. https://doi.org/10.1145/3290607.3313071
[8]
Mike Krieger Kevin Systrom. 2023. Instagram. Retrieved Accessed 18-Jan-2023 from https://www.instagram.com
[9]
Stephen J. Lepore, Jennifer D. Ragan, and Scott Jones. 2000. Talking facilitates cognitive–emotional processes of adaptation to an acute stressor.Journal of Personality and Social Psychology 78, 3 (2000), 499–508. https://doi.org/10.1037/0022-3514.78.3.499
[10]
Danielle Lottridge. 2020. Insights from videochat research in the context of Covid-19. Interactions 27, 4 (July 2020), 9–10. https://doi.org/10.1145/3406104
[11]
Gaëtan Mertens, Lotte Gerritsen, Stefanie Duijndam, Elske Salemink, and Iris M. Engelhard. 2020. Fear of the coronavirus (COVID-19): Predictors in an online study conducted in March 2020. Journal of Anxiety Disorders 74 (Aug. 2020), 102258. https://doi.org/10.1016/j.janxdis.2020.102258
[12]
NAVER CLOUD PLATFORM. 2023. CLOVA Face Recognition(CFR). Retrieved Accessed 18-Jan-2023 from https://api.ncloud-docs.com/docs/ai-naver-clovafacerecognition-face
[13]
NAVER CLOUD PLATFORM. 2023. CLOVA Speech Recognition(CSR). Retrieved Accessed 18-Jan-2023 from https://api-fin.ncloud-docs.com/docs/ai-naver-clovaspeechrecognition-stt
[14]
Jordi Quoidbach, Elizabeth V. Berry, Michel Hansenne, and Moïra Mikolajczak. 2010. Positive emotion regulation and well-being: Comparing the impact of eight savoring and dampening strategies. Personality and Individual Differences 49, 5 (Oct. 2010), 368–373. https://doi.org/10.1016/j.paid.2010.03.048
[15]
Ellen Roche, Joscelin Rocha-Hidalgo, Douglas Piper, Gabrielle A. Strouse, Lucinda I. Neely, Jenna Ryu, Lauren J. Myers, Elisabeth McClure, Georgene L. Troseth, Jennifer M. Zosh, and Rachel Barr. 2022. Presence at a distance: Video chat supports intergenerational sensitivity and positive infant affect during COVID-19. Infancy 27, 6 (Aug. 2022), 1008–1031. https://doi.org/10.1111/infa.12491
[16]
Camilo Rojas, Eugenio Zuccarelli, Alexandra Chin, Gaurav Patekar, David Esquivel, and Pattie Maes. 2022. Towards Enhancing Empathy Through Emotion Augmented Remote Communication. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. ACM. https://doi.org/10.1145/3491101.3519797
[17]
Alessandro Rovetta and Akshaya Srikanth Bhagavathula. 2020. COVID-19-Related Web Search Behaviors and Infodemic Attitudes in Italy: Infodemiological Study. JMIR Public Health and Surveillance 6, 2 (May 2020), e19374. https://doi.org/10.2196/19374
[18]
Matthew T. Tull, Keith A. Edmonds, Kayla M. Scamaldo, Julia R. Richmond, Jason P. Rose, and Kim L. Gratz. 2020. Psychological Outcomes Associated with Stay-at-Home Orders and the Perceived Impact of COVID-19 on Daily Life. Psychiatry Research 289 (July 2020), 113098. https://doi.org/10.1016/j.psychres.2020.113098
[19]
Keiko Yamaguchi, Masaya Ito, and Yoshitake Takebayashi. 2018. Positive emotion in distress as a potentially effective emotion regulation strategy for depression: A preliminary investigation. Psychology and Psychotherapy: Theory, Research and Practice 91, 4 (March 2018), 509–525. https://doi.org/10.1111/papt.12176
[20]
Zihan Yan, Yufei Wu, Yang Zhang, and Xiang ’Anthony’ Chen. 2022. EmoGlass: An End-to-End AI-Enabled Wearable Platform for Enhancing Self-Awareness of Emotional Health. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 13, 19 pages. https://doi.org/10.1145/3491102.3501925
Index Terms
- EmoFlow: Visualizing Emotional Changes in Video Chat - Preliminary Study
Recommendations
Visualizing excitement of individuals and groups
EmoVis'16: Proceedings of the 2016 EmoVis Conference on Emotion and VisualizationExcitement or arousal is one of the main emotional dimensions that affects our lives on a daily basis. We win a tennis match, watch a great movie, get into an argument with a colleague—all of these are instances when most of us experience excitement, ...
Interpolating Happiness: Understanding the Intensity Gradations of Face Emojis Across Cultures
CHI '22: Proceedings of the 2022 CHI Conference on Human Factors in Computing SystemsWe frequently utilize face emojis to express emotions in digital communication. But how wholly and precisely do such pictographs sample the emotional spectrum, and are there gaps to be closed? Our research establishes emoji intensity scales for seven ...
The benefits of distance and mediation
Conflicts come as natural elements in human relationships and they are experienced in face-to-face as well as mediated interactions. Yet, it is unclear in which way and to which degree the modality of interaction influences the experience, the process, ...
Comments
Information & Contributors
Information
Published In
September 2023
256 pages
ISBN:9781450399241
DOI:10.1145/3565066
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 26 September 2023
Check for updates
Author Tags
Qualifiers
- Extended-abstract
- Research
- Refereed limited
Conference
MobileHCI '23
Sponsor:
MobileHCI '23: 25th International Conference on Mobile Human-Computer Interaction
September 26 - 29, 2023
Athens, Greece
Acceptance Rates
Overall Acceptance Rate 202 of 906 submissions, 22%
Upcoming Conference
MobileHCI '24
- Sponsor:
- sigchi
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 206Total Downloads
- Downloads (Last 12 months)206
- Downloads (Last 6 weeks)14
Reflects downloads up to 10 Sep 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format