poster

CURHAT: Telling Your Story to a Multimodal Conversation Bot to Alleviating the Stress Caused by Pandemic Fatigue

Authors:

Rafiandi Ammar Putra,

Irsyad Musyaffa,

Auzi Asfarian,

Dean Apriana RamadhanAuthors Info & Claims

Asian CHI '21: Proceedings of the Asian CHI Symposium 2021

Pages 177 - 179

https://doi.org/10.1145/3429360.3468206

Published: 07 September 2021 Publication History

Get Access

Abstract

This study aims to generate a design concept of a multimodal conversation bot to help people who have difficulty confiding in others or their family, especially during the Covid-19 pandemic. We design interactions to help these people express their problem while relieving the stress they experience. We design the concept by involving five participants aged 19-25 years through the design thinking process: empathy, define, idea, prototype, and test. From this process, we generate a multimodal conversation bot that will listen and respond to user story to alleviating the stress caused by pandemic (pandemic fatigue). We present three main interactions mode of conversation: chat-based, voice-based, and holographic avatar. Based on testing, participants gave positive feedback on the prototype we made. Further study is needed to measure the psychological benefits of the application to the user.

References

[1]

Kate Cavanagh and David A Shapiro. 2004. Computer treatment for common mental health problems. Journal of clinical psychology 60, 3 (2004), 239–251.

Crossref

Google Scholar

[2]

Richard C Davis, T Scott Saponas, Michael Shilman, and James A Landay. 2007. SketchWizard: Wizard of Oz prototyping of pen-based user interfaces. In Proceedings of the 20th annual ACM symposium on User interface software and technology. 119–128.

Digital Library

Google Scholar

[3]

Kathleen Kara Fitzpatrick, Alison Darcy, and Molly Vierhile. 2017. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR mental health 4, 2 (2017), e19.

Google Scholar

[4]

Wall Street Journal. 2020. Pandemic Fatigue Is Real—And It’s Spreading: Collective exhaustion with coronavirus restrictions has emerged as a formidable adversary for governments. Retrieved February, 25th 2021 from https://www.wsj.com/articles/pandemic-fatigue-is-realand-its-spreading-11603704601

Google Scholar

[5]

Michael Lewrick, Patrick Link, and Larry Leifer. 2018. The design thinking playbook: Mindful digital transformation of teams, products, services, businesses and ecosystems. John Wiley & Sons.

Google Scholar

[6]

Hario Megatsari, Agung Dwi Laksono, Mursyidul Ibad, Yeni Tri Herwanto, Kinanty Putri Sarweni, Rachmad Ardiansyah Pua Geno, and Estiningtyas Nugraheni. 2020. The community psychosocial burden during the COVID-19 pandemic in Indonesia. Heliyon 6, 10 (2020), e05136.

Crossref

Google Scholar

[7]

Wahyu Eka Prasetyaningtyas, Wa Ode Lili Andriani Nasri, and Berru Amalianita. 2020. Self-report on the occurrence of insomnia and the habit of taking multivitamins against academic stress among students in the early period of COVID-19 pandemic. Konselor 9, 2 (2020), 81–94.

Crossref

Google Scholar

[8]

Michael L Slepian and James N Kirby. 2018. To whom do we confide our secrets?Personality and Social Psychology Bulletin 44, 7 (2018), 1008–1023.

Google Scholar

Cited By

View all

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
Lim YJang JKim SJoe BShin SJung M(2024)A Korean Multimodal Dialogue System Across Multiple User Interfaces2024 15th International Conference on Information and Communication Technology Convergence (ICTC)10.1109/ICTC62082.2024.10827698(1363-1366)Online publication date: 16-Oct-2024
https://doi.org/10.1109/ICTC62082.2024.10827698
Pamparau CCostea AJurchis RVatavu ROpre A(2022)Experimental Evaluation of Implicit and Explicit Learning of Abstract Regularities Following Socio-Emotional Interactions in Mixed Reality2022 International Conference on Development and Application Systems (DAS)10.1109/DAS54948.2022.9786218(150-154)Online publication date: 26-May-2022
https://doi.org/10.1109/DAS54948.2022.9786218

Recommendations

Evaluation of spoken multimodal conversation
ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

Spoken multimodal dialogue systems in which users address face-only or embodied interface agents have been gaining ground in research for some time. Although most systems are still strictly task-oriented, the field is now moving towards domain-oriented ...
Media inequality in conversation: how people behave differently when interacting with computers and people
CHI '03: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

How is interacting with computer programs different from interacting with people? One answer in the literature is that these two types of interactions are similar. The present study challenges this perspective with a laboratory experiment grounded in ...
Grounding and turn-taking in multimodal multiparty conversation
HCI'13: Proceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IV

This study explores the empirical basis for multimodal conversation control acts. Applying conversation analysis as an exploratory approach, we attempt to illuminate the control functions of paralinguistic behaviors in managing multiparty conversation. ...

Comments

Information & Contributors

Information

Published In

Asian CHI '21: Proceedings of the Asian CHI Symposium 2021

May 2021

228 pages

ISBN:9781450382038

DOI:10.1145/3429360

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2021

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Conference

CHI '21

Sponsor:

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
159
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rashik MJasim MKucher KSarvghad AMahyar N(2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661563
Lim YJang JKim SJoe BShin SJung M(2024)A Korean Multimodal Dialogue System Across Multiple User Interfaces2024 15th International Conference on Information and Communication Technology Convergence (ICTC)10.1109/ICTC62082.2024.10827698(1363-1366)Online publication date: 16-Oct-2024
https://doi.org/10.1109/ICTC62082.2024.10827698
Pamparau CCostea AJurchis RVatavu ROpre A(2022)Experimental Evaluation of Implicit and Explicit Learning of Abstract Regularities Following Socio-Emotional Interactions in Mixed Reality2022 International Conference on Development and Application Systems (DAS)10.1109/DAS54948.2022.9786218(150-154)Online publication date: 26-May-2022
https://doi.org/10.1109/DAS54948.2022.9786218

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Recommendations

Evaluation of spoken multimodal conversation

Media inequality in conversation: how people behave differently when interacting with computers and people

Grounding and turn-taking in multimodal multiparty conversation

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations