SCBG: Semantic-Constrained Bidirectional Generation for Emotional Support Conversation
Authors: 
Yangyang Xu, Zhuoer Zhao, Xiao SunAuthors Info & Claims
Yangyang Xu, Zhuoer Zhao, Xiao SunAuthors Info & ClaimsArticle No.: 101, Pages 1 - 17
Abstract
The Emotional Support Conversation (ESC) task aims to deliver consolation, encouragement, and advice to individuals undergoing emotional distress, thereby assisting them in overcoming difficulties. In the context of emotional support dialogue systems, it is of utmost importance to generate user-relevant and diverse responses. However, previous methods failed to take into account these crucial aspects, resulting in a tendency to produce universal and safe responses (e.g., “I do not know” and “I am sorry to hear that”). To tackle this challenge, a semantic-constrained bidirectional generation (SCBG) framework is utilized for generating more diverse and user-relevant responses. Specifically, we commence by selecting keywords that encapsulate the ongoing dialogue topics based on the context. Subsequently, a bidirectional generator generates responses incorporating these keywords. Two distinct methodologies, namely, statistics-based and prompt-based methods, are employed for keyword extraction. Experimental results on the ESConv dataset demonstrate that the proposed SCBG framework improves response diversity and user relevance while ensuring response quality.
References
[1]
Maherus Anastasiia and Tetyana Korotyeva. 2022. A chatbot of a person’s emotional state using a neural network. In Proceedings of the IEEE 17th International Conference on Computer Sciences and Information Technologies (CSIT’22). IEEE, 13–16.
[2]
Kamil Bennani-Smires, Claudiu Musat, Andreea Hossmann, Michael Baeriswyl, and Martin Jaggi. 2018. Simple unsupervised keyphrase extraction using sentence embeddings. In Proceedings of the 22nd Conference on Computational Natural Language Learning. 221–229.
[3]
David M. Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet allocation. J. Mach. Learn. Res. 3, Jan. (2003), 993–1022.
[4]
Antoine Bosselut, Hannah Rashkin, Maarten Sap, Chaitanya Malaviya, Asli Celikyilmaz, and Yejin Choi. 2019. COMET: Commonsense transformers for automatic knowledge graph construction. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 4762–4779.
[5]
Florian Boudin. 2018. Unsupervised keyphrase extraction with multipartite graphs. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 667–672.
[6]
Sergey Brin and Lawrence Page. 1998. The anatomy of a large-scale hypertextual web search engine. Comput. Netw. ISDN Syst. 30, 1-7 (1998), 107–117.
[7]
Ricardo Campos, Vítor Mangaravite, Arian Pasquali, Alípio Mário Jorge, Célia Nunes, and Adam Jatowt. 2018. A text feature based automatic keyword extraction method for single documents. In Proceedings of the European Conference on Information Retrieval. Springer, 684–691.
[8]
Yun-Nung Chen, Asli Celikyilmaz, and Dilek Hakkani-Tur. 2017. Deep learning for dialogue systems. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. 8–14.
[9]
Yi Cheng, Wenge Liu, Wenjie Li, Jiashuo Wang, Ruihui Zhao, Bang Liu, Xiaodan Liang, and Yefeng Zheng. 2022. Improving multi-turn emotional support dialogue generation with lookahead strategy planning. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 3014–3026.
[10]
Hamidreza Chinaei and Brahim Chaib-draa. 2014. Dialogue strategy learning in healthcare: A systematic approach for learning dialogue models from data. In Proceedings of the 5th Workshop on Speech and Language Processing for Assistive Technologies. 13–19.
[11]
Kenneth Church and Patrick Hanks. 1990. Word association norms, mutual information, and lexicography. Computat. Ling. 16, 1 (1990), 22–29.
[12]
Sheldon Cohen and Thomas A. Wills. 1985. Stress, social support, and the buffering hypothesis. Psychol. Bull. 98, 2 (1985), 310.
[13]
Tianyu Gao, Adam Fisch, and Danqi Chen. 2021. Making pre-trained language models better few-shot learners. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. 3816–3830.
[14]
Kazi Saidul Hasan and Vincent Ng. 2014. Automatic keyphrase extraction: A survey of the state of the art. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics. 1262–1273.
[15]
Yu-Cian Huang, Edwinn Gamborino, Yan-Jia Huang, Xiaobei Qian, Li-Chen Fu, and Su-Ling Yeh. 2022. Inferring stressors from conversation: Towards an emotional support robot companion. Int. J. Soc. Robot. 14, 7 (2022), 1657–1671.
[16]
Chien-Hao Kao, Chih-Chieh Chen, and Yu-Tza Tsai. 2019. Model of multi-turn dialogue in emotional chatbot. In Proceedings of the International Conference on Technologies and Applications of Artificial Intelligence (TAAI’19). IEEE, 1–5.
[17]
Jingyuan Li and Xiao Sun. 2018. A syntactically constrained bidirectional-asynchronous approach for emotional conversation generation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 678–683.
[18]
Xiang Lisa Li and Percy Liang. 2021. Prefix-tuning: Optimizing continuous prompts for generation. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. 4582–4597.
[19]
Mingming Liu, Qicheng Ding, Yu Zhang, Guoguang Zhao, Changjian Hu, Jiangtao Gong, Penghui Xu, Yu Zhang, Liuxin Zhang, and Qianying Wang. 2020. Cold comfort matters—How channel-wise emotional strategies help in a customer service chatbot. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–7.
[20]
Siyang Liu, Chujie Zheng, Orianna Demasi, Sahand Sabour, Yu Li, Zhou Yu, Yong Jiang, and Minlie Huang. 2021. Towards emotional support dialog systems. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. 3469–3483.
[21]
Zhiyuan Liu, Peng Li, Yabin Zheng, and Maosong Sun. 2009. Clustering to find exemplar terms for keyphrase extraction. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 257–266.
[22]
Jingbo Meng and Yue Dai. 2021. Emotional support from AI chatbots: Should a supportive partner self-disclose or not? J. Comput.-mediat. Commun. 26, 4 (2021), 207–222.
[23]
Lili Mou, Yiping Song, Rui Yan, Ge Li, Lu Zhang, and Zhi Jin. 2016. Sequence to backward and forward sequences: A content-introducing approach to generative short-text conversation. In Proceedings of the 26th International Conference on Computational Linguistics (COLING’16). 3349–3358.
[24]
Eirini Papagiannopoulou and Grigorios Tsoumakas. 2018. Local word vectors guiding keyphrase extraction. Inf. Process. Manag. 54, 6 (2018), 888–902.
[25]
Eirini Papagiannopoulou and Grigorios Tsoumakas. 2020. A review of keyphrase extraction. Wiley Interdiscip. Rev.: Data Min. Knowl. Discov. 10, 2 (2020), e1339.
[26]
Wei Peng, Yue Hu, Luxi Xing, Yuqiang Xie, Yajing Sun, and Yunpeng Li. 2022. Control globally, understand locally: A global-to-local hierarchical graph network for emotional support conversation. In Proceedings of the 31st International Joint Conference on Artificial Intelligence (IJCAI’22). 4324–4330.
[27]
Wei Peng, Ziyuan Qin, Yue Hu, Yuqiang Xie, and Yunpeng Li. 2023. FADO: Feedback-aware double controlling network for emotional support conversation. Knowl.-based Syst. 264 (2023), 110340.
[28]
Yehong Peng, Yizhen Fang, Zhiwen Xie, and Guangyou Zhou. 2019. Topic-enhanced emotional conversation generation with attention mechanism. Knowl.-based Syst. 163 (2019), 429–437.
[29]
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res. 21, 1 (2020), 5485–5551.
[30]
Stephen A. Rains, Corey A. Pavlich, Bethany Lutovsky, Eric Tsetsi, and Anjali Ashtaputre. 2020. Support seeker expectations, support message quality, and supportive interaction processes and outcomes: The case of the comforting computer program revisited. J. Soc. Person. Relation. 37, 2 (2020), 647–666.
[31]
Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Eric Michael Smith, Y-Lan Boureau and Jason Weston. 2021. Recipes for building an open-domain chatbot. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics. 300–325.
[32]
Maarten Sap, Ronan Le Bras, Emily Allaway, Chandra Bhagavatula, Nicholas Lourie, Hannah Rashkin, Brendan Roof, Noah A. Smith, and Yejin Choi. 2019. ATOMIC: An atlas of machine commonsense for if-then reasoning. In Proceedings of the AAAI Conference on Artificial Intelligence. 3027–3035.
[33]
Shuangyong Song, Chao Wang, Haiqing Chen, and Huan Chen. 2021. An emotional comfort framework for improving user satisfaction in E-commerce customer service chatbots. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 130–137.
[34]
Xiao Sun, Jia Li, Xing Wei, Changliang Li, and Jianhua Tao. 2019. Emotional conversation generation based on a Bayesian deep neural network. ACM Trans. Inf. Syst. 38, 1 (2019), 1–24.
[35]
Quan Tu, Yanran Li, Jianwei Cui, Bin Wang, Ji-Rong Wen, and Rui Yan. 2022. MISC: A mixed strategy-aware model integrating COMET for emotional support conversation. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics. 308–319.
[36]
Tsung-Hsien Wen, David Vandyke, Nikola Mrkšić, Milica Gasic, Lina M. Rojas Barahona, Pei-Hao Su, Stefan Ultes, and Steve Young. 2017. A network-based end-to-end trainable task-oriented dialogue system. In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics. 438–449.
[37]
Lili Yao, Yaoyuan Zhang, Yansong Feng, Dongyan Zhao, and Rui Yan. 2017. Towards implicit content-introducing for generative short-text conversation systems. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. 2190–2199.
[38]
Yang Yu and Vincent Ng. 2018. WikiRank: Improving keyphrase extraction based on background knowledge. arXiv preprint arXiv:1803.09000 (2018).
[39]
Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, and William B. Dolan. 2020. DIALOGPT: Large-scale generative pre-training for conversational response generation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 270–278.
[40]
Tiancheng Zhao and Maxine Eskenazi. 2016. Towards end-to-end learning for dialog state tracking and management using deep reinforcement learning. In Proceedings of the 17th Annual Meeting of the Special Interest Group on Discourse and Dialogue. 1–10.
[41]
Guangyou Zhou, Yizhen Fang, Yehong Peng, and Jiaheng Lu. 2019. Neural conversation generation with auxiliary emotional supervised models. ACM Trans. Asian Low-resour. Lang. Inf. Process. 19, 2 (2019), 1–17.
[42]
Hao Zhou, Minlie Huang, Tianyang Zhang, Xiaoyan Zhu, and Bing Liu. 2018. Emotional chatting machine: Emotional conversation generation with internal and external memory. In Proceedings of the AAAI Conference on Artificial Intelligence.
[43]
Jinfeng Zhou, Zhuang Chen, Bo Wang, and Minlie Huang. 2023. Facilitating multi-turn emotional support conversation with positive emotion elicitation: A reinforcement learning approach. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics. 1714–1729.
Index Terms
- SCBG: Semantic-Constrained Bidirectional Generation for Emotional Support Conversation
Recommendations
Multi-modal Multi-emotion Emotional Support Conversation
Advanced Data Mining and ApplicationsAbstractThis paper proposes a new task of Multi-modal Multi-emotion Emotional Support Conversation (MMESC), which has great value in various applications, such as counseling, daily chatting, and elderly company. This task aims to fully perceive the users’ ...
Leveraging hierarchical semantic‐emotional memory in emotional conversation generation
AbstractHandling emotions in human‐computer dialogues has emerged as a challenging task which requires artificial intelligence systems to generate emotional responses by jointly perceiving the emotion involved in the input posts and incorporating it into ...
ARIEL: Brain-Computer Interfaces meet Large Language Models for Emotional Support Conversation
UMAP Adjunct '24: Adjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and PersonalizationIn an era characterized by unprecedented virtual connectivity, paradoxically, individuals often find themselves disconnected from genuine human interactions. The advent of remote working arrangements, compounded by the influence of digital communication ...
Comments
Information & Contributors
Information
Published In
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 26 June 2024
Online AM: 27 May 2024
Accepted: 21 May 2024
Revised: 03 March 2024
Received: 22 September 2023
Published in TALLIP Volume 23, Issue 7
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- National Key R&D Programme of China
- Major Project of Anhui Province
- General Programmer of the National Natural Science Foundation of China
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 121Total Downloads
- Downloads (Last 12 months)121
- Downloads (Last 6 weeks)14
Reflects downloads up to 09 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in