Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3539597.3570426acmconferencesArticle/Chapter ViewAbstractPublication PageswsdmConference Proceedingsconference-collections
research-article

Variational Reasoning over Incomplete Knowledge Graphs for Conversational Recommendation

Published: 27 February 2023 Publication History

Abstract

Conversational recommender systems (CRSs) often utilize external knowledge graphs (KGs) to introduce rich semantic information and recommend relevant items through natural language dialogues. However, original KGs employed in existing CRSs are often incomplete and sparse, which limits the reasoning capability in recommendation. Moreover, only few of existing studies exploit the dialogue context to dynamically refine knowledge from KGs for better recommendation. To address the above issues, we propose the Variational Reasoning over Incomplete KGs Conversational Recommender (VRICR). Our key idea is to incorporate the large dialogue corpus naturally accompanied with CRSs to enhance the incomplete KGs; and perform dynamic knowledge reasoning conditioned on the dialogue context. Specifically, we denote the dialogue-specific subgraphs of KGs as latent variables with categorical priors for adaptive knowledge graphs refactor. We propose a variational Bayesian method to approximate posterior distributions over dialogue-specific subgraphs, which not only leverages the dialogue corpus for restructuring missing entity relations but also dynamically selects knowledge based on the dialogue context. Finally, we infuse the dialogue-specific subgraphs to decode the recommendation and responses. We conduct experiments on two benchmark CRSs datasets. Experimental results confirm the effectiveness of our proposed method.

Supplementary Material

MP4 File (WSDM23-fp0395.mp4)
Presentation video of the paper titled "Variational Reasoning over Incomplete Knowledge Graphs for Conversational Recommendation" in proceedings of WSDM' 23. Conversational recommender systems often recommend items through natural language interactions and utilize external knowledge graphs (KGs) to introduce rich semantic information. In this paper we explicitly tackle the problem of incompleteness and noise in KGs. We incorporate evidence from both dialogue corpus and original KGs to infer the dialogue-specific subgraphs of KGs. we denote the dialogue-specific subgraphs as latent variables with categorical priors for adaptive knowledge graphs refactor and propose a variational Bayesian model VRICR to approximate posterior distributions over dialogue-specific subgraphs. VRICR not only infers the missing relations of incomplete KGs but also dynamically selects relevant knowledge conditioned on the dialogue context. We conduct experiments on two benchmark datasets, which verify the effectiveness of VRICR.
MP4 File (29_wsdm2023_zhang_conversational_recommendation_01.mp4-streaming.mp4)
Variational Reasoning over Incomplete Knowledge Graphs for Conversational Recommendation

References

[1]
Antoine Bordes, Nicolas Usunier, Alberto Garcia-Durán, Jason Weston, and Oksana Yakhnenko. 2013. Translating Embeddings for Modeling Multi-relational Data. In Proceedings of NeurIPS. 2787--2795.
[2]
Yixin Cao, Xiang Wang, Xiangnan He, Zikun Hu, and Tat-Seng Chua. 2019. Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences. In Proceedings of WWW. 151--161.
[3]
Qibin Chen, Junyang Lin, Yichang Zhang, Ming Ding, Yukuo Cen, Hongxia Yang, and Jie Tang. 2019. Towards Knowledge-Based Recommender Dialog System. In Proceedings of EMNLP-IJCNLP. 1803--1813.
[4]
Wenhu Chen, Wenhan Xiong, Xifeng Yan, and William Yang Wang. 2018. Variational Knowledge Graph Reasoning. In Proceedings of NAACL-HLT. 1823--1832.
[5]
Yang Deng, Yaliang Li, Fei Sun, Bolin Ding, and Wai Lam. 2021. Unified Conversational Recommendation Policy Learning via Graph-based Reinforcement Learning. In Proceedings of SIGIR. 1431--1441.
[6]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL-HLT. 4171--4186.
[7]
Chongming Gao, Wenqiang Lei, Xiangnan He, Maarten de Rijke, and Tat-Seng Chua. 2021. Advances and challenges in conversational recommender systems: A survey. AI Open, Vol. 2 (2021), 100--126.
[8]
Matt W Gardner and SR Dorling. 1998. Artificial neural networks (the multilayer perceptron)-a review of applications in the atmospheric sciences. Atmospheric environment, Vol. 32, 14--15 (1998), 2627--2636.
[9]
Jiatao Gu, Zhengdong Lu, Hang Li, and Victor O. K. Li. 2016. Incorporating Copying Mechanism in Sequence-to-Sequence Learning. In Proceedings of ACL.
[10]
Dimitri Kartsaklis, Mohammad Taher Pilehvar, and Nigel Collier. 2018. Mapping Text to Knowledge Graph Entities using Multi-Sense LSTMs. In Proceedings of EMNLP. 1959--1970.
[11]
Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. In Proceedings of EMNLP. 1746--1751.
[12]
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In Proceedings of ICLR.
[13]
Diederik P. Kingma and Max Welling. 2014. Auto-Encoding Variational Bayes. In Proceedings of ICLR.
[14]
Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In Proceedings of ICLR.
[15]
Wenqiang Lei, Xiangnan He, Yisong Miao, Qingyun Wu, Richang Hong, Min-Yen Kan, and Tat-Seng Chua. 2020a. Estimation-Action-Reflection: Towards Deep Interaction Between Conversational and Recommender Systems. In Proceedings of WSDM. 304--312.
[16]
Wenqiang Lei, Gangyi Zhang, Xiangnan He, Yisong Miao, Xiang Wang, Liang Chen, and Tat-Seng Chua. 2020b. Interactive Path Reasoning on Graph for Conversational Recommendation. In Proceedings of KDD. 2073--2083.
[17]
Raymond Li, Samira Ebrahimi Kahou, Hannes Schulz, Vincent Michalski, Laurent Charlin, and Chris Pal. 2018. Towards Deep Conversational Recommendations. In Proceedings of NeurIPS. 9748--9758.
[18]
Shuokai Li, Ruobing Xie, Yongchun Zhu, Xiang Ao, Fuzhen Zhuang, and Qing He. 2022. User-Centric Conversational Recommendation with Multi-Aspect User Modeling. In SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022. 223--233.
[19]
Rongzhong Lian, Min Xie, Fan Wang, Jinhua Peng, and Hua Wu. 2019. Learning to Select Knowledge for Response Generation in Dialog Systems. In Proceedings of IJCAI. 5081--5087.
[20]
Zeming Liu, Haifeng Wang, Zheng-Yu Niu, Hua Wu, Wanxiang Che, and Ting Liu. 2020. Towards Conversational Recommendation over Multi-Type Dialogs. In Proceedings of ACL. 1036--1049.
[21]
Wenchang Ma, Ryuichi Takanobu, and Minlie Huang. 2021. CR-Walker: Tree-Structured Graph Reasoning and Dialog Acts for Conversational Recommendation. In Proceedings of EMNLP. 1839--1851.
[22]
Chaitanya Malaviya, Chandra Bhagavatula, Antoine Bosselut, and Yejin Choi. 2020. Commonsense Knowledge Base Completion with Structural and Semantic Context. In Proceedings of AAAI. 2925--2933.
[23]
Zhaochun Ren, Zhi Tian, Dongdong Li, Pengjie Ren, Liu Yang, Xin Xin, Huasheng Liang, Maarten de Rijke, and Zhumin Chen. 2022. Variational Reasoning about User Preferences for Conversational Recommendation. In SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022. 165--175.
[24]
Saed Rezayi, Handong Zhao, Sungchul Kim, Ryan A. Rossi, Nedim Lipka, and Sheng Li. 2021. Edge: Enriching Knowledge Graph Embeddings with External Text. In Proceedings of NAACL-HLT. 2767--2776.
[25]
Rajdeep Sarkar, Koustava Goswami, Mihael Arcan, and John P. McCrae. 2020. Suggest me a movie for tonight: Leveraging Knowledge Graphs for Conversational Recommendation. In Proceedings of COLING. 4179--4189.
[26]
Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie. 2015. AutoRec: Autoencoders Meet Collaborative Filtering. In Proceedings of WWW. 111--112.
[27]
Iulian Vlad Serban, Alessandro Sordoni, Ryan Lowe, Laurent Charlin, Joelle Pineau, Aaron C. Courville, and Yoshua Bengio. 2017. A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues. In Proceedings of AAAI. 3295--3301.
[28]
Haitian Sun, Bhuwan Dhingra, Manzil Zaheer, Kathryn Mazaitis, Ruslan Salakhutdinov, and William W. Cohen. 2018. Open Domain Question Answering Using Early Fusion of Knowledge Bases and Text. In Proceedings of EMNLP. 4231--4242.
[29]
Yueming Sun and Yi Zhang. 2018. Conversational Recommender System. In Proceedings of SIGIR. 235--244.
[30]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Proceedings of NeurIPS. 5998--6008.
[31]
Xiaolei Wang, Kun Zhou, Ji-Rong Wen, and Wayne Xin Zhao. 2022. Towards Unified Conversational Recommender Systems via Knowledge-Enhanced Prompt Learning. In KDD '22: The 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Washington, DC, USA, August 14 - 18, 2022. 1929--1937.
[32]
Zhigang Wang and Juan-Zi Li. 2016. Text-Enhanced Representation Learning for Knowledge Graph. In Proceedings of IJCAI. 1293--1299.
[33]
Bishan Yang, Wen-tau Yih, Xiaodong He, Jianfeng Gao, and Li Deng. 2015. Embedding Entities and Relations for Learning and Inference in Knowledge Bases. In Proceedings of ICLR.
[34]
Jun Zhang, Yan Yang, Chencai Chen, Liang He, and Zhou Yu. 2021. KERS: A Knowledge-Enhanced Framework for Recommendation Dialog Systems with Multiple Subgoals. In Proceedings of EMNLP. 1092--1101.
[35]
Jinfeng Zhou, Bo Wang, Ruifang He, and Yuexian Hou. 2021. CRFR: Improving Conversational Recommender Systems via Flexible Fragments Reasoning on Knowledge Graphs. In Proceedings of EMNLP. 4324--4334.
[36]
Kun Zhou, Wayne Xin Zhao, Shuqing Bian, Yuanhang Zhou, Ji-Rong Wen, and Jingsong Yu. 2020a. Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusion. In Proceedings of KDD. 1006--1014.
[37]
Kun Zhou, Yuanhang Zhou, Wayne Xin Zhao, Xiaoke Wang, and Ji-Rong Wen. 2020b. Towards Topic-Guided Conversational Recommender System. In Proceedings of COLING. 4128--4139.
[38]
Yuanhang Zhou, Kun Zhou, Wayne Xin Zhao, Cheng Wang, Peng Jiang, and He Hu. 2022. C(^2)-CRS: Coarse-to-Fine Contrastive Learning for Conversational Recommender System. In Proceedings of WSDM. 1488--1496.
[39]
Jie Zou, Evangelos Kanoulas, Pengjie Ren, Zhaochun Ren, Aixin Sun, and Cheng Long. 2022. Improving Conversational Recommender Systems via Transformer-based Sequential Modelling. In SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022. 2319--2324.

Cited By

View all
  • (2024)FairCRS: Towards User-oriented Fairness in Conversational Recommendation SystemsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688150(126-136)Online publication date: 8-Oct-2024
  • (2024)Towards Empathetic Conversational Recommender SystemsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688133(84-93)Online publication date: 8-Oct-2024
  • (2024)Broadening the View: Demonstration-augmented Prompt Learning for Conversational RecommendationProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657755(785-795)Online publication date: 10-Jul-2024
  • Show More Cited By

Index Terms

  1. Variational Reasoning over Incomplete Knowledge Graphs for Conversational Recommendation

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      WSDM '23: Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining
      February 2023
      1345 pages
      ISBN:9781450394079
      DOI:10.1145/3539597
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 27 February 2023

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. conversational recommender systems
      2. knowledge graph enhancement
      3. knowledge refinemen
      4. variational inference

      Qualifiers

      • Research-article

      Funding Sources

      • the Natural Science Foundation of Shandong Province
      • the Natural Science Foundation of China
      • Meituan
      • the Key Scientific and Technological Innovation Program of Shandong Province
      • Shandong University multidisciplinary research and innovation team of young scholars

      Conference

      WSDM '23

      Acceptance Rates

      Overall Acceptance Rate 498 of 2,863 submissions, 17%

      Upcoming Conference

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)236
      • Downloads (Last 6 weeks)39
      Reflects downloads up to 14 Oct 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)FairCRS: Towards User-oriented Fairness in Conversational Recommendation SystemsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688150(126-136)Online publication date: 8-Oct-2024
      • (2024)Towards Empathetic Conversational Recommender SystemsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688133(84-93)Online publication date: 8-Oct-2024
      • (2024)Broadening the View: Demonstration-augmented Prompt Learning for Conversational RecommendationProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657755(785-795)Online publication date: 10-Jul-2024
      • (2024)Universal Knowledge Graph EmbeddingsCompanion Proceedings of the ACM on Web Conference 202410.1145/3589335.3651978(1793-1797)Online publication date: 13-May-2024
      • (2024)Link prediction for knowledge graphs based on extended relational graph attention networksExpert Systems with Applications10.1016/j.eswa.2024.125260(125260)Online publication date: Aug-2024
      • (2024)Knowledge graph-based recommendation with knowledge noise reduction and data augmentationApplied Intelligence10.1007/s10489-024-05657-x54:21(10333-10359)Online publication date: 13-Aug-2024
      • (2024)LGCRS: LLM-Guided Representation-Enhancing for Conversational Recommender SystemArtificial Neural Networks and Machine Learning – ICANN 202410.1007/978-3-031-72356-8_6(74-88)Online publication date: 17-Sep-2024
      • (2023)KGPR: Knowledge Graph Enhanced Passage RankingProceedings of the 32nd ACM International Conference on Information and Knowledge Management10.1145/3583780.3615252(3880-3885)Online publication date: 21-Oct-2023
      • (2023)LinRec: Linear Attention Mechanism for Long-term Sequential Recommender SystemsProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591717(289-299)Online publication date: 19-Jul-2023
      • (undefined)Knowledge-Enhanced Conversational Recommendation via Transformer-based Sequential ModellingACM Transactions on Information Systems10.1145/3677376
      • Show More Cited By

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media