Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Enhancing Conversational Recommendation Systems with Representation Fusion

Published: 21 February 2023 Publication History

Abstract

Conversational Recommendation Systems (CRSs) aim to improve recommendation performance by utilizing information from a conversation session. A CRS first constructs questions and then asks users for their feedback in each conversation session to refine better recommendation lists to users. The key design of CRS is to construct proper questions and obtain users’ feedback in response to these questions so as to effectively capture user preferences. Many CRS works have been proposed; however, they suffer from defects when constructing questions for users to answer: (1) employing a dialogue policy agent for constructing questions is one of the most common choices in CRS, but it needs to be trained with a huge corpus, and (2) it is not appropriate that constructing questions from a single policy (e.g., a CRS only selects attributes that the user has interacted with) for all users with different preferences. To address these defects, we propose a novel CRS model, namely a Representation Fusion–based Conversational Recommendation model, where the whole conversation session is divided into two subsessions (i.e., Local Question Search subsession and Global Question Search subsession) and two different question search methods are proposed to construct questions in the corresponding subsessions without employing policy agents. In particular, in the Local Question Search subsession we adopt a novel graph mining method to find questions, where the paths in the graph between users and attributes can eliminate irrelevant attributes; in the Global Question Search subsession we propose to initialize user preference on items with the user and all item historical rating records and construct questions based on user’s preference. Then, we update the embeddings independently over the two subsessions according to user’s feedback and fuse the final embeddings from the two subsessions for the recommendation. Experiments on three real-world recommendation datasets demonstrate that our proposed method outperforms five state-of-the-art baselines.

References

[1]
Mohammad Aliannejadi, Hamed Zamani, Fabio Crestani, and W. Bruce Croft. 2019. Asking clarifying questions in open-domain information-seeking conversations. In Proceedings of the 42nd International ACM Sigir Conference on Research and Development in Information Retrieval. 475–484.
[2]
Rodrigo Alves, Antoine Ledent, and Marius Kloft. 2021. Burst-induced multi-armed bandit for learning recommendation. In Proceedings of the 15th ACM Conference on Recommender Systems. 292–301.
[3]
Martin Anthony, Peter L. Bartlett, Peter L. Bartlett, et al. 1999. Neural Network Learning: Theoretical Foundations. Vol. 9, Cambridge University Press, Cambridge.
[4]
Robert Bell, Yehuda Koren, and Chris Volinsky. 2007. Modeling relationships at multiple scales to improve accuracy of large recommender systems. In Proceedings of the 13th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 95–104.
[5]
Keping Bi, Qingyao Ai, Yongfeng Zhang, and Bruce W. Croft. 2019. Conversational product search based on negative feedback. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 359–368.
[6]
Guanzheng Chen, Jinyuan Fang, Zaiqiao Meng, Qiang Zhang, and Shangsong Liang. 2022. Multi-Relational graph representation learning with bayesian gaussian process network. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 5530–5538.
[7]
Qibin Chen, Junyang Lin, Yichang Zhang, Ming Ding, Yukuo Cen, Hongxia Yang, and Jie Tang. 2019. Towards knowledge-based recommender dialog system. In Proceedings of the Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP’19). 1803–1813.
[8]
Konstantina Christakopoulou, Alex Beutel, Rui Li, Sagar Jain, and H. Ed Chi. 2018. Q&R: A two-stage approach toward interactive recommendation. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 139–148.
[9]
Konstantina Christakopoulou, Filip Radlinski, and Katja Hofmann. 2016. Towards conversational recommender systems. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 815–824.
[10]
Chongming Gao, Wenqiang Lei, Xiangnan He, de Maarten Rijke, and Tat-Seng Chua. 2021. Advances and challenges in conversational recommender systems: A survey. AI Open 2 (2021), 100–126.
[11]
Yingqiang Ge, Shuya Zhao, Honglu Zhou, Changhua Pei, Fei Sun, Wenwu Ou, and Yongfeng Zhang. 2020. Understanding echo chambers in e-commerce recommender systems. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2261–2270.
[12]
Claudio Gentile, Shuai Li, Purushottam Kar, Alexandros Karatzoglou, Giovanni Zappella, and Evans Etrue. 2017. On context-dependent clustering of bandits. In International Conference on machine learning, PMLR, 1253–1262.
[13]
Yulong Gu, Zhuoye Ding, Shuaiqiang Wang, and Dawei Yin. 2020. Hierarchical user profiling for e-commerce recommender systems. In Proceedings of the 13th International Conference on Web Search and Data Mining. 223–231.
[14]
Maxwell F. Harper and Joseph A. Konstan. 2015. The movielens datasets: History and context. ACM Transactions on Interactive Intelligent Systems (TIIS) 5, 4 (2015), 1–19.
[15]
Claudia Hauff, Julia Kiseleva, Mark Sanderson, Hamed Zamani, and Yongfeng Zhang. 2021. Conversational search and recommendation: Introduction to the special issue. ACM Transactions on Information Systems 39, 4 (2021).
[16]
Xiangnan He and Tat-Seng Chua. 2017. Neural factorization machines for sparse predictive analytics. In Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval. 355–364.
[17]
Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, Yongdong Zhang, and Meng Wang. 2020. Lightgcn: Simplifying and powering graph convolution network for recommendation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 639–648.
[18]
Guo Huifeng, Tang Ruiming, Ye Yunming, Li Zhenguo, and He Xiuqiang. 2017. DeepFM: A factorization-machine based neural network for CTR prediction. In Proceedings of the 26th International Joint Conference on Artificial Intelligence. 1725–1731.
[19]
Andrea Iovine, Pasquale Lops, Fedelucio Narducci, Marco de Gemmis, and Giovanni Semeraro. 2021. Improving preference elicitation in a conversational recommender system with active learning strategies. In Annual ACM Symposium on Applied Computing. 1375–1382.
[20]
Dietmar Jannach, Ahtsham Manzoor, Wanling Cai, and Li Chen. 2021. A survey on conversational recommender systems. ACM Comput. Surv. (CSUR) 54, 5 (2021), 1–36.
[21]
Kalervo Järvelin and Jaana Kekäläinen. 2002. Cumulated gain-based evaluation of IR techniques. ACM Trans. Inf. Syst. (TOIS) 20, 4 (2002), 422–446.
[22]
Edwin T. Jaynes. 1982. On the rationale of maximum-entropy methods. Proc. IEEE 70, 9 (1982), 939–952.
[23]
Shaojie Jiang, Pengjie Ren, Christof Monz, and Maarten de Rijke. 2019. Improving neural response diversity with frequency-aware cross-entropy loss. In The World Wide Web Conference. 2879–2885.
[24]
Wang-Cheng Kang and Julian McAuley. 2018. Self-attentive sequential recommendation. In IEEE international Conference on Data Mining (ICDM’18). IEEE, 197–206.
[25]
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In ICLR (Poster).
[26]
Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. IEEE Comput. 42, 8 (2009), 30–37.
[27]
Wenqiang Lei, Chongming Gao, and Maarten de Rijke. 2021. RecSys 2021 tutorial on conversational recommendation: Formulation, methods, and evaluation. In Proceedings of the 15th ACM Conference on Recommender Systems. 842–844.
[28]
Wenqiang Lei, Xiangnan He, Maarten de Rijke, and Tat-Seng Chua. 2020. Conversational recommendation: Formulation, methods, and evaluation. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2425–2428.
[29]
Wenqiang Lei, Xiangnan He, Yisong Miao, Qingyun Wu, Richang Hong, Min-Yen Kan, and Tat-Seng Chua. 2020. Estimation-Action-Reflection: Towards deep interaction between conversational and recommender systems. In Proceedings of the 13th International Conference on Web Search and Data Mining. 304–312.
[30]
Wenqiang Lei, Gangyi Zhang, Xiangnan He, Yisong Miao, Xiang Wang, Liang Chen, and Tat-Seng Chua. 2020. Interactive path reasoning on graph for conversational recommendation. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2073–2083.
[31]
Dongdong Li, Zhaochun Ren, Pengjie Ren, Zhumin Chen, Miao Fan, Jun Ma, and Maarten de Rijke. 2021. Semi-Supervised variational reasoning for medical dialogue generation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 544–554.
[32]
Guohui Li, Qi Chen, Bolong Zheng, Nguyen Quoc Viet Hung, Pan Zhou, and Guanfeng Liu. 2020. Time-aspect-sentiment recommendation models based on novel similarity measure methods. ACM Trans. Web 14, 2 (2020), 1–26.
[33]
Lihong Li, Wei Chu, John Langford, and Robert E. Schapire. 2010. A contextual-bandit approach to personalized news article recommendation. In Proceedings of the 19th International Conference on World Wide Web. 661–670.
[34]
Raymond Li, Samira Ebrahimi Kahou, Hannes Schulz, Vincent Michalski, Laurent Charlin, and Chris Pal. 2018. Towards deep conversational recommendations. Advances in Neural Information Processing Systems 31 (2018).
[35]
Shijun Li, Wenqiang Lei, Qingyun Wu, Xiangnan He, Peng Jiang, and Tat-Seng Chua. 2021. Seamlessly unifying attributes and items: Conversational recommendation for cold-start users. ACM Trans Inf. Syst. 39, 4 (2021), 1–29.
[36]
Shangsong Liang, Yupeng Luo, and Zaiqiao Meng. 2021. Profiling users for question answering communities via flow-based constrained co-embedding model. ACM Trans. Inf. Syst. 40, 2 (2021), 1–38.
[37]
Shangsong Liang, Shaowei Tang, Zaiqiao Meng, and Qiang Zhang. 2022. Cross-temporal snapshot alignment for dynamic networks. IEEE Trans. Knowl. Data Eng. (2022), 1–15.
[38]
Bang Liu, Hanlin Zhang, Linglong Kong, and Di Niu. 2021. Factorizing historical user actions for next-day purchase prediction. ACM Trans. Web 16, 1 (2021), 1–26.
[39]
Zeming Liu, Haifeng Wang, Zheng-Yu Niu, Hua Wu, Wanxiang Che, and Ting Liu. 2020. Towards conversational recommendation over multi-type dialogs. In 58th Annual Meeting of the Association-For-Computational-Linguistics (Acl) Conference Location Electr Network. Assoc Computational Linguistics-Acl Location Stroudsburg, 1036–1049.
[40]
Robert Nowak. 2008. Generalized binary search. Annual Allerton Conference on Communication, Control, and Computing, 568–574.
[41]
Yaoxin Pan, Shangsong Liang, Jiaxin Ren, Zaiqiao Meng, and Qiang Zhang. 2021. Personalized, sequential, attentive, metric-aware product search. ACM Trans. Inf. Syst. 40, 2 (2021), 1–29.
[42]
Zhiqiang Pan, Fei Cai, Wanyu Chen, and Honghui Chen. 2021. Graph co-attentive session-based recommendation. ACM Trans. Inf. Syst. 40, 4 (2021), 1–31.
[43]
Jiahuan Pei, Pengjie Ren, and Maarten de Rijke. 2021. A cooperative memory network for personalized task-oriented dialogue systems with incomplete user profiles. In Proceedings of the Web Conference 2021. 1552–1561.
[44]
Dhanya Pramod and Prafulla Bafna. 2022. Conversational Recommender systems techniques, tools, acceptance, and adoption: A state of the art review. Expert Syst. Appl. (2022), 1–18.
[45]
Bilih Priyogi. 2019. Preference elicitation strategy for conversational recommender system. In Proceedings of the 12th ACM International Conference on Web Search and Data Mining. 824–825.
[46]
Filip Radlinski, Krisztian Balog, Bill Byrne, and Karthik Krishnamoorthi. 2019. Coached conversational preference elicitation: A case study in understanding movie preferences. In Proceedings of the 20th Annual SIGdial Meeting on Discourse and Dialogue. 353–360.
[47]
Matej Racinsk y. 2018. MyAnimeList dataset. Kaggle (2018).
[48]
Xuhui Ren, Hongzhi Yin, Tong Chen, Hao Wang, Zi Huang, and Kai Zheng. 2021. Learning to ask appropriate questions in conversational recommendation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 808–817.
[49]
Xuhui Ren, Hongzhi Yin, Tong Chen, Hao Wang, Nguyen Quoc Viet Hung, Zi Huang, and Xiangliang Zhang. 2020. Crsal: Conversational recommender systems with adversarial learning. ACM Trans. Inf. Syst. 38, 4 (2020), 1–40.
[50]
Steffen Rendle. 2010. Factorization machines. In 2010 IEEE International Conference on Data Mining, IEEE, 995–1000.
[51]
J. Ben Schafer, Dan Frankowski, Jon Herlocker, and Shilad Sen. 2007. Collaborative filtering recommender systems. 291–324.
[52]
Anna Sepliarskaia, Julia Kiseleva, Filip Radlinski, and Maarten de Rijke. 2018. Preference elicitation as an optimization problem. In Proceedings of the 12th ACM Conference on Recommender Systems. 172–180.
[53]
Guy Shani, David Heckerman, Ronen I. Brafman, and Craig Boutilier. 2005. An MDP-based recommender system.Journal of Machine Learning Research 6, 9 (2005).
[54]
Yueming Sun and Yi Zhang. 2018. Conversational recommender system. In Proceeding of the 41st International ACM SIGIR Conference on Research & Development in iInformation Retrieval. 235–244.
[55]
Huazheng Wang, Qingyun Wu, and Hongning Wang. 2017. Factorization bandits for interactive recommendation. In Thirty-first AAAI Conference on Artificial Intelligence.
[56]
Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019. Neural graph collaborative filtering. In Proceedings of the 42nd international ACM SIGIR Conference on Research and Development in Information Retrieval. 165–174.
[57]
Bin Wu, Zaiqiao Meng, Qiang Zhang, and Shangsong Liang. 2022. Meta-Learning helps personalized product search. In Proceedings of the ACM Web Conference 2022. 2277–2287.
[58]
Jiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He, Liang Chen, Jianxun Lian, and Xing Xie. 2021. Self-supervised graph learning for recommendation. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. 726–735.
[59]
Qingyun Wu, Naveen Iyer, and Hongning Wang. 2018. Learning contextual bandits in a non-stationary environment. In Proceeding of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 495–504.
[60]
Kerui Xu, Jingxuan Yang, Jun Xu, Sheng Gao, Jun Guo, and Ji-Rong Wen. 2021. Adapting user preference to online feedback in multi-round conversational recommendation. In Proceedings of the 14th ACM International Conference on Web Search and Data Mining. 364–372.
[61]
Tong Yu, Yilin Shen, and Hongxia Jin. 2019. A visual dialog augmented interactive recommender system. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 157–165.
[62]
Xiaofeng Yuan, Lixin Han, Subin Qian, Licai Zhu, Jun Zhu, and Hong Yan. 2021. Preliminary data-based matrix factorization approach for recommendation. Inf. Process. Manage. (2021).
[63]
Dave Zachariah, Martin Sundin, Magnus Jansson, and Saikat Chatterjee. 2012. Alternating least-squares for low-rank matrix reconstruction. IEEE Sign. Process. Lett. (2012), 231–234.
[64]
Hamed Zamani, Susan Dumais, Nick Craswell, Paul Bennett, and Gord Lueck. 2020. Generating clarifying questions for information retrieval. In WWW, 418–428.
[65]
Xiaoying Zhang, Hong Xie, Hang Li, and C.S. John Lui. 2020. Conversational contextual bandit: Algorithm and application. In Proceedings of the Web Conference 2020. 662–672.
[66]
Yongfeng Zhang, Xu Chen, Qingyao Ai, Liu Yang, and Bruce W. Croft. 2018. Towards conversational search and recommendation: System ask, user respond. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 177–186.
[67]
Chunyi Zhou, Yuanyuan Jin, Xiaoling Wang, and Yingjie Zhang. 2020. Conversational music recommendation based on bandits. In IEEE International Conference on Knowledge Graph (ICKG’20). IEEE, 41–48.
[68]
Kun Zhou, Xin Zhao, Shuqing Bian, Yuanhang Zhou, Ji-Rong Wen, and Jingsong Yu. 2020. Improving conversational recommender systems via knowledge graph based semantic fusion. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1006–1014.
[69]
Tianyu Zhu, Leilei Sun, and Guoqing Chen. 2021. Graph-based embedding smoothing for sequential recommendation. IEEE Trans. Knowl. Data Eng. 35, 1 (2021), 496–508.
[70]
Yadong Zhu, Xiliang Wang, Qing Li, Tianjun Yao, and Shangsong Liang. 2021. Botspot++: A hierarchical deep ensemble model for bots install fraud detection in mobile advertising. ACM Trans. Inf. Syst. 40, 3 (2021), 1–28.
[71]
Jie Zou and Evangelos Kanoulas. 2019. Learning to ask: Question-based sequential bayesian product search. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 369–378.
[72]
Jie Zou, Dan Li, and Evangelos Kanoulas. 2018. Technology assisted reviews: Finding the last few relevant documents by asking yes/no questions to reviewers. In Proceeding of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 949–952.
[73]
Jie Zou, Chen Yifan, and Kanoulas Evangelos. 2020. Towards question-based recommender systems. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 881–890.

Cited By

View all
  • (2024)Enhancing Graph Neural Networks via Memorized Global InformationACM Transactions on the Web10.1145/3689430Online publication date: 28-Aug-2024
  • (2024)Diversity Matters: User-Centric Multi-Interest Learning for Conversational Movie RecommendationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680909(9515-9524)Online publication date: 28-Oct-2024
  • (2024)CoBjeason: Reasoning Covered Object in Image by Multi-Agent Collaboration Based on Informed Knowledge GraphACM Transactions on Knowledge Discovery from Data10.1145/364356518:5(1-56)Online publication date: 28-Feb-2024
  • Show More Cited By

Index Terms

  1. Enhancing Conversational Recommendation Systems with Representation Fusion

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on the Web
    ACM Transactions on the Web  Volume 17, Issue 1
    February 2023
    189 pages
    ISSN:1559-1131
    EISSN:1559-114X
    DOI:10.1145/3575872
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 21 February 2023
    Online AM: 19 January 2023
    Accepted: 19 September 2022
    Revised: 23 July 2022
    Received: 30 December 2021
    Published in TWEB Volume 17, Issue 1

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Conversational Recommendation Systems
    2. interactive recommendation
    3. representation learning

    Qualifiers

    • Research-article

    Funding Sources

    • National Natural Science Foundation of China
    • MBZUAI-WIS Joint Program for Artificial Intelligence Research

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)301
    • Downloads (Last 6 weeks)21
    Reflects downloads up to 10 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Enhancing Graph Neural Networks via Memorized Global InformationACM Transactions on the Web10.1145/3689430Online publication date: 28-Aug-2024
    • (2024)Diversity Matters: User-Centric Multi-Interest Learning for Conversational Movie RecommendationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3680909(9515-9524)Online publication date: 28-Oct-2024
    • (2024)CoBjeason: Reasoning Covered Object in Image by Multi-Agent Collaboration Based on Informed Knowledge GraphACM Transactions on Knowledge Discovery from Data10.1145/364356518:5(1-56)Online publication date: 28-Feb-2024
    • (2024)Credit Card Fraud Detection via Intelligent Sampling and Self-supervised LearningACM Transactions on Intelligent Systems and Technology10.1145/364128315:2(1-29)Online publication date: 28-Mar-2024
    • (2024)Context-based Entity Recommendation for Knowledge Workers: Establishing a Benchmark on Real-life DataProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688068(654-659)Online publication date: 8-Oct-2024
    • (2024)Relevance Feedback with Brain SignalsACM Transactions on Information Systems10.1145/363787442:4(1-37)Online publication date: 9-Feb-2024
    • (2024)Evolving Knowledge Graph Representation Learning with Multiple Attention Strategies for Citation Recommendation SystemACM Transactions on Intelligent Systems and Technology10.1145/363527315:2(1-26)Online publication date: 28-Mar-2024
    • (2024)Something Just Like This: A Secret History of the Role of Analogues in Information SeekingProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638317(189-198)Online publication date: 10-Mar-2024
    • (2023)Multi-aspect Graph Contrastive Learning for Review-enhanced RecommendationACM Transactions on Information Systems10.1145/361810642:2(1-29)Online publication date: 8-Nov-2023
    • (2023)Reinforced PU-learning with Hybrid Negative Sampling Strategies for RecommendationACM Transactions on Intelligent Systems and Technology10.1145/358256214:3(1-25)Online publication date: 8-May-2023
    • Show More Cited By

    View Options

    Get Access

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media