Just Accepted
TCGC: Temporal Collaboration-Aware Graph Co-Evolution Learning for Dynamic Recommendation
Abstract
Dynamic recommendation systems, where users interact with items continuously over time, have been widely deployed in real-world online streaming applications. The burst of interaction stream causes a rapid evolution of both users and items. To update representations dynamically, existing studies have investigated event-level and history-level dynamics by modeling the newly-arrived interactions and aggregating historical interactions, respectively. However, most of them directly learn the representation evolution as new interactions occur, without exploring the collaboration between the newly-arrived and historical interactions, thus failing to scrutinize whether those new interactions would benefit the evolution learning process when generating dynamic representations. Moreover, most of them model the two levels of dynamics independently, explicitly ignoring the inherent co-evolving correlation between them. In this work, we propose the Temporal Collaboration-Aware Graph Co-Evolution Learning (TCGC) for the dynamic recommendation scenario. First, we explore the effectiveness of collaborative information and devise the collaboration-aware indicator to guide the evolution learning process. Second, we design a temporal co-evolving graph network, enabling our framework to capture the correlation between event and history dynamics. Third, we leverage the evolution task and recommendation task together for joint training. Extensive experiments on four public datasets demonstrate the superiority and effectiveness of our proposed TCGC.
References
[1]
Qijie Bai, Changli Nie, Haiwei Zhang, Dongming Zhao, and Xiaojie Yuan. 2023. HGWaveNet: A Hyperbolic Graph Neural Network for Temporal Link Prediction. In WWW ’23. 523–532.
[2]
Alex Beutel, Paul Covington, Sagar Jain, Can Xu, Jia Li, Vince Gatto, and Ed H. Chi. 2018. Latent Cross: Making Use of Context in Recurrent Recommender Systems. In WSDM ’18. 46–54.
[3]
Shaked Brody, Uri Alon, and Eran Yahav. 2022. How Attentive are Graph Attention Networks?. In ICLR’ 22.
[4]
Desheng Cai, Shengsheng Qian, Quan Fang, Jun Hu, and Changsheng Xu. 2023. User Cold-Start Recommendation via Inductive Heterogeneous Graph Neural Network. ACM Trans. Inf. Syst. 41, 3, Article 64 (2023), 27 pages.
[5]
Guohao Cai, Jieming Zhu, Quanyu Dai, Zhenhua Dong, Xiuqiang He, Ruiming Tang, and Rui Zhang. 2022. ReLoop: A Self-Correction Continual Learning Loop for Recommender Systems. In SIGIR ’22. 2692–2697.
[6]
Xuheng Cai, Lianghao Xia, Xubin Ren, and Chao Huang. 2023. How Expressive are Graph Neural Networks in Recommendation?. In CIKM ’23. 173–182.
[7]
Yuwei Cao, Liangwei Yang, Chen Wang, Zhiwei Liu, Hao Peng, Chenyu You, and Philip S. Yu. 2023. Multi-task Item-attribute Graph Pre-training for Strict Cold-start Item Recommendation. In RecSys ’23. 322–333.
[8]
Jianxin Chang, Chen Gao, Yu Zheng, Yiqun Hui, Yanan Niu, Yang Song, Depeng Jin, and Yong Li. 2021. Sequential Recommendation with Graph Neural Networks. In SIGIR’ 21. 378–387.
[9]
Haokun Chen, Xinyi Dai, Han Cai, Weinan Zhang, Xuejian Wang, Ruiming Tang, Yuzhou Zhang, and Yong Yu. 2019. Large-scale interactive recommendation with tree-structured policy gradient. In AAAI ’19, Vol. 33. 3312–3320.
[10]
Huidi Chen, Yun Xiong, Yangyong Zhu, and Philip S. Yu. 2021. Highly Liquid Temporal Interaction Graph Embeddings. In WWW’ 21. 1639–1648.
[11]
Hanjun Dai, Yichen Wang, Rakshit Trivedi, and Le Song. 2017. Deep Coevolutionary Network: Embedding User and Item Features for Recommendation. arXiv preprint arXiv:1609.03675 (2017).
[12]
Yang Deng, Yaliang Li, Bolin Ding, and Wai Lam. 2023. Leveraging Long Short-Term User Preference in Conversational Recommendation via Multi-agent Reinforcement Learning. IEEE Transactions on Knowledge and Data Engineering 35, 11 (2023), 11541–11555.
[13]
Chengxin Ding, Zhongying Zhao, Chao Li, Yanwei Yu, and Qingtian Zeng. 2023. Session-based recommendation with hypergraph convolutional networks and sequential information embeddings. Expert Systems with Applications 223 (2023), 119875.
[14]
Wenqi Fan, Xiaorui Liu, Wei Jin, Xiangyu Zhao, Jiliang Tang, and Qing Li. 2022. Graph Trend Filtering Networks for Recommendation. In SIGIR ’22. 112–121.
[15]
Ziwei Fan, Zhiwei Liu, Jiawei Zhang, Yun Xiong, Lei Zheng, and Philip S. Yu. 2021. Continuous-Time Sequential Recommendation with Temporal Graph Collaborative Transformer. In CIKM ’21. 433–442.
[16]
Chen Gao, Yu Zheng, Nian Li, Yinfeng Li, Yingrong Qin, Jinghua Piao, Yuhan Quan, Jianxin Chang, Depeng Jin, Xiangnan He, and Yong Li. 2023. A Survey of Graph Neural Networks for Recommender Systems: Challenges, Methods, and Directions. ACM Trans. Recomm. Syst. 1, 1, Article 3 (2023), 51 pages.
[17]
Rong Gao, Yuhe Tao, Yonghong Yu, Jia Wu, Xiongkai Shao, Jing Li, and Zhiwei Ye. 2023. Self-supervised Dual Hypergraph learning with Intent Disentanglement for session-based recommendation. Knowledge-Based Systems 270 (2023), 110528.
[18]
Cheng Guo, Mengfei Zhang, Jinyun Fang, Jiaqi Jin, and Mao Pan. 2020. Session-based Recommendation with Hierarchical Leaping Networks. In SIGIR ’20. 1705–1708.
[19]
Jiayan Guo, Lun Du, Xu Chen, Xiaojun Ma, Qiang Fu, Shi Han, Dongmei Zhang, and Yan Zhang. 2023. On Manipulating Signals of User-Item Graph: A Jacobi Polynomial-based Graph Collaborative Filtering. In KDD ’23. 602–613.
[20]
Bowei He, Xu He, Yingxue Zhang, Ruiming Tang, and Chen Ma. 2023. Dynamically Expandable Graph Convolution for Streaming Recommendation. In WWW ’23. 1457–1467.
[21]
Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, YongDong Zhang, and Meng Wang. 2020. LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation. In SIGIR ’20. 639–648.
[22]
Juyong Jiang, Peiyan Zhang, Yingtao Luo, Chaozhuo Li, Jae Boum Kim, Kai Zhang, Senzhang Wang, Xing Xie, and Sunghun Kim. 2023. AdaMCT: Adaptive Mixture of CNN-Transformer for Sequential Recommendation. In CIKM ’23. 976–986.
[23]
Srijan Kumar, Xikun Zhang, and Jure Leskovec. 2019. Predicting dynamic embedding trajectory in temporal interaction networks. In KDD ’19. 1269–1278.
[24]
Muyang Li, Zijian Zhang, Xiangyu Zhao, Wanyu Wang, Minghao Zhao, Runze Wu, and Ruocheng Guo. 2023. AutoMLP: Automated MLP for Sequential Recommendations. In WWW ’23. 1190–1198.
[25]
Xiaohan Li, Mengqi Zhang, Shu Wu, Zheng Liu, Liang Wang, and S Yu Philip. 2020. Dynamic graph collaborative filtering. In 2020 IEEE International Conference on Data Mining (ICDM). IEEE, 322–331.
[26]
Zeyu Li, Wei Cheng, Haiqi Xiao, Wenchao Yu, Haifeng Chen, and Wei Wang. 2021. You Are What and Where You Are: Graph Enhanced Attention Network for Explainable POI Recommendation. In CIKM ’21. 3945–3954.
[27]
Weilin Lin, Xiangyu Zhao, Yejing Wang, Yuanshao Zhu, and Wanyu Wang. 2023. AutoDenoise: Automatic Data Instance Denoising for Recommendations. In WWW ’23. 1003–1011.
[28]
Jiahao Liu, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Li Shang, and Ning Gu. 2023. Personalized Graph Signal Processing for Collaborative Filtering. In WWW ’23. 1264–1272.
[29]
Yong Liu, Yingtai Xiao, Qiong Wu, Chunyan Miao, Juyong Zhang, Binqiang Zhao, and Haihong Tang. 2020. Diversified interactive recommendation with implicit feedback. In AAAI ’20, Vol. 34. 4932–4939.
[30]
Ilya Loshchilov and Frank Hutter. 2019. Decoupled Weight Decay Regularization. In ICLR.
[31]
Yuanfu Lu, Yuan Fang, and Chuan Shi. 2020. Meta-learning on Heterogeneous Information Networks for Cold-start Recommendation. In KDD ’20. 1563–1573.
[32]
Giang Hoang Nguyen, John Boaz Lee, Ryan A. Rossi, Nesreen K. Ahmed, Eunyee Koh, and Sungchul Kim. 2018. Continuous-Time Dynamic Network Embeddings. In Companion Proceedings of the The Web Conference 2018. 969–976.
[33]
Yuxin Ni, Yunwen Xia, Hui Fang, Chong Long, Xinyu Kong, Daqian Li, Dong Yang, and Jie Zhang. 2023. Meta-CRS: A Dynamic Meta-Learning Approach for Effective Conversational Recommender System. ACM Trans. Inf. Syst. 42, 1, Article 28 (2023), 27 pages.
[34]
Zhiqiang Pan, Fei Cai, Wanyu Chen, and Honghui Chen. 2021. Graph Co-Attentive Session-based Recommendation. ACM Trans. Inf. Syst. 40, 4, Article 67 (2021), 31 pages.
[35]
Xiuyuan Qin, Huanhuan Yuan, Pengpeng Zhao, Guanfeng Liu, Fuzhen Zhuang, and Victor S. Sheng. 2024. Intent Contrastive Learning with Cross Subsequences for Sequential Recommendation. In WSDM ’24. 548–556.
[36]
Emanuele Rossi, Ben Chamberlain, Fabrizio Frasca, Davide Eynard, Federico Monti, and Michael Bronstein. 2020. Temporal graph networks for deep learning on dynamic graphs. arXiv preprint arXiv:2006.10637 (2020).
[37]
Thiago Silva, Nícollas Silva, Heitor Werneck, Carlos Mito, Adriano C.M. Pereira, and Leonardo Rocha. 2022. iRec: An Interactive Recommendation Framework. In SIGIR ’22. 3165–3175.
[38]
Susheel Suresh, Mayank Shrivastava, Arko Mukherjee, Jennifer Neville, and Pan Li. 2023. Expressive and Efficient Representation Learning for Ranking Links in Temporal Graphs. In WWW ’23. 567–577.
[39]
Haoran Tang, Shiqing Wu, Guandong Xu, and Qing Li. 2023. Dynamic Graph Evolution Learning for Recommendation. In SIGIR ’23. 1589–1598.
[40]
Xing Tang, Ling Chen, Hongyu Shi, and Dandan Lyu. 2024. DHyper: A Recurrent Dual Hypergraph Neural Network for Event Prediction in Temporal Knowledge Graphs. ACM Trans. Inf. Syst. 42, 5, Article 129 (2024), 23 pages.
[41]
Rakshit Trivedi, Mehrdad Farajtabar, Prasenjeet Biswal, and Hongyuan Zha. 2019. DyRep: Learning Representations over Dynamic Graphs. In ICLR.
[42]
Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2018. Graph Attention Networks. In ICLR.
[43]
Binwu Wang, Yudong Zhang, Xu Wang, Pengkun Wang, Zhengyang Zhou, Lei Bai, and Yang Wang. 2023. Pattern Expansion and Consolidation on Evolving Graphs for Continual Traffic Prediction. In KDD ’23. 2223–2232.
[44]
Guangtao Wang, Rex Ying, Jing Huang, and Jure Leskovec. 2019. Improving graph attention networks with large margin-based constraints. arXiv preprint arXiv:1910.11945 (2019).
[45]
Junshan Wang, Guojie Song, Yi Wu, and Liang Wang. 2020. Streaming Graph Neural Networks via Continual Learning. In CIKM ’20. 1515–1524.
[46]
Junshan Wang, Wenhao Zhu, Guojie Song, and Liang Wang. 2022. Streaming Graph Neural Networks with Generative Replay. In KDD ’22. 1878–1888.
[47]
Lei Wang, Ee-Peng Lim, Zhiwei Liu, and Tianxiang Zhao. 2022. Explanation Guided Contrastive Learning for Sequential Recommendation. In CIKM ’22. 2017–2027.
[48]
Weiqing Wang, Hongzhi Yin, Zi Huang, Qinyong Wang, Xingzhong Du, and Quoc Viet Hung Nguyen. 2018. Streaming Ranking Based Recommender Systems. In SIGIR ’18. 525–534.
[49]
Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019. Neural Graph Collaborative Filtering. In SIGIR’19. 165–174.
[50]
Yichao Wang, Huifeng Guo, Ruiming Tang, Zhirong Liu, and Xiuqiang He. 2020. A practical incremental method to train deep ctr models. arXiv preprint arXiv:2009.02147 (2020).
[51]
Yufeng Wang and Charith Mendis. 2024. TGLite: A Lightweight Programming Framework for Continuous-Time Temporal Graph Neural Networks. In ASPLOS ’24. 1183–1199.
[52]
Yu Wang, Yuying Zhao, Yi Zhang, and Tyler Derr. 2023. Collaboration-Aware Graph Convolutional Network for Recommender Systems. In WWW ’23. 91–101.
[53]
Yinwei Wei, Xiang Wang, Qi Li, Liqiang Nie, Yan Li, Xuanping Li, and Tat-Seng Chua. 2021. Contrastive Learning for Cold-Start Recommendation. In MM ’21. 5382–5390.
[54]
Zhihao Wen and Yuan Fang. 2022. TREND: Temporal Event and Node Dynamics for Graph Representation Learning. In WWW ’22,. 1159–1169.
[55]
Jiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He, Liang Chen, Jianxun Lian, and Xing Xie. 2021. Self-supervised Graph Learning for Recommendation. In SIGIR ’21. 726–735.
[56]
Shu Wu, Yuyuan Tang, Yanqiao Zhu, Liang Wang, Xing Xie, and Tieniu Tan. 2019. Session-based recommendation with graph neural networks. In AAAI ’19, Vol. 33. 346–353.
[57]
Shiqing Wu, Guandong Xu, and Xianzhi Wang. 2023. SOAC: Supervised Off-Policy Actor-Critic for Recommender Systems. In ICDM ’23. 1421–1426.
[58]
Yuxia Wu, Yuan Fang, and Lizi Liao. 2024. On the Feasibility of Simple Transformer for Dynamic Graph Modeling. In WWW ’24. 870–880.
[59]
Jiafeng Xia, Dongsheng Li, Hansu Gu, Jiahao Liu, Tun Lu, and Ning Gu. 2022. FIRE: Fast Incremental Recommendation with Graph Signal Processing. In WWW ’22. 2360–2369.
[60]
Jiafeng Xia, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, and Ning Gu. 2021. Incremental graph convolutional network for collaborative filtering. In CIKM ’21. 2170–2179.
[61]
Jiafeng Xia, Dongsheng Li, Hansu Gu, Tun Lu, Peng Zhang, Li Shang, and Ning Gu. 2024. Neural Kalman Filtering for Robust Temporal Recommendation. In WSDM ’24. 836–845.
[62]
Lianghao Xia, Chao Huang, Yong Xu, Peng Dai, Xiyue Zhang, Hongsheng Yang, Jian Pei, and Liefeng Bo. 2021. Knowledge-enhanced hierarchical graph transformer network for multi-behavior recommendation. In AAAI ’21, Vol. 35. 4486–4493.
[63]
Lianghao Xia, Chao Huang, Yong Xu, Jiashu Zhao, Dawei Yin, and Jimmy Huang. 2022. Hypergraph Contrastive Collaborative Filtering. In SIGIR ’22. 70–79.
[64]
Chunjing Xiao, Wanlin Ji, Yuxiang Zhang, and Shenkai Lv. 2024. PIDKG: Propagating Interaction Influence on the Dynamic Knowledge Graph for Recommendation. ACM Trans. Web 18, 2, Article 26 (2024), 26 pages.
[65]
Teng Xiao and Donglin Wang. 2021. A general offline reinforcement learning framework for interactive recommendation. In AAAI ’21, Vol. 35. 4512–4520.
[66]
Xu Xie, Fei Sun, Zhaoyang Liu, Shiwen Wu, Jinyang Gao, Jiandong Zhang, Bolin Ding, and Bin Cui. 2022. Contrastive Learning for Sequential Recommendation. In ICDE ’22. 1259–1273.
[67]
Da Xu, Chuanwei Ruan, Evren Korpeoglu, Sushant Kumar, and Kannan Achan. 2020. Inductive representation learning on temporal graphs. In ICLR.
[68]
Dingqi Yang, Daqing Zhang, Vincent W. Zheng, and Zhiyong Yu. 2015. Modeling User Activity Preference by Leveraging User Spatial Temporal Characteristics in LBSNs. IEEE Transactions on Systems, Man, and Cybernetics: Systems 45, 1 (2015), 129–142.
[69]
Menglin Yang, Min Zhou, Marcus Kalander, Zengfeng Huang, and Irwin King. 2021. Discrete-Time Temporal Network Embedding via Implicit Hierarchical Learning in Hyperbolic Space. In KDD ’21. 1975–1985.
[70]
Yuhao Yang, Chao Huang, Lianghao Xia, and Chenliang Li. 2022. Knowledge Graph Contrastive Learning for Recommendation. In SIGIR ’22. 1434–1443.
[71]
Zhen Yang, Ming Ding, Bin Xu, Hongxia Yang, and Jie Tang. 2022. STAM: A Spatiotemporal Aggregation Method for Graph Neural Network-Based Recommendation. In WWW ’22. 3217–3228.
[72]
Junchen Ye, Zihan Liu, Bowen Du, Leilei Sun, Weimiao Li, Yanjie Fu, and Hui Xiong. 2022. Learning the Evolutionary and Multi-Scale Graph Structure for Multivariate Time Series Forecasting. In KDD ’22. 2296–2306.
[73]
Dianer Yu, Qian Li, Hongzhi Yin, and Guandong Xu. 2023. Causality-guided Graph Learning for Session-based Recommendation. In CIKM ’23. 3083–3093.
[74]
Huanhuan Yuan, Pengpeng Zhao, Xuefeng Xian, Guanfeng Liu, Yanchi Liu, Victor S. Sheng, and Lei Zhao. 2023. Sequential Recommendation with Probabilistic Logical Reasoning. In IJCAI ’23. 2432–2440.
[75]
Zixuan Yuan, Hao Liu, Junming Liu, Yanchi Liu, Yang Yang, Renjun Hu, and Hui Xiong. 2021. Incremental Spatio-Temporal Graph Learning for Online Query-POI Matching. In WWW ’21. 1586–1597.
[76]
Guozhen Zhang, Tian Ye, Depeng Jin, and Yong Li. 2023. An Attentional Multi-Scale Co-Evolving Model for Dynamic Link Prediction. In WWW ’23. 429–437.
[77]
Mengqi Zhang, Shu Wu, Xueli Yu, Qiang Liu, and Liang Wang. 2023. Dynamic Graph Neural Networks for Sequential Recommendation. IEEE Transactions on Knowledge and Data Engineering 35, 5 (2023), 4741–4753.
[78]
Song Zhang, Nan Zheng, and Danli Wang. 2023. HetGRec: Heterogeneous Graph Attention Network for Group Recommendation. IEEE Intelligent Systems 38, 1 (2023), 9–18.
[79]
Wei Zhang, Zeyuan Chen, Hongyuan Zha, and Jianyong Wang. 2021. Learning from Substitutable and Complementary Relations for Graph-based Sequential Product Recommendation. ACM Trans. Inf. Syst. 40, 2, Article 26 (2021), 28 pages.
[80]
Yang Zhang, Fuli Feng, Chenxu Wang, Xiangnan He, Meng Wang, Yan Li, and Yongdong Zhang. 2020. How to Retrain Recommender System? A Sequential Meta-Learning Method. In SIGIR ’20. 1479–1488.
[81]
Yao Zhang, Yun Xiong, Yongxiang Liao, Yiheng Sun, Yucheng Jin, Xuehao Zheng, and Yangyong Zhu. 2023. TIGER: Temporal Interaction Graph Embedding with Restarts. In WWW ’23. 478–488.
[82]
Xu Zhao, Yi Ren, Ying Du, Shenzheng Zhang, and Nian Wang. 2022. Improving Item Cold-start Recommendation via Model-agnostic Conditional Variational Autoencoder. In SIGIR ’22. 2595–2600.
[83]
Xiaobo Zhu, Yan Wu, Liying Wang, Hailong Su, and Zhipeng Li. 2024. Continuous-Time Dynamic Interaction Network Learning Based on Evolutionary Expectation. IEEE Transactions on Cognitive and Developmental Systems 16, 3 (2024), 840–849.
[84]
Yifan Zhu, Fangpeng Cong, Dan Zhang, Wenwen Gong, Qika Lin, Wenzheng Feng, Yuxiao Dong, and Jie Tang. 2023. WinGNN: Dynamic Graph Neural Networks with Random Gradient Aggregation Window. In KDD ’23. 3650–3662.
[85]
Yu Zhu, Hao Li, Yikang Liao, Beidou Wang, Ziyu Guan, Haifeng Liu, and Deng Cai. 2017. What to Do Next: Modeling User Behaviors by Time-LSTM. In IJCAI ’17. 3602–3608.
[86]
Lixin Zou, Long Xia, Pan Du, Zhuo Zhang, Ting Bai, Weidong Liu, Jian-Yun Nie, and Dawei Yin. 2020. Pseudo Dyna-Q: A Reinforcement Learning Framework for Interactive Recommendation. In WSDM ’20. 816–824.
Index Terms
- TCGC: Temporal Collaboration-Aware Graph Co-Evolution Learning for Dynamic Recommendation
Recommendations
Dynamic Graph Evolution Learning for Recommendation
SIGIR '23: Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information RetrievalGraph neural network (GNN) based algorithms have achieved superior performance in recommendation tasks due to their advanced capability of exploiting high-order connectivity between users and items. However, most existing GNN-based recommendation models ...
Temporal-order association-based dynamic graph evolution for recommendation
AbstractModeling the interactions between users and items to accurately predict a user preference on items is very crucial for improving the performance of recommendation. Although existing graph-based methods have achieved great progress in predicting a ...
Dynamic Personalized Recommendation on Sparse Data
Recommendation techniques are very important in the fields of E-commerce and other web-based services. One of the main difficulties is dynamically providing high-quality recommendation on sparse data. In this paper, a novel dynamic personalized ...
Comments
Information & Contributors
Information
Published In
EISSN:1558-2868
Table of ContentsCopyright © 2024 Copyright held by the owner/author(s).
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Online AM: 27 August 2024
Accepted: 21 July 2024
Revised: 19 June 2024
Received: 17 April 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 149Total Downloads
- Downloads (Last 12 months)149
- Downloads (Last 6 weeks)149
Reflects downloads up to 04 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in