Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3580305.3599768acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article
Free access

Adaptive Graph Contrastive Learning for Recommendation

Published: 04 August 2023 Publication History

Abstract

Graph neural networks (GNNs) have recently emerged as an effective collaborative filtering (CF) approaches for recommender systems. The key idea of GNN-based recommender systems is to recursively perform message passing along user-item interaction edges to refine encoded embeddings, relying on sufficient and high-quality training data. However, user behavior data in practical recommendation scenarios is often noisy and exhibits skewed distribution. To address these issues, some recommendation approaches, such as SGL, leverage self-supervised learning to improve user representations. These approaches conduct self-supervised learning through creating contrastive views, but they depend on the tedious trial-and-error selection of augmentation methods. In this paper, we propose a novel Adaptive Graph Contrastive Learning (AdaGCL) framework that conducts data augmentation with two adaptive contrastive view generators to better empower the CF paradigm. Specifically, we use two trainable view generators - a graph generative model and a graph denoising model - to create adaptive contrastive views. With two adaptive contrastive views, AdaGCL introduces additional high-quality training signals into the CF paradigm, helping to alleviate data sparsity and noise issues. Extensive experiments on three real-world datasets demonstrate the superiority of our model over various state-of-the-art recommendation methods. Our model implementation codes are available at the link https://github.com/HKUDS/AdaGCL.

Supplementary Material

MP4 File (adfp604-2min-promo.mp4)
Presentation video - short version

References

[1]
Rianne van den Berg, Thomas N Kipf, and Max Welling. 2017. Graph convolutional matrix completion. arXiv preprint arXiv:1706.02263 (2017).
[2]
Jiangxia Cao, Xin Cong, Jiawei Sheng, Tingwen Liu, and Bin Wang. 2022. Contrastive Cross-Domain Sequential Recommendation. In International Conference on Information & Knowledge Management (CIKM). 138--147.
[3]
Lei Chen, Le Wu, Richang Hong, Kun Zhang, and Meng Wang. 2020. Revisiting graph based collaborative filtering: A linear residual graph convolutional network approach. In AAAI Conference on Artificial Intelligence (AAAI), Vol. 34. 27--34.
[4]
Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, Yongdong Zhang, and Meng Wang. 2020. Lightgcn: Simplifying and powering graph convolution network for recommendation. In International Conference on Research and Development in Information Retrieval (SIGIR). 639--648.
[5]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In The Web Conference (WWW). 173--182.
[6]
Cheng Hsu and Cheng-Te Li. 2021. Retagnn: Relational temporal attentive graph neural networks for holistic sequential recommendation. In The Web Conference (WWW). 2968--2979.
[7]
Dasol Hwang, Jinyoung Park, Sunyoung Kwon, KyungMin Kim, Jung-Woo Ha, and Hyunwoo J Kim. 2020. Self-supervised auxiliary learning with meta-paths for heterogeneous graphs. In Advances in Neural Information Processing Systems (NeurIPS). 10294--10305.
[8]
Mohsen Jamali and Martin Ester. 2010. A matrix factorization technique with trust propagation for recommendation in social networks. In ACM Conference on Recommender Systems (Recsys). 135--142.
[9]
Thomas N Kipf and Max Welling. 2016. Variational graph auto-encoders. arXiv preprint arXiv:1611.07308 (2016).
[10]
Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer, Vol. 42, 8 (2009), 30--37.
[11]
Chaoliu Li, Lianghao Xia, Xubin Ren, Yaowen Ye, Yong Xu, and Chao Huang. 2023. Graph Transformer for Recommendation. arXiv preprint arXiv:2306.02330 (2023).
[12]
Zihan Lin, Changxin Tian, Yupeng Hou, and Wayne Xin Zhao. 2022. Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learning. In The Web Conference (WWW). 2320--2329.
[13]
Xubin Ren, Lianghao Xia, Jiashu Zhao, Dawei Yin, and Chao Huang. 2023. Disentangled Contrastive Collaborative Filtering. arXiv preprint arXiv:2305.02759 (2023).
[14]
Suvash Sedhain, Aditya Krishna Menon, Scott Sanner, and Lexing Xie. 2015. Autorec: Autoencoders meet collaborative filtering. In The Web Conference (WWW). 111--112.
[15]
Zhulin Tao, Xiaohao Liu, Yewei Xia, Xiang Wang, Lifang Yang, Xianglin Huang, and Tat-Seng Chua. 2022. Self-supervised learning for multimedia recommendation. Transactions on Multimedia (TMM) (2022).
[16]
Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research, Vol. 9, 11 (2008).
[17]
Chenyang Wang, Yuanqing Yu, Weizhi Ma, Min Zhang, Chong Chen, Yiqun Liu, and Shaoping Ma. 2022b. Towards Representation Alignment and Uniformity in Collaborative Filtering. In International Conference on Knowledge Discovery and Data Mining (KDD). 1816--1825.
[18]
Hongwei Wang, Jialin Wang, Jia Wang, Miao Zhao, Weinan Zhang, Fuzheng Zhang, Wenjie Li, Xing Xie, and Minyi Guo. 2019b. Learning graph representation with generative adversarial nets. Transactions on Knowledge and Data Engineering (TKDE), Vol. 33, 8 (2019), 3090--3103.
[19]
Jianling Wang, Raphael Louca, Diane Hu, Caitlin Cellier, James Caverlee, and Liangjie Hong. 2020b. Time to Shop for Valentine's Day: Shopping Occasions and Sequential Recommendation in E-commerce. In International Conference on Web Search and Data Mining (WSDM). 645--653.
[20]
Wenjie Wang, Xinyu Lin, Fuli Feng, Xiangnan He, Min Lin, and Tat-Seng Chua. 2022a. Causal representation learning for out-of-distribution recommendation. In The Web Conference (WWW). 3562--3571.
[21]
Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019a. Neural graph collaborative filtering. In International Conference on Research and Development in Information Retrieval (SIGIR). 165--174.
[22]
Xiang Wang, Hongye Jin, An Zhang, Xiangnan He, Tong Xu, and Tat-Seng Chua. 2020a. Disentangled graph collaborative filtering. In International Conference on Research and Development in Information Retrieval (SIGIR). 1001--1010.
[23]
Ziyang Wang, Wei Wei, Gao Cong, Xiao-Li Li, Xian-Ling Mao, and Minghui Qiu. 2020c. Global context enhanced graph neural networks for session-based recommendation. In International Conference on Research and Development in Information Retrieval (SIGIR). 169--178.
[24]
Zhaobo Wang, Yanmin Zhu, Haobing Liu, and Chunyang Wang. 2022c. Learning graph-based disentangled representations for next POI recommendation. In International Conference on Research and Development in Information Retrieval (SIGIR). 1154--1163.
[25]
Wei Wei, Chao Huang, Lianghao Xia, and Chuxu Zhang. 2023. Multi-Modal Self-Supervised Learning for Recommendation. In The Web Conference (WWW). 790--800.
[26]
Jiancan Wu, Xiang Wang, Fuli Feng, Xiangnan He, Liang Chen, Jianxun Lian, and Xing Xie. 2021. Self-supervised graph learning for recommendation. In International Conference on Research and Development in Information Retrieval (SIGIR). 726--735.
[27]
Liang Wu, Diane Hu, Liangjie Hong, and Huan Liu. 2018. Turning clicks into purchases: Revenue optimization for product search in e-commerce. In International Conference on Research & Development in Information Retrieval (SIGIR). 365--374.
[28]
Shiwen Wu, Fei Sun, Wentao Zhang, Xu Xie, and Bin Cui. 2022. Graph neural networks in recommender systems: a survey. Comput. Surveys, Vol. 55, 5 (2022), 1--37.
[29]
Lianghao Xia, Chao Huang, Jiao Shi, and Yong Xu. 2023. Graph-less collaborative filtering. In The Web Conference (WWW). 17--27.
[30]
Lianghao Xia, Chao Huang, Yong Xu, Jiashu Zhao, Dawei Yin, and Jimmy Huang. 2022b. Hypergraph contrastive collaborative filtering. In International Conference on Research and Development in Information Retrieval (SIGIR). 70--79.
[31]
Lianghao Xia, Chao Huang, and Chuxu Zhang. 2022a. Self-supervised hypergraph transformer for recommender systems. In International Conference on Knowledge Discovery and Data Mining (KDD). 2100--2109.
[32]
Tiansheng Yao, Xinyang Yi, Derek Zhiyuan Cheng, Felix Yu, Ting Chen, Aditya Menon, Lichan Hong, Ed H Chi, Steve Tjoa, Jieqi Kang, et al. 2021. Self-supervised learning for large-scale item recommendations. In International Conference on Information & Knowledge Management (CIKM). 4321--4330.
[33]
Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L Hamilton, and Jure Leskovec. 2018. Graph convolutional neural networks for web-scale recommender systems. In International Conference on Knowledge Discovery and Data Mining (KDD). 974--983.
[34]
Ruohan Zhan, Changhua Pei, Qiang Su, Jianfeng Wen, Xueliang Wang, Guanyu Mu, Dong Zheng, Peng Jiang, and Kun Gai. 2022. Deconfounding Duration Bias in Watch-time Prediction for Video Recommendation. In International Conference on Knowledge Discovery and Data Mining (KDD). 4472--4481.
[35]
Fanjin Zhang, Jie Tang, Xueyi Liu, Zhenyu Hou, Yuxiao Dong, Jing Zhang, Xiao Liu, Ruobing Xie, Kai Zhuang, Xu Zhang, et al. 2021b. Understanding WeChat user preferences and ?wow" diffusion. Transactions on Knowledge and Data Engineering (TKDE), Vol. 34, 12 (2021), 6033--6046.
[36]
Jiani Zhang, Xingjian Shi, Shenglin Zhao, and Irwin King. 2019. Star-gcn: Stacked and reconstructed graph convolutional networks for recommender systems. International Joint Conference on Artificial Intelligence (IJCAI) (2019).
[37]
Mengqi Zhang, Shu Wu, Xueli Yu, Qiang Liu, and Liang Wang. 2022. Dynamic graph neural networks for sequential recommendation. Transactions on Knowledge and Data Engineering (TKDE), Vol. 35, 5 (2022), 4741--4753.
[38]
Qianru Zhang, Chao Huang, Lianghao Xia, Zheng Wang, Zhonghang Li, and Siuming Yiu. 2023. Automated Spatio-Temporal Graph Contrastive Learning. In The Web Conference (WWW). 295--305.
[39]
Zaixi Zhang, Qi Liu, Hao Wang, Chengqiang Lu, and Chee-Kong Lee. 2021a. Motif-based graph self-supervised learning for molecular property prediction. In Advances in Neural Information Processing Systems (NeurIPS). 15870--15882.
[40]
Kun Zhou, Hui Wang, Wayne Xin Zhao, Yutao Zhu, Sirui Wang, Fuzheng Zhang, Zhongyuan Wang, and Ji-Rong Wen. 2020. S3-rec: Self-supervised learning for sequential recommendation with mutual information maximization. In International Conference on Information & Knowledge Management (CIKM). 1893--1902.

Cited By

View all
  • (2025)Prototypical Graph Contrastive Learning for RecommendationApplied Sciences10.3390/app1504196115:4(1961)Online publication date: 13-Feb-2025
  • (2025)Denoising Alignment with Large Language Model for RecommendationACM Transactions on Information Systems10.1145/369666243:2(1-35)Online publication date: 24-Jan-2025
  • (2025)Hyperbolic Graph Contrastive Learning for Collaborative FilteringIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.352296037:3(1255-1267)Online publication date: Mar-2025
  • Show More Cited By

Index Terms

  1. Adaptive Graph Contrastive Learning for Recommendation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    KDD '23: Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
    August 2023
    5996 pages
    ISBN:9798400701030
    DOI:10.1145/3580305
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 August 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. contrastive learning
    2. data augmentation
    3. recommendation

    Qualifiers

    • Research-article

    Conference

    KDD '23
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

    Upcoming Conference

    KDD '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)1,073
    • Downloads (Last 6 weeks)73
    Reflects downloads up to 18 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Prototypical Graph Contrastive Learning for RecommendationApplied Sciences10.3390/app1504196115:4(1961)Online publication date: 13-Feb-2025
    • (2025)Denoising Alignment with Large Language Model for RecommendationACM Transactions on Information Systems10.1145/369666243:2(1-35)Online publication date: 24-Jan-2025
    • (2025)Hyperbolic Graph Contrastive Learning for Collaborative FilteringIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.352296037:3(1255-1267)Online publication date: Mar-2025
    • (2025)Simplified self-supervised learning for hybrid propagation graph-based recommendationNeural Networks10.1016/j.neunet.2025.107145185(107145)Online publication date: May-2025
    • (2025)Multi-relational graph contrastive learning with learnable graph augmentationNeural Networks10.1016/j.neunet.2024.106757181(106757)Online publication date: Jan-2025
    • (2025)Intelligible graph contrastive learning with attention-aware for recommendationNeurocomputing10.1016/j.neucom.2024.128781614:COnline publication date: 21-Jan-2025
    • (2025)Cross-domain recommendation via knowledge distillationKnowledge-Based Systems10.1016/j.knosys.2025.113112311(113112)Online publication date: Feb-2025
    • (2025)Addressing sparse data challenges in recommendation systems: A systematic review of rating estimation using sparse rating data and profile enrichment techniquesIntelligent Systems with Applications10.1016/j.iswa.2024.20047425(200474)Online publication date: Mar-2025
    • (2025)User identification network with contrastive clustering for shared-account recommendationInformation Processing & Management10.1016/j.ipm.2024.10405562:3(104055)Online publication date: May-2025
    • (2025)Enhancing robustness in implicit feedback recommender systems with subgraph contrastive learningInformation Processing & Management10.1016/j.ipm.2024.10396262:1(103962)Online publication date: Jan-2025
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media