Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3331184.3331267acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Neural Graph Collaborative Filtering

Published: 18 July 2019 Publication History

Abstract

Learning vector representations (aka. embeddings) of users and items lies at the core of modern recommender systems. Ranging from early matrix factorization to recently emerged deep learning based methods, existing efforts typically obtain a user's (or an item's) embedding by mapping from pre-existing features that describe the user (or the item), such as ID and attributes. We argue that an inherent drawback of such methods is that, the collaborative signal, which is latent in user-item interactions, is not encoded in the embedding process. As such, the resultant embeddings may not be sufficient to capture the collaborative filtering effect.
In this work, we propose to integrate the user-item interactions - more specifically the bipartite graph structure - into the embedding process. We develop a new recommendation framework Neural Graph Collaborative Filtering (NGCF), which exploits the user-item graph structure by propagating embeddings on it. This leads to the expressive modeling of high-order connectivity in user-item graph, effectively injecting the collaborative signal into the embedding process in an explicit manner. We conduct extensive experiments on three public benchmarks, demonstrating significant improvements over several state-of-the-art models like HOP-Rec [39] and Collaborative Memory Network [5]. Further analysis verifies the importance of embedding propagation for learning better user and item representations, justifying the rationality and effectiveness of NGCF. Codes are available at https://github.com/xiangwang1223/neural_graph_collaborative_filtering.

Supplementary Material

MP4 File (cite2-14h50-d1.mp4)

References

[1]
Yixin Cao, Xiang Wang, Xiangnan He, Zikun Hu, and Tat-Seng Chua. 2019. Unifying Knowledge Graph Learning and Recommendation: Towards a Better Understanding of User Preferences. In WWW.
[2]
Jingyuan Chen, Hanwang Zhang, Xiangnan He, Liqiang Nie, Wei Liu, and Tat-Seng Chua. 2017. Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention. In SIGIR. 335--344.
[3]
Zhiyong Cheng, Ying Ding, Lei Zhu, and Mohan S. Kankanhalli. 2018. Aspect-Aware Latent Factor Model: Rating Prediction with Ratings and Reviews. In WWW. 639--648.
[4]
Michaël Defferrard, Xavier Bresson, and Pierre Vandergheynst. 2016. Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering. In NeurIPS. 3837--3845.
[5]
Travis Ebesu, Bin Shen, and Yi Fang. 2018. Collaborative Memory Network for Recommendation Systems. In SIGIR. 515--524.
[6]
Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In AISTATS. 249--256.
[7]
Marco Gori and Augusto Pucci. 2007. ItemRank: A Random-Walk Based Scoring Algorithm for Recommender Engines. In IJCAI. 2766--2771.
[8]
William L. Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive Representation Learning on Large Graphs. In NeurIPS. 1025--1035.
[9]
Ruining He and Julian McAuley. 2016. Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering. In WWW. 507--517.
[10]
Ruining He and Julian McAuley. 2016. VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback. In AAAI. 144--150.
[11]
Xiangnan He and Tat-Seng Chua. 2017. Neural Factorization Machines for Sparse Predictive Analytics. In SIGIR. 355--364.
[12]
Xiangnan He, Ming Gao, Min-Yen Kan, and Dingxian Wang. 2017. BiRank: Towards Ranking on Bipartite Graphs. TKDE, Vol. 29, 1 (2017), 57--71.
[13]
Xiangnan He, Zhankui He, Xiaoyu Du, and Tat-Seng Chua. 2018. Adversarial Personalized Ranking for Recommendation. In SIGIR. 355--364.
[14]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural Collaborative Filtering. In WWW. 173--182.
[15]
Cheng-Kang Hsieh, Longqi Yang, Yin Cui, Tsung-Yi Lin, Serge J. Belongie, and Deborah Estrin. 2017. Collaborative Metric Learning. In WWW. 193--201.
[16]
Santosh Kabbur, Xia Ning, and George Karypis. 2013. FISM: factored item similarity models for top-N recommender systems. In KDD. 659--667.
[17]
Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. In ICLR.
[18]
Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In ICLR.
[19]
Yehuda Koren. 2008. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In KDD. 426--434.
[20]
Yehuda Koren, Robert M. Bell, and Chris Volinsky. 2009. Matrix Factorization Techniques for Recommender Systems. IEEE Computer, Vol. 42, 8 (2009), 30--37.
[21]
Dawen Liang, Laurent Charlin, James McInerney, and David M. Blei. 2016. Modeling User Exposure in Recommendation. In WWW. 951--961.
[22]
Zhenguang Liu, Zepeng Wang, Luming Zhang, Rajiv Ratn Shah, Yingjie Xia, Yi Yang, and Xuelong Li. 2017. FastShrinkage: Perceptually-aware Retargeting Toward Mobile Platforms. In MM. 501--509.
[23]
Andrew L. Maas, Awni Y. Hannun, and Andrew Y. Ng. 2013. Rectifier nonlinearities improve neural network acoustic models. In ICML .
[24]
Athanasios N. Nikolakopoulos and George Karypis. 2019. RecWalk: Nearly Uncoupled Random Walks for Top-N Recommendation. (2019).
[25]
Jiezhong Qiu, Jian Tang, Hao Ma, Yuxiao Dong, Kuansan Wang, and Jie Tang. 2018. DeepInf: Social Influence Prediction with Deep Learning. In KDD. 2110--2119.
[26]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian Personalized Ranking from Implicit Feedback. In UAI. 452--461.
[27]
Xuemeng Song, Fuli Feng, Xianjing Han, Xin Yang, Wei Liu, and Liqiang Nie. 2018. Neural Compatibility Modeling with Attentive Knowledge Distillation. In SIGIR. 5--14.
[28]
Yi Tay, Luu Anh Tuan, and Siu Cheung Hui. 2018. Latent relational metric learning via memory-based attention for collaborative ranking. In WWW. 729--739.
[29]
Rianne van den Berg, Thomas N. Kipf, and Max Welling. 2017. Graph Convolutional Matrix Completion. In KDD.
[30]
Hao Wang, Naiyan Wang, and Dit-Yan Yeung. 2015. Collaborative Deep Learning for Recommender Systems. In KDD. 1235--1244.
[31]
Xiang Wang, Xiangnan He, Yixin Cao, Meng Liu, and Tat-Seng Chua. 2019. KGAT: Knowledge Graph Attention Network for Recommendation. In KDD.
[32]
Xiang Wang, Xiangnan He, Fuli Feng, Liqiang Nie, and Tat-Seng Chua. 2018. TEM: Tree-enhanced Embedding Model for Explainable Recommendation. In WWW. 1543--1552.
[33]
Xiang Wang, Xiangnan He, Liqiang Nie, and Tat-Seng Chua. 2017. Item Silk Road: Recommending Items from Information Domains to Social Users. In SIGIR. 185--194.
[34]
Xiang Wang, Dingxian Wang, Canran Xu, Xiangnan He, Yixin Cao, and Tat-Seng Chua. 2019. Explainable Reasoning over Knowledge Graphs for Recommendation. In AAAI.
[35]
Yao Wu, Christopher DuBois, Alice X. Zheng, and Martin Ester. 2016. Collaborative Denoising Auto-Encoders for Top-N Recommender Systems. In WSDM. 153--162.
[36]
Xin Xin, Xiangnan He, Yongfeng Zhang, Yongdong Zhang, and Joemon Jose. 2019. Relational Collaborative Filtering:Modeling Multiple Item Relations for Recommendation. In SIGIR.
[37]
Keyulu Xu, Chengtao Li, Yonglong Tian, Tomohiro Sonobe, Ken-ichi Kawarabayashi, and Stefanie Jegelka. 2018. Representation Learning on Graphs with Jumping Knowledge Networks. In ICML, Vol. 80. 5449--5458.
[38]
Feng Xue, Xiangnan He, Xiang Wang, Jiandong Xu, Kai Liu, and Richang Hong. 2019. Deep Item-based Collaborative Filtering for Top-N Recommendation. TOIS, Vol. 37, 3 (2019), 33:1--33:25.
[39]
Jheng-Hong Yang, Chih-Ming Chen, Chuan-Ju Wang, and Ming-Feng Tsai. 2018. HOP-rec: high-order proximity for implicit recommendation. In RecSys. 140--144.
[40]
Xun Yang, Xiangnan He, Xiang Wang, Yunshan Ma, Fuli Feng, Meng Wang, and Tat-Seng Chua. 2019. Interpretable Fashion Matching with Rich Attributes. In SIGIR.
[41]
Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L. Hamilton, and Jure Leskovec. 2018. Graph Convolutional Neural Networks for Web-Scale Recommender Systems. In KDD (Data Science track). 974--983.
[42]
Lei Zheng, Chun-Ta Lu, Fei Jiang, Jiawei Zhang, and Philip S. Yu. 2018. Spectral collaborative filtering. In RecSys. 311--319.

Cited By

View all
  • (2025)Graph-Based Feature Crossing to Enhance Recommender SystemsMathematics10.3390/math1302030213:2(302)Online publication date: 18-Jan-2025
  • (2025)SC-TKGR: Temporal Knowledge Graph-Based GNN for Recommendations in Supply ChainsElectronics10.3390/electronics1402022214:2(222)Online publication date: 7-Jan-2025
  • (2025)Interactive, Enhanced Dual Hypergraph Model for Explainable Contrastive Learning RecommendationElectronics10.3390/electronics1402021614:2(216)Online publication date: 7-Jan-2025
  • Show More Cited By

Recommendations

Reviews

Jolanta MizeraPietraszko

Typically, collaborative filtering (CF) is simply a nearest neighbor (NN) algorithm used either in its original form or in machine learning (ML), especially in supervised learning, to predict user preferences in recommender systems. Here, neural graph collaborative filtering (NGCF) aims to resolve a critical issue of mapping from preexisting features: "the collaborative signal is latent in user-item interactions." The proposed bipartite graph structure integrates this interaction into the embedding process. Some approaches to CF, such as embedding and modeling user-item interactions, suggest that the proposed method is an extension of existing solutions. For example, matrix factorization is replaced with an encoding of the CF signals onto graph representations, named here as high-order connectivity; the presented definition is supported with an example. As neural networks are applicable almost everywhere, the authors "design a neural network method to propagate embeddings recursively on the graph." Following this concept, the recommendation is closely related to the behavioral patterns of users interacting with the same items-the longer the path (more layers), the stronger and more reliable the recommendation. Having the message constructed based on the encoding function, the messages are aggregated and the high-order propagation is computed in matrices whose inner products generate user preferences as to which items are better. The objective function annotates higher prediction values to observed (rather than unobserved) user-item interactions. To avoid overfitting, both message dropout and node dropout are adopted. Experiments conducted on three datasets indicate that the approach allows for a better understanding of user behavior in recommender systems. In my opinion, however, the method does not outperform existing solutions because the assumption relies on the same user-item interaction as in other methods. Perhaps more attributes would boost it. Furthermore, while the method may be interesting, the paper contains some typographical errors (for example, "an vector"); thus, I would rather not recommend it.

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGIR'19: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval
July 2019
1512 pages
ISBN:9781450361729
DOI:10.1145/3331184
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 July 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. collaborative filtering
  2. embedding propagation
  3. graph neural network
  4. high-order connectivity
  5. recommendation

Qualifiers

  • Research-article

Funding Sources

  • NExT++ research
  • Thousand Youth Talents Program 2018

Conference

SIGIR '19
Sponsor:

Acceptance Rates

SIGIR'19 Paper Acceptance Rate 84 of 426 submissions, 20%;
Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1,369
  • Downloads (Last 6 weeks)116
Reflects downloads up to 01 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Graph-Based Feature Crossing to Enhance Recommender SystemsMathematics10.3390/math1302030213:2(302)Online publication date: 18-Jan-2025
  • (2025)SC-TKGR: Temporal Knowledge Graph-Based GNN for Recommendations in Supply ChainsElectronics10.3390/electronics1402022214:2(222)Online publication date: 7-Jan-2025
  • (2025)Interactive, Enhanced Dual Hypergraph Model for Explainable Contrastive Learning RecommendationElectronics10.3390/electronics1402021614:2(216)Online publication date: 7-Jan-2025
  • (2025)A Learning Resource Recommendation Method Based on Graph Contrastive LearningElectronics10.3390/electronics1401014214:1(142)Online publication date: 1-Jan-2025
  • (2025)Heterogeneous Spatio-Temporal Graph Contrastive Learning for Point-of-Interest RecommendationTsinghua Science and Technology10.26599/TST.2023.901014830:1(186-197)Online publication date: Feb-2025
  • (2025)Attention-Enhanced and Knowledge-Fused Dual Item Representations Network for RecommendationTsinghua Science and Technology10.26599/TST.2023.901014330:2(585-599)Online publication date: Apr-2025
  • (2025)Betweenness Approximation for Edge Computing with Hypergraph Neural NetworksTsinghua Science and Technology10.26599/TST.2023.901010630:1(331-344)Online publication date: Feb-2025
  • (2025)Accurate multi-behavior sequence-aware recommendation via graph convolution networksPLOS ONE10.1371/journal.pone.031428220:1(e0314282)Online publication date: 7-Jan-2025
  • (2025)A Thorough Performance Benchmarking on Lightweight Embedding-based Recommender SystemsACM Transactions on Information Systems10.1145/3712589Online publication date: 17-Jan-2025
  • (2025)Pone-GNN: Integrating Positive and Negative Feedback in Graph Neural Networks for Recommender SystemsACM Transactions on Recommender Systems10.1145/3711666Online publication date: 4-Jan-2025
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media