research-article

Recurrent knowledge graph embedding for effective recommendation

Authors:

Alessandro Bozzon,

Long-Kai Huang,

Chi XuAuthors Info & Claims

RecSys '18: Proceedings of the 12th ACM Conference on Recommender Systems

Pages 297 - 305

https://doi.org/10.1145/3240323.3240361

Published: 27 September 2018 Publication History

Abstract

Knowledge graphs (KGs) have proven to be effective to improve recommendation. Existing methods mainly rely on hand-engineered features from KGs (e.g., meta paths), which requires domain knowledge. This paper presents RKGE, a KG embedding approach that automatically learns semantic representations of both entities and paths between entities for characterizing user preferences towards items. Specifically, RKGE employs a novel recurrent network architecture that contains a batch of recurrent networks to model the semantics of paths linking a same entity pair, which are seamlessly fused into recommendation. It further employs a pooling operator to discriminate the saliency of different paths in characterizing user preferences towards items. Extensive validation on real-world datasets shows the superiority of RKGE against state-of-the-art methods. Furthermore, we show that RKGE provides meaningful explanations for recommendation results.

Supplementary Material

MP4 File (p297-sun.mp4)

Download
1577.41 MB

References

[1]

Phil Blunsom, Edward Grefenstette, and Nal Kalchbrenner. 2014. A Convolutional Neural Network for Modelling Sentences. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (ACL). Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics.

[2]

Rose Catherine and William Cohen. 2016. Personalized Recommendations using Knowledge Graphs: A Probabilistic Logic Programming Approach. In Proceedings of the 10th ACM Conference on Recommender Systems (RecSys). ACM, 325--332.

Digital Library

[3]

Sneha Chaudhari, Amos Azaria, and Tom Mitchell. 2017. An Entity Graph based Recommender System. AI Communications 30, 2 (2017), 141--149.

Digital Library

[4]

Tianqi Chen, Weinan Zhang, Qiuxia Lu, Kailong Chen, Zhao Zheng, and Yong Yu. 2012. SVDFeature: A Toolkit for Feature-based Collaborative Filtering. Journal of Machine Learning Research (JMLR) 13, Dec (2012), 3619--3622.

Digital Library

[5]

Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural Language Processing (almost) from Scratch. Journal of Machine Learning Research (JMLR) 12, Aug (2011), 2493--2537.

Digital Library

[6]

Francois Fouss, Alain Pirotte, Jean-Michel Renders, and Marco Saerens. 2007. Random-walk Computation of Similarities Between Nodes of a Graph with Application to Collaborative Recommendation. IEEE Transactions on Knowledge and Data Engineering (TKDE) 19, 3 (2007), 355--369.

Digital Library

[7]

László Grad-Gyenge, Peter Filzmoser, and Hannes Werthner. 2015. Recommendations on a Knowledge Graph. In 1st International Workshop on Machine Learning Methods for Recommender Systems, MLRec. 13--20.

[8]

Aditya Grover and Jure Leskovec. 2016. Node2vec: Scalable Feature Learning for Networks. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD). ACM, 855--864.

Digital Library

[9]

Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural Collaborative Filtering. In Proceedings of the 26th International Conference on World Wide Web (WWW). International World Wide Web Conferences Steering Committee, 173--182.

Digital Library

[10]

Alexandros Karatzoglou, Xavier Amatriain, Linas Baltrunas, and Nuria Oliver. 2010. Multiverse Recommendation: N-dimensional Tensor Factorization for Context-aware Collaborative Filtering. In Proceedings of the 4th ACM Conference on Recommender Systems (RecSys). ACM, 79--86.

Digital Library

[11]

Yann LeCun, Yoshua Bengio, et al. 1995. Convolutional Networks for Images, Speech, and Time Series. The handbook of Brain Theory and Neural Networks 3361, 10 (1995), 1995.

Digital Library

[12]

Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015. Learning Entity and Relation Embeddings for Knowledge Graph Completion. In Proceedings of 29th AAAI Conference on Artificial Intelligence (AAAI), Vol. 15. 2181--2187.

Digital Library

[13]

Zemin Liu, Vincent W Zheng, Zhou Zhao, Fanwei Zhu, Kevin Chen-Chuan Chang, Minghui Wu, and Jing Ying. 2017. Semantic Proximity Search on Heterogeneous Graph by Proximity Embedding. In Proceedings of 31st AAAI Conference on Artificial Intelligence (AAAI).

[14]

Zemin Liu, Vincent W Zheng, Zhou Zhao, Fanwei Zhu, Kevin Chen-Chuan Chang, Minghui Wu, and Jing Ying. 2018. Distance-aware dag embedding for proximity search on heterogeneous graphs. In Proceedings of 32nd AAAI Conference on Artificial Intelligence (AAAI). AAAI.

[15]

Chen Luo, Wei Pang, Zhe Wang, and Chenghua Lin. 2014. Hete-cf: Social-based Collaborative Filtering Recommendation using Heterogeneous Relations. In Data Mining (ICDM), 2014 IEEE International Conference on. IEEE, 917--922.

Digital Library

[16]

Andriy Mnih and Ruslan R Salakhutdinov. 2008. Probabilistic Matrix Factorization. In Advances in Neural Information Processing Systems. 1257--1264.

Digital Library

[17]

Wenjie Pei, Tadas Baltrušaitis, David MJ Tax, and Louis-Philippe Morency. 2017. Temporal Attention-gated Model for Robust Sequence Classification. In Computer Vision and Pattern Recognition (CVPR), 2017 IEEE Conference on. IEEE, 820--829.

[18]

Wenjie Pei, Jie Yang, Zhu Sun, Jie Zhang, Alessandro Bozzon, and David MJ Tax. 2017. Interacting Attention-gated Recurrent Networks for Recommendation. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (CIKM). ACM, 1459--1468.

Digital Library

[19]

Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. Deepwalk: Online Learning of Social Representations. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD). ACM, 701--710.

Digital Library

[20]

Tuan-Anh Nguyen Pham, Xutao Li, Gao Cong, and Zhenjie Zhang. 2015. A General Graph-based Model for Recommendation in Event-based Social Networks. In Data Engineering (ICDE), 2015 IEEE 31st International Conference on. IEEE, 567--578.

[21]

Tuan-Anh Nguyen Pham, Xutao Li, Gao Cong, and Zhenjie Zhang. 2016. A General Recommendation Model for Heterogeneous Networks. IEEE Transactions on Knowledge and Data Engineering (TKDE) 28, 12 (2016), 3140--3153.

Digital Library

[22]

M Ross Quillan. 1968. Semantic Memory. In Semantic Information Processing.

[23]

Steffen Rendle. 2010. Factorization Machines. In Data Mining (ICDM), 2010 IEEE 10th International Conference on. IEEE, 995--1000.

Digital Library

[24]

Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian Personalized Ranking from Implicit Feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (UAI). AUAI Press, 452--461.

Digital Library

[25]

Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl. 2001. Item-based Collaborative Filtering Recommendation Algorithms. In Proceedings of the 10th International Conference on World Wide Web (WWW). ACM, 285--295.

Digital Library

[26]

Mike Schuster and Kuldip K Paliwal. 1997. Bidirectional Recurrent Neural Networks. IEEE Transactions on Signal Processing 45, 11 (1997), 2673--2681.

Digital Library

[27]

Chuan Shi, Jian Liu, Fuzhen Zhuang, S Yu Philip, and Bin Wu. 2016. Integrating Heterogeneous Information via Flexible Regularization Framework for Recommendation. Knowledge and Information Systems 49, 3 (2016), 835--859.

Digital Library

[28]

Chuan Shi, Zhiqiang Zhang, Ping Luo, Philip S Yu, Yading Yue, and Bin Wu. 2015. Semantic Path based Personalized Recommendation on Weighted Heterogeneous Information Networks. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management (CIKM). ACM, 453--462.

Digital Library

[29]

Yue Shi, Martha Larson, and Alan Hanjalic. 2014. Collaborative Filtering Beyond the User-item Matrix: A Survey of the State of The Art and Future Challenges. ACM Computing Surveys (CSUR) 47, 1 (2014), 3.

Digital Library

[30]

Ajit P Singh and Geoffrey J Gordon. 2008. Relational Learning via Collective Matrix Factorization. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD). ACM, 650--658.

Digital Library

[31]

Alexander J Smola and Risi Kondor. 2003. Kernels and Regularization on Graphs. In Learning Theory and Kernel Machines (COLT). Springer, 144--158.

[32]

Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A Simple Way to Prevent Neural Networks from Overrating. The Journal of Machine Learning Research (JMLR) 15, 1 (2014), 1929--1958.

Digital Library

[33]

Yizhou Sun, Jiawei Han, Xifeng Yan, Philip S Yu, and Tianyi Wu. 2011. Path-sim: Meta Path-based Top-k Similarity Search in Heterogeneous Information Networks. Proceedings of the VLDB Endowment 4, 11 (2011), 992--1003.

Digital Library

[34]

Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014. Sequence to sequence learning with neural networks. In Advances in Neural Information Processing Systems(NIPS). 3104--3112.

Digital Library

[35]

Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei. 2015. Line: Large-scale Information Network Embedding. In Proceedings of the 24th International Conference on World Wide Web (WWW). International World Wide Web Conferences Steering Committee, 1067--1077.

Digital Library

[36]

Ellen M Voorhees et al. 1999. The TREC-8 Question Answering Track Report. In Trec, Vol. 99. 77--82.

[37]

Yueyang Wang, Yuanfang Xia, Siliang Tang, Fei Wu, and Yueting Zhuang. 2017. Flickr Group Recommendation with Auxiliary Information in Heterogeneous Information Networks. Multimedia Systems 23, 6 (2017), 703--712.

Digital Library

[38]

Paul J Werbos. 1988. Generalization of Backpropagation with Application to a Recurrent Gas Market Model. Neural networks 1, 4 (1988), 339--356.

[39]

Chao-Yuan Wu, Amr Ahmed, Alex Beutel, Alexander J Smola, and How Jing. 2017. Recurrent Recommender Networks. In Proceedings of the 10th ACM International Conference on Web Search and Data Mining (WSDM). ACM, 495--503.

Digital Library

[40]

Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, and Yoshua Bengio. 2015. Show, Attend and Tell: Neural Image Caption Generation with Visual Attention. In International Conference on Machine Learning (ICML). 2048--2057.

Digital Library

[41]

Xiao Yu, Xiang Ren, Quanquan Gu, Yizhou Sun, and Jiawei Han. 2013. Collaborative Filtering with Entity Similarity Regularization in Heterogeneous Information Networks. Proceedings of 5th IJCAI Workshop on Heterogeneous Information Network Analysis (IJCAI-HINA) 27 (2013).

[42]

Xiao Yu, Xiang Ren, Yizhou Sun, Quanquan Gu, Bradley Sturt, Urvashi Khandelwal, Brandon Norick, and Jiawei Han. 2014. Personalized Entity Recommendation: A Heterogeneous Information Network Approach. In Proceedings of the 7th ACM International Conference on Web Search and Data Mining (WSDM). ACM, 283--292.

Digital Library

[43]

Xiao Yu, Xiang Ren, Yizhou Sun, Bradley Sturt, Urvashi Khandelwal, Quanquan Gu, Brandon Norick, and Jiawei Han. 2013. Recommendation in Heterogeneous Information Networks with Implicit User Feedback. In Proceedings of the 7th ACM conference on Recommender Systems (RecSys). ACM, 347--350.

Digital Library

[44]

Fuzheng Zhang, Nicholas Jing Yuan, Defu Lian, Xing Xie, and Wei-Ying Ma. 2016. Collaborative Knowledge base Embedding for Recommender Systems. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD). ACM, 353--362.

Digital Library

[45]

Jing Zheng, Jian Liu, Chuan Shi, Fuzhen Zhuang, Jingzhi Li, and Bin Wu. 2017. Recommendation in Heterogeneous Information Network via Dual Similarity Regularization. International Journal of Data Science and Analytics 3, 1 (2017), 35--48.

Cited By

Hua QZhou JZhang FDong CXu D(2025)Attention-Enhanced and Knowledge-Fused Dual Item Representations Network for RecommendationTsinghua Science and Technology10.26599/TST.2023.901014330:2(585-599)Online publication date: Apr-2025
https://doi.org/10.26599/TST.2023.9010143
Cao YShang SWang JZhang W(2025)Explainable Session-Based Recommendation via Path ReasoningIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.348632637:1(278-290)Online publication date: Jan-2025
https://doi.org/10.1109/TKDE.2024.3486326
Elahi EAnwar SAl-kfairy MRodrigues JNgueilbaye AHalim ZWaqas M(2025)Graph attention-based neural collaborative filtering for item-specific recommendation system using knowledge graphExpert Systems with Applications10.1016/j.eswa.2024.126133266(126133)Online publication date: Mar-2025
https://doi.org/10.1016/j.eswa.2024.126133
Show More Cited By

Index Terms

Recurrent knowledge graph embedding for effective recommendation
1. Information systems
  1. Information systems applications
    1. Data mining
      1. Collaborative filtering

Recommendations

Deep Hybrid Knowledge Graph Embedding for Top-N Recommendation
Web Information Systems and Applications
Abstract
In knowledge graph (KG) based recommender systems, path-based methods make recommendations by building user-item graphs and exploiting connectivity patterns between the entities in the graph. To overcome the limitations of traditional meta-path ...
Knowledge-aware fine-grained attention networks with refined knowledge graph embedding for personalized recommendation
Abstract
Recommendation systems aim to provide users with personalized and accurate services by integrating various machine learning technologies. Suffering from the puzzles such as cold-start and data sparsity, recommendation models has received ...
Highlights
- An end-to-end recommendation model KFGAN is proposed.
- KFGAN construct a fine-grained attention network to exploring user preferences.
- We learns from contrastive learning approach to reduces redundant KG signal.
- KFGAN mines the ...
Temporal Knowledge Graph Incremental Construction Model for Recommendation
Web and Big Data
Abstract
Knowledge graph (KG) has been proven to be effective to improve the performance of recommendation because of exploiting structural and semantic paths information in a static knowledge base. However, the KG is an incremental construction process ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

RecSys '18: Proceedings of the 12th ACM Conference on Recommender Systems

September 2018

600 pages

ISBN:9781450359016

DOI:10.1145/3240323

General Chairs:
Sole Pera
Boise State University
,
Michael Ekstrand
Boise State University
,
Program Chairs:
Xavier Amatriain
Curai, USA
,
John O'Donovan
University of California, Santa Barbara

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 September 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

RecSys '18

Sponsor:

SIGCHI

RecSys '18: Twelfth ACM Conference on Recommender Systems

October 2, 2018

British Columbia, Vancouver, Canada

Acceptance Rates

RecSys '18 Paper Acceptance Rate 32 of 181 submissions, 18%;

Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

254
Total Citations
View Citations
3,333
Total Downloads

Downloads (Last 12 months)228
Downloads (Last 6 weeks)18

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hua QZhou JZhang FDong CXu D(2025)Attention-Enhanced and Knowledge-Fused Dual Item Representations Network for RecommendationTsinghua Science and Technology10.26599/TST.2023.901014330:2(585-599)Online publication date: Apr-2025
https://doi.org/10.26599/TST.2023.9010143
Cao YShang SWang JZhang W(2025)Explainable Session-Based Recommendation via Path ReasoningIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.348632637:1(278-290)Online publication date: Jan-2025
https://doi.org/10.1109/TKDE.2024.3486326
Elahi EAnwar SAl-kfairy MRodrigues JNgueilbaye AHalim ZWaqas M(2025)Graph attention-based neural collaborative filtering for item-specific recommendation system using knowledge graphExpert Systems with Applications10.1016/j.eswa.2024.126133266(126133)Online publication date: Mar-2025
https://doi.org/10.1016/j.eswa.2024.126133
Zeng JWang NLi J(2025)Knowledge-driven hierarchical intents modeling for recommendationExpert Systems with Applications10.1016/j.eswa.2024.125361259(125361)Online publication date: Jan-2025
https://doi.org/10.1016/j.eswa.2024.125361
Yu QWang HLiu YJin DLi YZhu LFeng J(2024)Mobility Prediction via Rule-enhanced Knowledge GraphACM Transactions on Knowledge Discovery from Data10.1145/367701918:9(1-21)Online publication date: 9-Oct-2024
https://dl.acm.org/doi/10.1145/3677019
Eytan LBogina VBen-Gal IKoenigstein N(2024)KPAR: Knowledge-aware Path-based Attentive Recommender with InterpretabilityACM Transactions on Recommender Systems10.1145/3673243Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3673243
Meng SZhou JChen XLiu YLu FHuang X(2024)Structure-Information-Based Reasoning over the Knowledge Graph: A Survey of Methods and ApplicationsACM Transactions on Knowledge Discovery from Data10.1145/367114818:8(1-42)Online publication date: 16-Aug-2024
https://dl.acm.org/doi/10.1145/3671148
Zheng CJiang GYan XYin PZhou QCheng J(2024)GE2: A General and Efficient Knowledge Graph Embedding Learning SystemProceedings of the ACM on Management of Data10.1145/36549862:3(1-27)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3654986
Zhou CChen HZhang JLi QHu D(2024)Quintuple-based Representation Learning for Bipartite Heterogeneous NetworksACM Transactions on Intelligent Systems and Technology10.1145/365397815:3(1-19)Online publication date: 17-May-2024
https://dl.acm.org/doi/10.1145/3653978
Sun ZFeng KYang JFang HQu XOng YLiu W(2024)Revisiting Bundle Recommendation for Intent-aware Product BundlingACM Transactions on Recommender Systems10.1145/36528652:3(1-34)Online publication date: 15-Mar-2024
https://dl.acm.org/doi/10.1145/3652865
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten