Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3219819.3219965acmotherconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Leveraging Meta-path based Context for Top- N Recommendation with A Neural Co-Attention Model

Published: 19 July 2018 Publication History

Abstract

Heterogeneous information network (HIN) has been widely adopted in recommender systems due to its excellence in modeling complex context information. Although existing HIN based recommendation methods have achieved performance improvement to some extent, they have two major shortcomings. First, these models seldom learn an explicit representation for path or meta-path in the recommendation task. Second, they do not consider the mutual effect between the meta-path and the involved user-item pair in an interaction. To address these issues, we develop a novel deep neural network with the co-attention mechanism for leveraging rich meta-path based context for top-N recommendation. We elaborately design a three-way neural interaction model by explicitly incorporating meta-path based context. To construct the meta-path based context, we propose to use a priority based sampling technique to select high-quality path instances. Our model is able to learn effective representations for users, items and meta-path based context for implementing a powerful interaction function. The co-attention mechanism improves the representations for meta-path based con- text, users and items in a mutual enhancement way. Extensive experiments on three real-world datasets have demonstrated the effectiveness of the proposed model. In particular, the proposed model performs well in the cold-start scenario and has potentially good interpretability for the recommendation results.

Supplementary Material

MP4 File (hu_meta_path_based.mp4)

References

[1]
Gediminas Adomavicius and Alexander Tuzhilin . 2015. Context-aware recommender systems. In Recommender systems handbook. 191--226.
[2]
Jingyuan Chen, Hanwang Zhang, Xiangnan He, Liqiang Nie, Wei Liu, and Tat-Seng Chua . 2017. Attentive collaborative filtering: Multimedia recommendation with item-and component-level attention. In Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval. 335--344.
[3]
Tianqi Chen, Weinan Zhang, Qiuxia Lu, Kailong Chen, Zhao Zheng, and Yong Yu . 2012. SVDFeature: a toolkit for feature-based collaborative filtering. Journal of Machine Learning Research Vol. 13 (2012), 3619--3622.
[4]
Yuxiao Dong, Nitesh V Chawla, and Ananthram Swami . 2017. metapath2vec: Scalable representation learning for heterogeneous networks Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 135--144.
[5]
Wei Feng and Jianyong Wang . 2012. Incorporating heterogeneous information for personalized tag recommendation in social tagging systems. In Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining. 1276--1284.
[6]
Tao Yang Fu, Wang Chien Lee, and Zhen Lei . 2017. HIN2Vec: Explore Meta-paths in Heterogeneous Information Networks for Representation Learning. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 1797--1806.
[7]
Aditya Grover and Jure Leskovec . 2016. node2vec: Scalable feature learning for networks. In Proceedings of the 22nd ACM SIGKDD international conference on Knowledge discovery and data mining. 855--864.
[8]
Yanchao Hao, Yuanzhe Zhang, Kang Liu, Shizhu He, Zhanyi Liu, Hua Wu, and Jun Zhao . 2017. An end-to-end model for question answering over knowledge base with cross-attention combining global knowledge. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics. 221--231.
[9]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun . 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.
[10]
Xiangnan He and Tat-Seng Chua . 2017. Neural factorization machines for sparse predictive analytics Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval. 355--364.
[11]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua . 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. 173--182.
[12]
Geoffrey E Hinton and Ruslan R Salakhutdinov . 2012. A better way to pretrain deep boltzmann machines. In Advances in Neural Information Processing Systems. 2447--2455.
[13]
Yifan Hu, Yehuda Koren, and Chris Volinsky . 2008. Collaborative filtering for implicit feedback datasets IEEE International Conference on Data Mining. 263--272.
[14]
Diederik P Kingma and Jimmy Ba . 2015. Adam: A method for stochastic optimization. Third International Conference on Learning Representations (2015).
[15]
Yehuda Koren and Robert Bell . 2015. Advances in collaborative filtering. In Recommender systems handbook. 77--118.
[16]
Yehuda Koren, Robert Bell, and Chris Volinsky . 2009. Matrix factorization techniques for recommender systems. Computer Vol. 42 (2009).
[17]
Aaron Q. Li, Amr Ahmed, Sujith Ravi, and Alexander J. Smola . 2014. Reducing the sampling complexity of topic models. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. 891--900.
[18]
Jian Liu, Chuan Shi, Binbin Hu, Shenghua Liu, and S Yu Philip . 2017. Personalized ranking recommendation via integrating multiple feedbacks Pacific-Asia Conference on Knowledge Discovery and Data Mining. 131--143.
[19]
Bryan Perozzi, Rami Al-Rfou, and Steven Skiena . 2014. Deepwalk: Online learning of social representations Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. 701--710.
[20]
Tuan-Anh Nguyen Pham, Xutao Li, Gao Cong, and Zhenjie Zhang . 2016. A general recommendation model for heterogeneous networks. IEEE Transactions on Knowledge and Data Engineering Vol. 28 (2016), 3140--3153.
[21]
Minh C Phan, Aixin Sun, Yi Tay, Jialong Han, and Chenliang Li . 2017. NeuPL: Attention-based Semantic Matching and Pair-Linking for Entity Disambiguation. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 1667--1676.
[22]
Steffen Rendle . 2010. Factorization machines. In IEEE 10th International Conference on Data Mining. 995--1000.
[23]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme . 2009. BPR: Bayesian personalized ranking from implicit feedback Proceedings of the twenty-fifth conference on uncertainty in artificial intelligence.
[24]
Royi Ronen, Elad Yom-Tov, and Gal Lavee . 2016. Recommendations meet web browsing: enhancing collaborative filtering using internet browsing logs. In IEEE 32nd International Conference on Data Engineering. 1230--1238.
[25]
Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl . 2001. Item-based collaborative filtering recommendation algorithms Proceedings of the 10th international conference on World Wide Web. 285--295.
[26]
Chuan Shi, Binbin Hu, Wayne Xin Zhao, and Philip S Yu . 2018. Heterogeneous Information Network Embedding for Recommendation. IEEE Transactions on Knowledge and Data Engineering (2018).
[27]
Chuan Shi, Xiangnan Kong, Yue Huang, S Yu Philip, and Bin Wu . 2014. Hetesim: A general framework for relevance measure in heterogeneous networks. IEEE Transactions on Knowledge and Data Engineering Vol. 26 (2014), 2479--2492.
[28]
Chuan Shi, Yitong Li, Jiawei Zhang, Yizhou Sun, and S Yu Philip . 2017. A survey of heterogeneous information network analysis. IEEE Transactions on Knowledge and Data Engineering Vol. 29 (2017), 17--37.
[29]
Chuan Shi, Zhiqiang Zhang, Ping Luo, Philip S Yu, Yading Yue, and Bin Wu . 2015. Semantic path based personalized recommendation on weighted heterogeneous information networks. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. 453--462.
[30]
Yizhou Sun, Jiawei Han, Xifeng Yan, Philip S Yu, and Tianyi Wu . 2011. Pathsim: Meta path-based top-k similarity search in heterogeneous information networks. Very Large Data Base Endowment Vol. 4 (2011), 992--1003.
[31]
Jian Tang, Meng Qu, Mingzhe Wang, Ming Zhang, Jun Yan, and Qiaozhu Mei . 2015. Line: Large-scale information network embedding. In Proceedings of the 24th International Conference on World Wide Web. 1067--1077.
[32]
Yi Tay, Luu Anh Tuan, and Siu Cheung Hui . 2018. Latent Relational Metric Learning via Memory-based A ention for Collaborative Ranking Proceedings of the 27th International Conference on World Wide Web.
[33]
Xin Wang, Wei Lu, Martin Ester, Can Wang, and Chun Chen . 2016. Social recommendation with strong and weak ties. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management. 5--14.
[34]
Xuejian Wang, Lantao Yu, Kan Ren, Guanyu Tao, Weinan Zhang, Yong Yu, and Jun Wang . 2017. Dynamic attention deep model for article recommendation by learning human editors' demonstration. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2051--2059.
[35]
Jun Xiao, Hao Ye, Xiangnan He, Hanwang Zhang, Fei Wu, and Tat-Seng Chua . 2017. Attentional factorization machines: Learning the weight of feature interactions via attention networks. arXiv preprint arXiv:1708.04617 (2017).
[36]
Caiming Xiong, Victor Zhong, and Richard Socher . 2017. Dynamic coattention networks for question answering. Fifth International Conference on Learning Representations (2017).
[37]
Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, and Yoshua Bengio . 2015. Show, attend and tell: Neural image caption generation with visual attention International Conference on Machine Learning. 2048--2057.
[38]
Linchuan Xu, Xiaokai Wei, Jiannong Cao, and Philip S Yu . 2017. Embedding of embedding (eoe): Joint embedding for coupled heterogeneous networks Proceedings of the Tenth ACM International Conference on Web Search and Data Mining. 741--749.
[39]
Hongzhi Yin, Yizhou Sun, Bin Cui, Zhiting Hu, and Ling Chen . 2013. LCARS: a location-content-aware recommender system Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining. 221--229.
[40]
Xiao Yu, Xiang Ren, Yizhou Sun, Quanquan Gu, Bradley Sturt, Urvashi Khandelwal, Brandon Norick, and Jiawei Han . 2014. Personalized entity recommendation: A heterogeneous information network approach Proceedings of the 7th ACM international conference on Web search and data mining. 283--292.
[41]
Huan Zhao, Quanming Yao, Jianda Li, Yangqiu Song, and Dik Lun Lee . 2017. Meta-graph based recommendation fusion over heterogeneous information networks Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 635--644.
[42]
Wayne Xin Zhao, Sui Li, Yulan He, Edward Y Chang, Ji-Rong Wen, and Xiaoming Li . 2016. Connecting social media to e-commerce: Cold-start product recommendation using microblogging information. IEEE Transactions on Knowledge and Data Engineering Vol. 28, 5 (2016), 1147--1159.
[43]
Xin Wayne Zhao, Yanwei Guo, Yulan He, Han Jiang, Yuexin Wu, and Xiaoming Li . 2014. We know what you want to buy: a demographic-based system for product recommendation on microblogs. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. 1935--1944.

Cited By

View all
  • (2025)Attention-Enhanced and Knowledge-Fused Dual Item Representations Network for RecommendationTsinghua Science and Technology10.26599/TST.2023.901014330:2(585-599)Online publication date: Apr-2025
  • (2025)DCIB: Dual contrastive information bottleneck for knowledge-aware recommendationInformation Processing & Management10.1016/j.ipm.2024.10398062:2(103980)Online publication date: Mar-2025
  • (2025)Knowledge-driven hierarchical intents modeling for recommendationExpert Systems with Applications10.1016/j.eswa.2024.125361259(125361)Online publication date: Jan-2025
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
KDD '18: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
July 2018
2925 pages
ISBN:9781450355520
DOI:10.1145/3219819
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 July 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. attention mechanism
  2. deep learning
  3. heterogeneous information network
  4. recommender system

Qualifiers

  • Research-article

Funding Sources

Conference

KDD '18
Sponsor:

Acceptance Rates

KDD '18 Paper Acceptance Rate 107 of 983 submissions, 11%;
Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)284
  • Downloads (Last 6 weeks)30
Reflects downloads up to 25 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2025)Attention-Enhanced and Knowledge-Fused Dual Item Representations Network for RecommendationTsinghua Science and Technology10.26599/TST.2023.901014330:2(585-599)Online publication date: Apr-2025
  • (2025)DCIB: Dual contrastive information bottleneck for knowledge-aware recommendationInformation Processing & Management10.1016/j.ipm.2024.10398062:2(103980)Online publication date: Mar-2025
  • (2025)Knowledge-driven hierarchical intents modeling for recommendationExpert Systems with Applications10.1016/j.eswa.2024.125361259(125361)Online publication date: Jan-2025
  • (2024)Enhancing Knowledge-Aware Recommendation with Dual-Graph Contrastive LearningInformation10.3390/info1509053415:9(534)Online publication date: 2-Sep-2024
  • (2024)Adaptive Knowledge Contrastive Learning with Dynamic Attention for Recommender SystemsElectronics10.3390/electronics1318359413:18(3594)Online publication date: 10-Sep-2024
  • (2024)KGCFRec: Improving Collaborative Filtering Recommendation with Knowledge GraphElectronics10.3390/electronics1310192713:10(1927)Online publication date: 15-May-2024
  • (2024)Hierarchical Self-Supervised Learning for Knowledge-Aware RecommendationApplied Sciences10.3390/app1420939414:20(9394)Online publication date: 15-Oct-2024
  • (2024)Transfer learning from rating prediction to Top-k recommendationPLOS ONE10.1371/journal.pone.030024019:3(e0300240)Online publication date: 28-Mar-2024
  • (2024)Self-derived Knowledge Graph Contrastive Learning for RecommendationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681693(7571-7580)Online publication date: 28-Oct-2024
  • (2024)Counterfactual Explanation for Fairness in RecommendationACM Transactions on Information Systems10.1145/364367042:4(1-30)Online publication date: 29-Jan-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media