research-article

Hypercomplex Graph Collaborative Filtering

Authors:

Farookh HussainAuthors Info & Claims

WWW '22: Proceedings of the ACM Web Conference 2022

Pages 1914 - 1922

https://doi.org/10.1145/3485447.3512065

Published: 25 April 2022 Publication History

Abstract

Hypercomplex algebras are well-developed in the area of mathematics. Recently, several hypercomplex recommendation approaches have been proposed and yielded great success. However, two vital issues have not been well-considered in existing hypercomplex recommenders. First, these methods are only designed for specific and low-dimensional hypercomplex algebras (e.g., complex and quaternion algebras), ignoring the exploration and utilization of high-dimensional ones. Second, most recommenders treat every user-item interaction as an isolated data instance, without considering high-order collaborative relationships.

To bridge these gaps, in this paper, we propose a novel recommendation framework named HyperComplex Graph Collaborative Filtering (HCGCF). To study the high-dimensional hypercomplex algebras, we introduce Cayley–Dickson construction which utilizes a recursive process to define hypercomplex algebras and their mathematical operations. Based on Cayley–Dickson construction, we devise a hypercomplex graph convolution operator to learn user and item representations. Specifically, the operator models both the neighborhood summary and interaction relations with neighbors in hypercomplex spaces, effectively exploiting the high-order connectivity in the user-item bipartite graph. To the best of our knowledge, it is the first time that Cayley-Dickson construction and graph convolution techniques have been explicitly discussed and used in hypercomplex recommender systems. Compared with several state-of-the-art recommender baselines, HCGCF achieves superior performance in both click-through rate prediction and top-K recommendation on three real-world datasets.

References

[1]

Daniel Alfsmann. 2006. On families of 2 N-dimensional hypercomplex algebras suitable for digital signal processing. In EUSIPCO. 1–4.

[2]

John Baez. 2002. The octonions. Bulletin of the american mathematical society 39, 2 (2002), 145–205.

[3]

Rianne van den Berg, Thomas N Kipf, and Max Welling. 2017. Graph convolutional matrix completion. In KDD.

[4]

Jiangxia Cao, Xixun Lin, Shu Guo, Luchen Liu, Tingwen Liu, and Bin Wang. 2021. Bipartite graph embedding via mutual information maximization. In WSDM. 635–643.

[5]

Jie Chen, Tengfei Ma, and Cao Xiao. 2018. Fastgcn: fast learning with graph convolutional networks via importance sampling. In ICLR.

[6]

Lei Chen, Le Wu, Richang Hong, Kun Zhang, and Meng Wang. 2020. Revisiting graph based collaborative filtering: A linear residual graph convolutional network approach. In AAAI. 27–34.

[7]

Tong Chen, Hongzhi Yin, Xiangliang Zhang, Zi Huang, Yang Wang, and Meng Wang. 2021. Quaternion Factorization Machines: A Lightweight Solution to Intricate Feature Interaction Modelling. TNNLS (2021).

[8]

Weiyu Cheng, Yanyan Shen, Yanmin Zhu, and Linpeng Huang. 2018. DELF: A Dual-Embedding based Deep Latent Factor Model for Recommendation. In IJCAI. 3329–3335.

[9]

Colin Cooper, Sang Hyuk Lee, Tomasz Radzik, and Yiannis Siantos. 2014. Random walks in recommender systems: exact computation and simulations. In WWW. 811–816.

[10]

Craig Culbert. 2007. Cayley-Dickson algebras and loops. Journal of Forensic Biomechanics 1, 1 (2007), 1–17.

[11]

Leonard E Dickson. 1919. On quaternions and their generalization and the history of the eight square theorem. Annals of Mathematics(1919), 155–171.

[12]

Yaxing Fang, Pengpeng Zhao, Guanfeng Liu, Yanchi Liu, Victor S Sheng, Lei Zhao, and Xiaofang Zhou. 2021. Quaternion-Based Graph Convolution Network for Recommendation. arXiv preprint arXiv:2111.10536(2021).

[13]

Chase J Gaudet and Anthony S Maida. 2020. Generalizing Complex/Hyper-complex Convolutions to Vector Map Convolutions. arXiv preprint arXiv:2009.04083(2020).

[14]

Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In AISTATS. 249–256.

[15]

Marco Gori, Augusto Pucci, V Roma, and I Siena. 2007. Itemrank: A random-walk based scoring algorithm for recommender engines. In IJCAI. 2766–2771.

[16]

Huifeng Guo, Ruiming Tang, Yunming Ye, Zhenguo Li, and Xiuqiang He. 2017. DeepFM: a factorization-machine based neural network for CTR prediction. In IJCAI.

[17]

Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, Yongdong Zhang, and Meng Wang. 2020. Lightgcn: Simplifying and powering graph convolution network for recommendation. In SIGIR. 639–648.

Digital Library

[18]

Xiangnan He, Ming Gao, Min-Yen Kan, and Dingxian Wang. 2016. Birank: Towards ranking on bipartite graphs. IEEE Transactions on Knowledge and Data Engineering 29, 1(2016), 57–71.

Digital Library

[19]

Xiangnan He, Zhankui He, Jingkuan Song, Zhenguang Liu, Yu-Gang Jiang, and Tat-Seng Chua. 2018. Nais: Neural attentive item similarity model for recommendation. IEEE Transactions on Knowledge and Data Engineering 30, 12(2018), 2354–2366.

Digital Library

[20]

Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In WWW. 173–182.

[21]

Thomas N Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In ICLR.

[22]

Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer (2009), 30–37.

Digital Library

[23]

Kantor I L, Kantor I L, and Solodovnikov A S. 1989. Hypercomplex numbers: an elementary introduction to algebras. Springer.

[24]

Srdan Lazendic, Aleksandra Pizurica, and Hendrik De Bie. 2018. Hypercomplex algebras for dictionary learning. In AGACSE. 57–64.

[25]

Anchen Li, Bo Yang, Hongxu Chen, and Guandong Xu. 2021. Hyperbolic Neural Collaborative Recommender. arXiv preprint arXiv:2104.07414(2021).

[26]

Anchen Li, Bo Yang, Huan Huo, and Farookh Khadeer Hussain. 2021. Leveraging implicit relations for recommender systems. Information Sciences 579(2021), 55–71.

[27]

Zhaopeng Li, Qianqian Xu, Yangbangyan Jiang, Xiaochun Cao, and Qingming Huang. 2020. Quaternion-Based Knowledge Graph Network for Recommendation. In MM. 880–888.

[28]

Tu Dinh Nguyen, Dinh Phung, 2021. Quaternion graph neural networks. In ACML. PMLR, 236–251.

[29]

Titouan Parcollet, Mirco Ravanelli, Mohamed Morchid, Georges Linarès, Chiheb Trabelsi, Renato De Mori, and Yoshua Bengio. 2019. Quaternion recurrent neural networks. In ICLR.

[30]

Dario Pavllo, Christoph Feichtenhofer, Michael Auli, and David Grangier. 2020. Modeling human motion with quaternion-based neural networks. IJCV 128, 4 (2020), 855–872.

Digital Library

[31]

Metod Saniga, Frédéric Holweck, and Petr Pracna. 2014. Cayley-Dickson algebras and finite geometry. arXiv preprint arXiv:1405.6888(2014).

[32]

Chuan Shi, Binbin Hu, Wayne Xin Zhao, and S Yu Philip. 2018. Heterogeneous information network embedding for recommendation. IEEE Transactions on Knowledge and Data Engineering 31, 2(2018), 357–370.

Digital Library

[33]

Jianing Sun, Yingxue Zhang, Wei Guo, Huifeng Guo, Ruiming Tang, Xiuqiang He, Chen Ma, and Mark Coates. 2020. Neighbor interaction aware graph convolution networks for recommendation. In SIGIR. 1289–1298.

[34]

Zhiqing Sun, Zhi-Hong Deng, Jian-Yun Nie, and Jian Tang. 2019. Rotate: Knowledge graph embedding by relational rotation in complex space. In ICLR.

[35]

Jiaxi Tang and Ke Wang. 2018. Personalized top-n sequential recommendation via convolutional sequence embedding. In WSDM. 565–573.

[36]

Yi Tay, Aston Zhang, Luu Anh Tuan, Jinfeng Rao, Shuai Zhang, Shuohang Wang, Jie Fu, and Siu Cheung Hui. 2019. Lightweight and efficient neural natural language processing with quaternion networks. In ACL. 1494–1503.

[37]

Chiheb Trabelsi, Olexa Bilaniuk, Ying Zhang, Dmitriy Serdyuk, Sandeep Subramanian, Joao Felipe Santos, Soroush Mehri, Negar Rostamzadeh, Yoshua Bengio, and Christopher J Pal. 2018. Deep complex networks. In ICLR.

[38]

Thanh Tran, Di You, and Kyumin Lee. 2020. Quaternion-based self-attentive long short-term user preference encoding for recommendation. In CIKM. 1455–1464.

[39]

Théo Trouillon, Johannes Welbl, Sebastian Riedel, Éric Gaussier, and Guillaume Bouchard. 2016. Complex embeddings for simple link prediction. In ICML. 2071–2080.

[40]

Laurens Van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE.Journal of machine learning research 9, 11 (2008).

[41]

Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2018. Graph attention networks. In ICLR.

[42]

Guilherme Vieira and Marcos Eduardo Valle. 2020. Extreme Learning Machines on Cayley-Dickson Algebra Applied for Color Image Auto-Encoding. In IJCNN. 1–8.

[43]

Guilherme Vieira and Marcos Eduardo Valle. 2021. A General Framework for Hypercomplex-valued Extreme Learning Machines. arXiv preprint arXiv:2101.06166(2021).

[44]

Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat-Seng Chua. 2019. Neural graph collaborative filtering. In SIGIR. 165–174.

[45]

Hong-Jian Xue, Xinyu Dai, Jianbing Zhang, Shujian Huang, and Jiajun Chen. 2017. Deep Matrix Factorization Models for Recommender Systems. In IJCAI. 3203–3209.

[46]

Jheng-Hong Yang, Chih-Ming Chen, Chuan-Ju Wang, and Ming-Feng Tsai. 2018. HOP-rec: high-order proximity for implicit recommendation. In RecSys. 140–144.

[47]

Baolin Yi, Xiaoxuan Shen, Hai Liu, Zhaoli Zhang, Wei Zhang, Sannyuya Liu, and Naixue Xiong. 2019. Deep matrix factorization with implicit feedback embedding for recommendation system. IEEE Transactions on Industrial Informatics 15, 8 (2019), 4591–4601.

[48]

Shuai Zhang, Yi Tay, Lina Yao, and Qi Liu. 2019. Quaternion knowledge graph embeddings. In NeurIPS. 2731–2741.

[49]

Shuai Zhang, Lina Yao, Lucas Vinh Tran, Aston Zhang, and Yi Tay. 2019. Quaternion Collaborative Filtering for Recommendation. In IJCAI. 4313–4319.

[50]

Xuanyu Zhu, Yi Xu, Hongteng Xu, and Changjian Chen. 2018. Quaternion convolutional neural networks. In ECCV. 631–647.

Cited By

Ma JBian KXu YZhu L(2024)ANAGL: A Noise-resistant and Anti-sparse Graph Learning for micro-video recommendationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/3670407Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670407
Li YLiu KSatapathy RWang SCambria E(2024)Recent Developments in Recommender Systems: A Survey [Review Article]IEEE Computational Intelligence Magazine10.1109/MCI.2024.336398419:2(78-95)Online publication date: May-2024
https://doi.org/10.1109/MCI.2024.3363984
Li AYang BHuo HHussain FXu G(2024)Structure- and Logic-Aware Heterogeneous Graph Learning for Recommendation2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00048(544-556)Online publication date: 13-May-2024
https://doi.org/10.1109/ICDE60146.2024.00048
Show More Cited By

Index Terms

Hypercomplex Graph Collaborative Filtering
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing theory, concepts and paradigms
      1. Collaborative filtering
2. Information systems
  1. Information retrieval
    1. Retrieval tasks and goals
  2. Information systems applications

Index terms have been assigned to the content through auto-classification.

Recommendations

Typicality-Based Collaborative Filtering Recommendation

Collaborative filtering (CF) is an important and popular technology for recommender systems. However, current CF methods suffer from such problems as data sparsity, recommendation inaccuracy, and big-error in predictions. In this paper, we borrow ideas ...
Kernelized probabilistic matrix factorization for collaborative filtering: exploiting projected user and item graph
RecSys '18: Proceedings of the 12th ACM Conference on Recommender Systems

Matrix Factorization (MF) techniques have already shown its strong foundation in collaborative filtering (CF), particularly for rating prediction problem. In the basic MF model, the use of additional information such as social network, item tags along ...
Item enhanced graph collaborative network for collaborative filtering recommendation
Abstract
Learning vector embeddings of users and items is the core of modern recommender systems. Recently the collaborative filtering recommender systems based on graph convolutional networks, which integrates the bipartite graph of user-item interaction ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WWW '22: Proceedings of the ACM Web Conference 2022

April 2022

3764 pages

ISBN:9781450390965

DOI:10.1145/3485447

Editors:
Frédérique Laforest
INSA Lyon, France
,
Raphaël Troncy
EURECOM, France
,
Elena Simperl
King’s College London, UK
,
Deepak Agarwal
Pinterest, USA
,
Aristides Gionis
KTH Royal Institute of Technology, Sweden
,
Ivan Herman
W3C / retired
,
Lionel Médini
Université Lyon 1, France

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Jilin Province Key Scientific and Technological Research and Development Project
Jilin Province Natural Science Foundation
the National Natural Science Foundation of China
the National Key R&D Program of China

Conference

WWW '22

Sponsor:

SIGWEB

WWW '22: The ACM Web Conference 2022

April 25 - 29, 2022

Virtual Event, Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
537
Total Downloads

Downloads (Last 12 months)91
Downloads (Last 6 weeks)4

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ma JBian KXu YZhu L(2024)ANAGL: A Noise-resistant and Anti-sparse Graph Learning for micro-video recommendationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/3670407Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670407
Li YLiu KSatapathy RWang SCambria E(2024)Recent Developments in Recommender Systems: A Survey [Review Article]IEEE Computational Intelligence Magazine10.1109/MCI.2024.336398419:2(78-95)Online publication date: May-2024
https://doi.org/10.1109/MCI.2024.3363984
Li AYang BHuo HHussain FXu G(2024)Structure- and Logic-Aware Heterogeneous Graph Learning for Recommendation2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00048(544-556)Online publication date: 13-May-2024
https://doi.org/10.1109/ICDE60146.2024.00048
Liu LHuang FLiu XXiong ZLi MSong CZhang WElkind E(2023)Multi-view contrastive learning hypergraph neural network for drug-microbe-disease association predictionProceedings of the Thirty-Second International Joint Conference on Artificial Intelligence10.24963/ijcai.2023/537(4829-4837)Online publication date: 19-Aug-2023
https://dl.acm.org/doi/10.24963/ijcai.2023/537

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents