Abstract
With the development of graph neural network, researchers begin to use bipartite graph to model user-item interactions for recommendation. It is worth noting that most of graph recommendation models represent users and items in the real-valued space, which ignore the rich representational capacity of the non-real space. Besides, the simplicity and symmetry of the inner product make it ineffectively capture the intricate antisymmetric relations between users and items in interaction modeling. In this paper, based on the framework of graph neural network, we propose Graph Collaborative Filtering for recommendation in Complex and Quaternion space (GCFC and GCFQ respectively). Specifically, we first use complex embeddings or quaternion embeddings to initialize users and items. Then, the Hermitian product (for GCFC) or Hamilton product (for GCFQ) and embedding propagation layers are used to further enrich the embeddings of users and items. As such, we can obtain both latent inter-dependencies and intra-dependencies between components of users and items. Finally, we aggregate the embeddings of different propagation layers and use the Hermitian or Hamilton product with inner product to obtain the intricate antisymmetric relations between users and items. We have carried out extensive experiments on four real-world datasets to verify the effectiveness of GCFC and GCFQ.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Availability of data and materials
Please refer to Section 5.1.1 of the paper.
References
He, X., Liao, L., Zhang, H., Nie, L., Hu, X., Chua, T.: Neural collaborative filtering. In: Proceedings of the 26th International Conference on World Wide Web, pp. 173-182 (2017)
Xue, H., Dai, X., Zhang, J., Huang, S., Chen, J.: Deep matrix factorization models for recommender systems. In: Proceedings of the 26th International Joint Conference on Artificial Intelligence, pp. 3203-3209 (2017)
Liao, J., Zhou, W., Luo, F., Wen, J., Gao, M., Li, X., Zeng, J.: Sociallgn: Light graph convolution network for social recommendation. Inf. Sci. 589, 595–607 (2022)
Yu, B., Li, X., Fang, J., Tai, C., Cheng, W., Xu, J.: Memory-augmented meta-learning framework for session-based target behavior recommendation. World Wide Web (WWW) 26(1), 233–251 (2023)
Li, Y., Guo, X., Lin, W., Zhong, M., Li, Q., Liu, Z., Zhong, W., Zhu, Z.: Learning dynamic user interest sequence in knowledge graphs for click-through rate prediction. IEEE Trans. Knowl. Data Eng. 35(1), 647–657 (2023)
van den Berg, R., Kipf, T.N., Welling, M.: Graph convolutional matrix completion. arXiv preprint arXiv:1706.02263 (2017)
Ying, R., He, R., Chen, K., Eksombatchai, P., Hamilton, W.L., Leskovec, J.: Graph convolutional neural networks for web-scale recommender systems. In: Proceedings of the 24th ACM International Conference on Knowledge Discovery & Data Mining, pp. 974-983 (2018)
Parcollet, T., Morchid, M., Linarès, G.: A survey of quaternion neural networks. Artif. Intell. Rev. 53(4), 2957–2982 (2020)
Lee, C., Hasegawa, H., Gao, S.: Complex-valued neural networks: A comprehensive survey. IEEE CAA J. Autom. Sin. 9(8), 1406–1426 (2022)
Dacrema, M.F., Cremonesi, P., Jannach, D.: Are we really making much progress? A worrying analysis of recent neural recommendation approaches. In: Proceedings of the 13th ACM Conference on Recommender Systems, pp. 101-109 (2019)
Rendle, S., Krichene, W., Zhang, L., Anderson, J.R.: Neural collaborative filtering vs. matrix factorization revisited. In: Proceedings of the 14th ACM Conference on Recommender Systems, pp. 240-248 (2020)
Sun, Z., Yu, D., Fang, H., Yang, J., Qu, X., Zhang, J., Geng, C.: Are we evaluating rigorously? benchmarking recommendation for reproducible evaluation and fair comparison. In: Proceedings of the 14th ACM Conference on Recommender Systems, pp. 23-32 (2020)
Trouillon, T., Welbl, J., Riedel, S., Gaussier, E., Bouchard, G.: Complex embeddings for simple link prediction. In: Proceedings of the 33nd International Conference on Machine Learning, pp. 2071-2080 (2016)
Zhang, S., Yao, L., Tran, L.V., Zhang, A., Tay, Y.: Quaternion collaborative filtering for recommendation. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence, pp. 4313-4319 (2019)
Gao, M., Chen, L., He, X., Zhou, A.: Bine: Bipartite network embedding. In: The 41st International ACM Conference on Research & Development in Information Retrieval, SIGIR, pp. 715-724 (2018)
Huang, W., Li, Y., Fang, Y., Fan, J., Yang, H.: Biane: Bipartite attributed network embedding. In: Proceedings of the 43rd International ACM Conference on Research and Development in Information Retrieval, SIGIR, pp. 149-158 (2020)
Wu, L., Wang, D., Feng, S., Zhou, X., Zhang, Y., Yu, G.: Graph collaborative filtering for recommendation in complex and quaternion spaces. In: Web Information Systems Engineering, vol. 13724, pp. 579-594 (2022)
Koren, Y., Bell, R.M., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 42(8), 30–37 (2009)
Yang, J., Chen, C., Wang, C., Tsai, M.: Hop-rec: high-order proximity for implicit recommendation. In: Proceedings of the 12th ACM Conference on Recommender Systems, pp. 140-144 (2018)
Chen, C., Wang, C., Tsai, M., Yang, Y.: Collaborative similarity embedding for recommender systems. In: Proceedings of the 28th International Conference on World Wide Web, pp. 2637-2643 (2019)
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: Proceedings of the 5th International Conference on Learning Representations (2017)
Zhu, T., Sun, L., Chen, G.: Graph-based embedding smoothing for sequential recommendation. IEEE Trans. Knowl. Data Eng. 35(1), 496–508 (2023)
Zhai, P., Yang, Y., Zhang, C.: Causality-based CTR prediction using graph neural networks. Inf. Process. Manag. 60(1), 103137 (2023)
Wang, X., He, X., Wang, M., Feng, F., Chua, T.: Neural graph collaborative filtering. In: Proceedings of the 42nd International ACM Conference on Research and Development in Information Retrieval, pp. 165-174 (2019)
Wu, S., Sun, F., Zhang, W., Xie, X., Cui, B.: Graph neural networks in recommender systems: A survey. ACM Comput. Surv. 55(5), 97–19737 (2023)
Trabelsi, C., Bilaniuk, O., Zhang, Y., Serdyuk, D., Subramanian, S., Santos, J.F., Mehri, S., Rostamzadeh, N., Bengio, Y., Pal, C.J.: Deep complex networks. In: Proceedings of the 6th International Conference on Learning Representations (2018)
Yang, M., Ma, M.Q., Li, D., Tsai, Y.H., Salakhutdinov, R.: Complex transformer: A framework for modeling complex-valued sequence. In: Proceedings of the 2020 IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 4232-4236 (2020)
Wisdom, S., Powers, T., Hershey, J.R., Roux, J.L., Atlas, L.E.: Full-capacity unitary recurrent neural networks. In: Annual Conference on Neural Information Processing Systems, pp. 4880-4888 (2016)
Sun, Z., Deng, Z., Nie, J., Tang, J.: Rotate: Knowledge graph embedding by relational rotation in complex space. In: Proceedings of the 7th International Conference on Learning Representations (2019)
Parcollet, T., Morchid, M., Linarès, G.: Quaternion convolutional neural networks for heterogeneous image processing. In: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP, pp. 8514-8518 (2019)
Shi, L., Geng, S., Shuang, K., Hori, C., Liu, S., Gao, P., Su, S.: Multi-layer content interaction through quaternion product for visual question answering. In: 2020 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP, pp. 4412-4416 (2020)
Nguyen, D.Q., Nguyen, T.D., Phung, D.Q.: Quaternion graph neural networks. In: Asian Conference on Machine Learning, vol. 157, pp. 236-251 (2021)
Zhang, S., Tay, Y., Yao, L., Liu, Q.: Quaternion knowledge graph embeddings. In: Advances in Neural Information Processing Systems, pp. 2731-2741 (2019)
Tay, Y., Zhang, A., Luu, A.T., Rao, J., Zhang, S., Wang, S., Fu, J., Hui, S.C.: Lightweight and efficient neural natural language processing with quaternion networks. In: Proceedings of the 57th Conference of the Association for Computational Linguistics, pp. 1494-1503 (2019)
Fang, Y., Zhao, P., Xian, X., Fang, J., Liu, G., Liu, Y., Sheng, V.S.: Quaternion-based graph contrastive learning for recommendation. In: International Joint Conference on Neural Networks, pp. 1-8 (2022)
Tran, T., You, D., Lee, K.: Quaternion-based self-attentive long short-term user preference encoding for recommendation. In: Proceedings of the 29th ACM International Conference on Information and Knowledge Management, pp. 1455-1464 (2020)
Li, Z., Xu, Q., Jiang, Y., Cao, X., Huang, Q.: Quaternion-based knowledge graph network for recommendation. In: Proceedings of the 28th ACM International Conference on Multimedia, pp. 880-888 (2020)
He, X., Deng, K., Wang, X., Li, Y., Zhang, Y., Wang, M.: Lightgcn: Simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 639-648 (2020)
Chen, L., Wu, L., Hong, R., Zhang, K., Wang, M.: Revisiting graph based collaborative filtering: A linear residual graph convolutional network approach. In: Proceedings of the 24th International Joint Conference on Artificial Intelligence, pp. 27-34 (2020)
Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. In: Proceedings of the 3rd International Conference on Learning Representations (2015)
Acknowledgements
The work was supported by National Natural Science Foundation of China (62172086, 62272092, 62106039).
Funding
The work was supported by National Natural Science Foundation of China (62172086, 62272092, 62106039).
Author information
Authors and Affiliations
Contributions
Longcan Wu: Conceptualization, Methodology, Software, Writing Original draft preparation. Daling Wang: Supervision, Validation, Funding acquisition. Shi Feng: Supervision, Validation, Funding acquisition. Xiangmin Zhou: Supervision, Validation, Funding acquisition. Yifei Zhang: Supervision, Validation, Funding acquisition. Ge Yu: Supervision, Project administration, Funding acquisition.
Corresponding author
Ethics declarations
Ethical Approval
This declaration is “not applicable”.
Competing interests
The authors have no relevant financial or non-financial interests to disclose.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This article belongs to the Topical Collection: Special Issue on Web Information Systems Engineering 2022
Guest Editor: Richard Chbeir, Helen Huang, Yannis Manolopoulos, Fabrizio Silvestri
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wu, L., Wang, D., Feng, S. et al. Graph neural network for recommendation in complex and quaternion spaces. World Wide Web 26, 3945–3964 (2023). https://doi.org/10.1007/s11280-023-01210-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11280-023-01210-x