Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Adversarial Learning for Cross Domain Recommendations

Published: 09 November 2022 Publication History

Abstract

Existing cross domain recommender systems typically assume homogeneous user preferences across multiple domains to capture similarities of user-item interactions and to provide cross domain recommendations accordingly. Meanwhile, the heterogeneity of user behaviors is usually not well studied and captured during the recommendation process, where users might have vastly different interests in different domains. In addition, previous models focus primarily on recommendation tasks between domain pairs, and cannot be naturally extended to serve for multiple domain recommendation applications. To address these challenges, we propose to utilize the idea of adversarial learning to intelligently incorporate global user preferences and domain-specific user preferences for providing satisfying cross domain recommendations. In particular, our proposed Adversarial Cross Domain Recommendation (ACDR) model first obtains the latent representations of global user preferences from their explicit feature information, and then transforms them into domain-specific user embeddings, where we take into account user behaviors and their heterogeneous preferences among different domains. By doing so, we address the differences among user representations in the domain-specific latent space while also preserving global user preferences, as we effectively segment the distributions of domain-specific user embeddings in the shared latent space. The convergence of our proposed model is theoretically guaranteed. The proposed ACDR model leads to significant and consistent improvements in cross domain recommendation performance over the state-of-the-art baseline models, which we demonstrate through extensive experiments on three real-world datasets. In addition, we show that the improvements are greater on those datasets that are smaller and more sparse, on those users that have fewer interaction records in the dataset, and when user interactions from more product domains are included in the cross domain recommendation model.

References

[1]
Gediminas Adomavicius and Alexander Tuzhilin. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. In Proceedings of the IEEE Transactions on Knowledge & Data Engineering6 (2005), 734–749.
[2]
Sanjeev Arora, Andrej Risteski, and Yi Zhang. 2018. Do GANs learn the distribution? Some theory and empirics. In Proceedings of the International Conference on Learning Representations.
[3]
Oren Barkan and Noam Koenigstein. 2016. Item2vec: Neural item embedding for collaborative filtering. In Proceedings of the 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP). IEEE, 1–6.
[4]
Homanga Bharadhwaj, Homin Park, and Brian Y. Lim. 2018. RecGAN: Recurrent generative adversarial networks for recommendation systems. In Proceedings of the 12th ACM Conference on Recommender Systems. 372–376.
[5]
Vladimir Bobrikov, Elena Nenova, and Dmitry I. Ignatov. 2016. What is a fair value of your recommendation list? In Proceedings of the 3rd Workshop on Experimental Economics and Machine Learning co-located with the 13th International Conference on Concept Lattices and Their Applications (CLA 2016), (Moscow, Russia, July 18, 2016). 1–12. http://ceur-ws.org/Vol-1627/inv1.pdf.
[6]
Iván Cantador, Ignacio Fernández-Tobías, Shlomo Berkovsky, and Paolo Cremonesi. 2015. Cross-domain recommender systems. In Recommender Systems Handbook. Springer, 919–959.
[7]
Chong Chen, Min Zhang, Chenyang Wang, Weizhi Ma, Minming Li, Yiqun Liu, and Shaoping Ma. 2019. An efficient adaptive transfer neural network for social-aware recommendation. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 225–234.
[8]
Xinshi Chen, Shuang Li, Hui Li, Shaohua Jiang, Yuan Qi, and Le Song. 2019. Generative adversarial user model for reinforcement learning based recommendation system. In Proceedings of the International Conference on Machine Learning(PMLR). 1052–1061.
[9]
Zhenhua Dong and Qian Zhao. 2012. Experimental analysis on cross domain preferences association and rating prediction. In Proceedings of the 1st International Workshop on Cross Domain Knowledge Discovery in Web and Social Network Mining. 26–31.
[10]
Wenqi Fan, Tyler Derr, Yao Ma, Jianping Wang, Jiliang Tang, and Qing Li. 2019. Deep adversarial social recommendation. arXiv preprint arXiv:1905.13160 (2019).
[11]
Chen Gao, Xiangning Chen, Fuli Feng, Kai Zhao, Xiangnan He, Yong Li, and Depeng Jin. 2019. Cross-domain recommendation without sharing user-relevant data. In Proceedings of the World Wide Web Conference. 491–502.
[12]
Sheng Gao, Hao Luo, Da Chen, Shantao Li, Patrick Gallinari, and Jun Guo. 2013. Cross-domain recommendation via cluster-level latent factor model. In Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 161–176.
[13]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Advances in Neural Information Processing Systems. 2672–2680.
[14]
Guibing Guo, Huan Zhou, Bowei Chen, Zhirong Liu, Xiao Xu, Xu Chen, Zhenhua Dong, and Xiuqiang He. 2020. IPGAN: Generating informative item pairs by adversarial sampling. IEEE Transactions on Neural Networks and Learning Systems (2020).
[15]
Xiangnan He, Zhankui He, Xiaoyu Du, and Tat-Seng Chua. 2018. Adversarial personalized ranking for recommendation. In Proceedings of the 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 355–364.
[16]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th International Conference on World Wide Web. 173–182.
[17]
Jonathan L. Herlocker, Joseph A. Konstan, Loren G. Terveen, and John T. Riedl. 2004. Evaluating collaborative filtering recommender systems. ACM Transactions on Information Systems (TOIS) 22, 1 (2004), 5–53.
[18]
Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2015. Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015).
[19]
Kurt Hornik, Maxwell Stinchcombe, and Halbert White. 1989. Multilayer feedforward networks are universal approximators. Neural Networks 2, 5 (1989), 359–366.
[20]
Liang Hou, Qi Cao, Huawei Shen, and Xueqi Cheng. 2021. Conditional GANs with auxiliary discriminative classifier. arXiv preprint arXiv:2107.10060 (2021).
[21]
Guangneng Hu, Yu Zhang, and Qiang Yang. 2018. CoNet: Collaborative cross networks for cross-domain recommendation. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management.
[22]
Liang Hu, Jian Cao, Guandong Xu, Longbing Cao, Zhiping Gu, and Can Zhu. 2013. Personalized recommendation via cross-domain triadic factorization. In Proceedings of the 22nd International Conference on World Wide Web.
[23]
Ling Huang, Anthony D. Joseph, Blaine Nelson, Benjamin I. P. Rubinstein, and J. Doug Tygar. 2011. Adversarial machine learning. In Proceedings of the 4th ACM Workshop on Security and Artificial Intelligence. 43–58.
[24]
Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In Proceedings of the International Conference on Machine Learning. 448–456.
[25]
Sang-Young Jo, Sun-Hye Jang, Hee-Eun Cho, and Jin-Woo Jeong. 2019. Scenery-based fashion recommendation with cross-domain geneartive adverserial networks. In Proceedings of the 2019 IEEE International Conference on Big Data and Smart Computing (BigComp). IEEE, 1–4.
[26]
Heishiro Kanagawa, Hayato Kobayashi, Nobuyuki Shimizu, Yukihiro Tagami, and Taiji Suzuki. 2019. Cross-domain recommendation via deep domain adaptation. In Proceedings of the European Conference on Information Retrieval. Springer, 20–29.
[27]
SeongKu Kang, Junyoung Hwang, Dongha Lee, and Hwanjo Yu. 2019. Semi-supervised learning for cross-domain recommendation to cold-start users. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 1563–1572.
[28]
Muhammad Murad Khan, Roliana Ibrahim, and Imran Ghani. 2017. Cross domain recommender systems: A systematic literature review. ACM Computing Surveys (CSUR) 50, 3 (2017), 1–34.
[29]
Bin Li, Qiang Yang, and Xiangyang Xue. 2009. Can movies and books collaborate? Cross-domain collaborative filtering for sparsity reduction. In Proceedings of the 21st International Joint Conference on Artificial Intelligence.
[30]
Muyang Li, Xiangyu Zhao, Chuan Lyu, Minghao Zhao, Runze Wu, and Ruocheng Guo. 2022. MLP4Rec: A pure MLP architecture for sequential recommendations. arXiv preprint arXiv:2204.11510 (2022).
[31]
Pan Li, Zhichao Jiang, Maofei Que, Yao Hu, and Alexander Tuzhilin. 2021. Dual attentive sequential learning for cross-domain click-through rate prediction. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 3172–3180.
[32]
Pan Li and Alexander Tuzhilin. 2020. DDTCDR: Deep dual transfer cross domain recommendation. In Proceedings of the 13th International Conference on Web Search and Data Mining. 331–339.
[33]
Pan Li and Alexander Tuzhilin. 2021. Dual metric learning for effective and efficient cross-domain recommendations. IEEE Transactions on Knowledge and Data Engineering (2021).
[34]
Yakun Li, Jiadong Ren, Jiaomin Liu, and Yixin Chang. 2021. Deep sparse autoencoder prediction model based on adversarial learning for cross-domain recommendations. Knowledge-Based Systems 220 (2021), 106948.
[35]
Ying Li, Jia-Jie Xu, Peng-Peng Zhao, Jun-Hua Fang, Wei Chen, and Lei Zhao. 2020. ATLRec: An attentional adversarial transfer learning network for cross-domain recommendation. Journal of Computer Science and Technology 35, 4 (2020), 794–808.
[36]
Jianxun Lian, Fuzheng Zhang, Xing Xie, and Guangzhong Sun. 2017. CCCFNet: A content-boosted collaborative filtering neural network for cross domain recommender systems. In Proceedings of the 26th International Conference on World Wide Web Companion. 817–818.
[37]
Huiting Liu, Lingling Guo, Peipei Li, Peng Zhao, and Xindong Wu. 2021. Collaborative filtering with a deep adversarial and attention network for cross-domain recommendation. Information Sciences 565 (2021), 370–389.
[38]
Qiang Liu, Shu Wu, Diyi Wang, Zhaokang Li, and Liang Wang. 2016. Context-aware sequential recommendation. In Proceedings of the 2016 IEEE 16th International Conference on Data Mining (ICDM). IEEE, 1053–1058.
[39]
Zhiwei Liu, Lei Zheng, Jiawei Zhang, Jiayu Han, and S. Yu Philip. 2019. JSCN: Joint spectral convolutional network for cross domain recommendation. In Proceedings of the 2019 IEEE International Conference on Big Data (Big Data). IEEE, 850–859.
[40]
Babak Loni, Yue Shi, Martha Larson, and Alan Hanjalic. 2014. Cross-domain collaborative filtering with factorization machines. In Proceedings of the European Conference on Information Retrieval. Springer, 656–661.
[41]
Jiaqi Ma, Zhe Zhao, Xinyang Yi, Jilin Chen, Lichan Hong, and Ed H. Chi. 2018. Modeling task relationships in multi-task learning with multi-gate mixture-of-experts. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1930–1939.
[42]
Tong Man, Huawei Shen, Xiaolong Jin, and Xueqi Cheng. 2017. Cross-domain recommendation: An embedding and mapping approach. In Proceedings of IJCAI. 2464–2470.
[43]
Lars Mescheder, Andreas Geiger, and Sebastian Nowozin. 2018. Which training methods for GANs do actually converge? In Proceedings of the International Conference on Machine Learning(PMLR). 3481–3490.
[44]
Mehdi Mirza and Simon Osindero. 2014. Conditional generative adversarial nets. arXiv preprint arXiv:1411.1784 (2014).
[45]
Ishan Misra, Abhinav Shrivastava, Abhinav Gupta, and Martial Hebert. 2016. Cross-stitch networks for multi-task learning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3994–4003.
[46]
Vaishnavh Nagarajan and J. Zico Kolter. 2017. Gradient descent GAN optimization is locally stable. Advances in Neural Information Processing Systems 30 (2017).
[47]
Linh Nguyen and Tsukasa Ishigaki. 2018. Domain-to-domain translation model for recommender system. arXiv preprint arXiv:1812.06229 (2018).
[48]
Jianmo Ni, Jiacheng Li, and Julian McAuley. 2019. Justifying recommendations using distantly-labeled reviews and fine-grained aspects. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 188–197.
[49]
Yabo Ni, Dan Ou, Shichen Liu, Xiang Li, Wenwu Ou, Anxiang Zeng, and Luo Si. 2018. Perceive your users in depth: Learning universal user representations from multiple e-commerce tasks. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 596–605.
[50]
Augustus Odena, Christopher Olah, and Jonathon Shlens. 2017. Conditional image synthesis with auxiliary classifier gans. In Proceedings of theInternational Conference on Machine Learning(PMLR). 2642–2651.
[51]
Dilruk Perera and Roger Zimmermann. 2019. CnGAN: Generative adversarial networks for cross-network user preference generation for non-overlapped users. In Proceedings of the World Wide Web Conference. 3144–3150.
[52]
David E. Rumelhart, Geoffrey E. Hinton, and Ronald J. Williams. 1985. Learning Internal Representations by Error Propagation. Technical Report. California Univ San Diego La Jolla Inst for Cognitive Science.
[53]
Shaghayegh Sahebi, Peter Brusilovsky, and Vladimir Bobrokov. 2017. Cross-domain recommendation for large-scale data. In CEUR Workshop Proceedings, Vol. 1887. 9–15.
[54]
Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web. 285–295.
[55]
Ajit P. Singh and Geoffrey J. Gordon. 2008. Relational learning via collective matrix factorization. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 650–658.
[56]
Jasper Snoek, Hugo Larochelle, and Ryan Prescott Adams. 2012. Practical Bayesian optimization of machine learning algorithms. Advances in Neural Information Processing Systems (2012).
[57]
Chang Su, Zongchao Hu, and Xianzhong Xie. 2021. Cross-domain recommendation based on heterogeneous information network with adversarial learning. In Proceedings of the 2021 5th International Conference on Intelligent Systems, Metaheuristics & Swarm Intelligence. 65–70.
[58]
Jinhui Tang, Xiaoyu Du, Xiangnan He, Fajie Yuan, Qi Tian, and Tat-Seng Chua. 2019. Adversarial training towards robust multimedia recommender system. IEEE Transactions on Knowledge and Data Engineering 32, 5 (2019), 855–867.
[59]
Aladin Virmaux and Kevin Scaman. 2018. Lipschitz regularity of deep neural networks: Analysis and efficient estimation. Advances in Neural Information Processing Systems 31 (2018).
[60]
Cheng Wang, Mathias Niepert, and Hui Li. 2019. RECSYS-DAN: Discriminative adversarial networks for cross-domain recommender systems. IEEE Transactions on Neural Networks and Learning Systems (2019).
[61]
Hao Wang, Naiyan Wang, and Dit-Yan Yeung. 2015. Collaborative deep learning for recommender systems. In Proceedings of the 21th ACM SIGKDD. ACM, 1235–1244.
[62]
Hao Wu, Zhengxin Zhang, Kun Yue, Binbin Zhang, Jun He, and Liangchen Sun. 2018. Dual-regularized matrix factorization with deep neural networks for recommender systems. Knowledge-Based Systems 145 (2018), 46–58.
[63]
Qiong Wu, Yong Liu, Chunyan Miao, Binqiang Zhao, Yin Zhao, and Lu Guan. 2019. PD-GAN: Adversarial learning for personalized diversity-promoting recommendation. In Proceedings ofIJCAI, Vol. 19. 3870–3876.
[64]
Feng Yuan, Lina Yao, and Boualem Benatallah. 2019. Adversarial collaborative neural network for robust recommendation. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. 1065–1068.
[65]
Feng Yuan, Lina Yao, and Boualem Benatallah. 2019. DARec: Deep domain adaptation for cross-domain recommendation via transferring rating patterns. arXiv preprint arXiv:1905.10760 (2019).
[66]
Shuai Zhang, Lina Yao, Aixin Sun, and Yi Tay. 2019. Deep learning based recommender system: A survey and new perspectives. ACM Computing Surveys (CSUR) 52, 1 (2019), 5.
[67]
Wen Zhang, Lingfei Deng, Lei Zhang, and Dongrui Wu. 2020. A survey on negative transfer. arXiv preprint arXiv:2009.00909.
[68]
Junbo Zhao, Yoon Kim, Kelly Zhang, Alexander Rush, and Yann LeCun. 2018. Adversarially regularized autoencoders. In Proceedings of the International Conference on Machine Learning(PMLR). 5902–5911.
[69]
Zhe Zhao, Lichan Hong, Li Wei, Jilin Chen, Aniruddh Nath, Shawn Andrews, Aditee Kumthekar, Maheswaran Sathiamoorthy, Xinyang Yi, and Ed Chi. 2019. Recommending what video to watch next: A multitask ranking system. In Proceedings of the 13th ACM Conference on Recommender Systems. 43–51.
[70]
Fan Zhou, Ruiyang Yin, Kunpeng Zhang, Goce Trajcevski, Ting Zhong, and Jin Wu. 2019. Adversarial point-of-interest recommendation. In Proceedings of the World Wide Web Conference. 3462–3468.
[71]
Kun Zhou, Hui Yu, Wayne Xin Zhao, and Ji-Rong Wen. 2022. Filter-enhanced MLP is all you need for sequential recommendation. In Proceedings of the ACM Web Conference 2022. 2388–2399.
[72]
Feng Zhu, Chaochao Chen, Yan Wang, Guanfeng Liu, and Xiaolin Zheng. 2019. DTCDR: A framework for dual-target cross-domain recommendation. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management. 1533–1542.
[73]
Feng Zhu, Yan Wang, Chaochao Chen, Jun Zhou, Longfei Li, and Guanfeng Liu. 2021. Cross-domain recommendation: Challenges, progress, and prospects. In Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI 2021). International Joint Conferences on Artificial Intelligence, 4721–4728.
[74]
Yongchun Zhu, Zhenwei Tang, Yudan Liu, Fuzhen Zhuang, Ruobing Xie, Xu Zhang, Leyu Lin, and Qing He. 2022. Personalized transfer of user preferences for cross-domain recommendation. In Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining. 1507–1515.

Cited By

View all
  • (2024)A Novel Framework for Joint Learning of City Region Partition and RepresentationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365285720:7(1-23)Online publication date: 16-May-2024
  • (2024)SiG: A Siamese-Based Graph Convolutional Network to Align Knowledge in Autonomous Transportation SystemsACM Transactions on Intelligent Systems and Technology10.1145/364386115:2(1-20)Online publication date: 28-Mar-2024
  • (2024)Improving Adversarial Robustness for Recommendation Model via Cross-Domain Distributional Adversarial TrainingProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688116(278-286)Online publication date: 8-Oct-2024
  • Show More Cited By

Index Terms

  1. Adversarial Learning for Cross Domain Recommendations

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Intelligent Systems and Technology
    ACM Transactions on Intelligent Systems and Technology  Volume 14, Issue 1
    February 2023
    487 pages
    ISSN:2157-6904
    EISSN:2157-6912
    DOI:10.1145/3570136
    • Editor:
    • Huan Liu
    Issue’s Table of Contents

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 November 2022
    Online AM: 18 July 2022
    Accepted: 01 July 2022
    Revised: 10 May 2022
    Received: 16 October 2021
    Published in TIST Volume 14, Issue 1

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Cross domain recommendation
    2. adversarial learning
    3. user preferences

    Qualifiers

    • Research-article
    • Refereed

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)393
    • Downloads (Last 6 weeks)68
    Reflects downloads up to 25 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)A Novel Framework for Joint Learning of City Region Partition and RepresentationACM Transactions on Multimedia Computing, Communications, and Applications10.1145/365285720:7(1-23)Online publication date: 16-May-2024
    • (2024)SiG: A Siamese-Based Graph Convolutional Network to Align Knowledge in Autonomous Transportation SystemsACM Transactions on Intelligent Systems and Technology10.1145/364386115:2(1-20)Online publication date: 28-Mar-2024
    • (2024)Improving Adversarial Robustness for Recommendation Model via Cross-Domain Distributional Adversarial TrainingProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688116(278-286)Online publication date: 8-Oct-2024
    • (2024)Discerning Canonical User Representation for Cross-Domain RecommendationProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688114(318-328)Online publication date: 8-Oct-2024
    • (2024)Sequential Recommendation with Collaborative Explanation via Mutual Information MaximizationProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657770(1062-1072)Online publication date: 10-Jul-2024
    • (2024)C²DR: Robust Cross-Domain Recommendation based on Causal DisentanglementProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635809(341-349)Online publication date: 4-Mar-2024
    • (2024)Inter- and Intra-Domain Potential User Preferences for Cross-Domain RecommendationIEEE Transactions on Multimedia10.1109/TMM.2024.337457726(8014-8025)Online publication date: 12-Mar-2024
    • (2024)Analysis of Recommender System Using Generative Artificial Intelligence: A Systematic Literature ReviewIEEE Access10.1109/ACCESS.2024.341696212(87742-87766)Online publication date: 2024
    • (2024)DADINExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.122880243:COnline publication date: 25-Jun-2024
    • (2024)A systematic review of the literature on deep learning approaches for cross-domain recommender systemsDecision Analytics Journal10.1016/j.dajour.2024.10051813(100518)Online publication date: Dec-2024
    • Show More Cited By

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media