Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3292500.3330873acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Enhancing Collaborative Filtering with Generative Augmentation

Published: 25 July 2019 Publication History

Abstract

Collaborative filtering (CF) has become one of the most popular and widely used methods in recommender systems, but its performance degrades sharply for users with rare interaction data. Most existing hybrid CF methods try to incorporate side information such as review texts to alleviate the data sparsity problem. However, the process of exploiting and integrating side information is computationally expensive. Existing hybrid recommendation methods treat each user equally and ignore that the pure CF methods have already achieved both effective and efficient recommendation performance for active users with sufficient interaction records and the little improvement brought by side information to these active users is ignorable. Therefore, they are not cost-effective solutions. One cost-effective idea to bypass this dilemma is to generate sufficient "real" interaction data for the inactive users with the help of side information, and then a pure CF method could be performed on this augmented dataset effectively. However, there are three major challenges to implement this idea. Firstly, how to ensure the correctness of the generated interaction data. Secondly, how to combine the data augmentation process and recommendation process into a unified model and train the model end-to-end. Thirdly, how to make the solution generalizable for various side information and recommendation tasks. In light of these challenges, we propose a generic and effective CF model called AugCF that supports a wide variety of recommendation tasks. AugCF is based on Conditional Generative Adversarial Nets that additionally consider the class (like or dislike) as a feature to generate new interaction data, which can be a sufficiently real augmentation to the original dataset. Also, AugCF adopts a novel discriminator loss and Gumbel-Softmax approximation to enable end-to-end training. Finally, extensive experiments are conducted on two large-scale recommendation datasets, and the experimental results show the superiority of our proposed model.

References

[1]
Antreas Antoniou, Amos Storkey, and Harrison Edwards. 2017. Data augmentation generative adversarial networks. arXiv (2017).
[2]
Martin Arjovsky, Soumith Chintala, and Léon Bottou. 2017. Wasserstein Generative Adversarial Networks. In ICML. 214--223.
[3]
Thierry Bertin-Mahieux, Daniel P.W. Ellis, Brian Whitman, and Paul Lamere. 2011. The Million Song Dataset. In ISMIR .
[4]
David M Blei, Andrew Y Ng, and Michael I Jordan. 2003. Latent Dirichlet Allocation. JMLR, Vol. 3, Jan (2003), 993--1022.
[5]
Liwei Cai and William Yang Wang. 2017. KBGAN: Adversarial Learning for Knowledge Graph Embeddings. arXiv (2017).
[6]
Dong-Kyu Chae, Jin-Soo Kang, Sang-Wook Kim, and Jung-Tae Lee. 2018. CFGAN: A Generic Collaborative Filtering Framework based on Generative Adversarial Networks. In CIKM. 137--146.
[7]
Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, and others. 2016. Wide & Deep Learning for Recommender Systems. In DLRS. 7--10.
[8]
Ronan Collobert, Jason Weston, Léon Bottou, Michael Karlen, Koray Kavukcuoglu, and Pavel Kuksa. 2011. Natural Language Processing (Almost) from Scratch. JMLR, Vol. 12, Aug (2011), 2493--2537.
[9]
Paolo Cremonesi, Yehuda Koren, and Roberto Turrin. 2010. Performance of recommender algorithms on top-n recommendation tasks. In RecSys. 39--46.
[10]
James Davidson, Benjamin Liebald, Junning Liu, Palash Nandy, Taylor Van Vleet, Ullas Gargi, Sujoy Gupta, Yu He, Mike Lambert, Blake Livingston, and others. 2010. The YouTube video recommendation system. In RecSys. 293--296.
[11]
Ming Ding, Jie Tang, and Jie Zhang. 2018. Semi-supervised Learning on Graphs with Generative Adversarial Nets. In CIKM. 913--922.
[12]
Ian Goodfellow. 2016. NIPS 2016 Tutorial: Generative Adversarial Networks. arXiv (2016).
[13]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In NIPS. 2672--2680.
[14]
Xiangnan He and Tat-Seng Chua. 2017. Neural Factorization Machines for Sparse Predictive Analytics. In SIGIR. 355--364.
[15]
Xiangnan He, Zhankui He, Xiaoyu Du, and Tat-Seng Chua. 2018. Adversarial Personalized Ranking for Recommendation. In SIGIR. 355--364.
[16]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural Collaborative Filtering. In WWW. 173--182.
[17]
Jonathan L Herlocker, Joseph A Konstan, Loren G Terveen, and John T Riedl. 2004. Evaluating Collaborative Filtering Recommender Systems. TOIS, Vol. 22, 1 (2004), 5--53.
[18]
Cheng-Kang Hsieh, Longqi Yang, Yin Cui, Tsung-Yi Lin, Serge Belongie, and Deborah Estrin. 2017. Collaborative Metric Learning. In WWW. 193--201.
[19]
Bo Hu and Martin Ester. 2013. Spatial Topic Modeling in Online Social Media for Location Recommendation. In RecSys. 25--32.
[20]
Eric Jang, Shixiang Gu, and Ben Poole. 2017. Categorical Reparameterization with Gumbel-Softmax. ICLR (2017).
[21]
Diederik P Kingma and Max Welling. 2013. Auto-Encoding Variational Bayes. arXiv (2013).
[22]
Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix Factorization Techniques for Recommender Systems. Computer 8 (2009), 30--37.
[23]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet Classification with Deep Convolutional Neural Networks. In NIPS. 1097--1105.
[24]
Matt J Kusner and José Miguel Hernández-Lobato. 2016. GANS for Sequences of Discrete Elements with the Gumbel-softmax Distribution. arXiv (2016).
[25]
Guanfeng Liu, Yan Wang, Mehmet A Orgun, and Ee-Peng Lim. 2013. Finding K Optimal Social Trust Paths for the Selection of Trustworthy Service Providers in Complex Social Networks. TSC, Vol. 6, 2 (2013), 152--167.
[26]
Hao Ma, Irwin King, and Michael R Lyu. 2007. Effective missing data prediction for collaborative filtering. In SIGIR. 39--46.
[27]
Chris J Maddison, Andriy Mnih, and Yee Whye Teh. 2017. The Concrete Distribution: A Continuous Relaxation of Ddiscrete Random Variables. ICLR (2017).
[28]
Chris J Maddison, Daniel Tarlow, and Tom Minka. 2014. A* Sampling. In NIPS. 3086--3094.
[29]
Julian McAuley and Jure Leskovec. 2013. Hidden Factors and Hidden Topics: Understanding Rating Dimensions with Review Text. In RecSys. 165--172.
[30]
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed Representations of Words and Phrases and Their Compositionality. In NIPS. 3111--3119.
[31]
Mehdi Mirza and Simon Osindero. 2014. Conditional Generative Adversarial Nets. arXiv (2014).
[32]
Andriy Mnih and Ruslan R Salakhutdinov. 2008. Probabilistic Matrix Factorization. In NIPS. 1257--1264.
[33]
Steffen Rendle. 2010. Factorization Machines. In ICDM. 995--1000.
[34]
Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra. 2014. Stochastic Backpropagation and Approximate Inference in Deep Generative Models. In ICML. 1278--1286.
[35]
Harald Steck. 2010. Training and testing of recommender systems on data missing not at random. In KDD. 713--722.
[36]
Zhongchuan Sun, Bin Wu, Yunpeng Wu, and Yangdong Ye. 2019. APL: Adversarial Pairwise Learning for Recommender Systems. Expert Systems with Applications, Vol. 118 (2019), 573--584.
[37]
Richard S Sutton, David A McAllester, Satinder P Singh, and Yishay Mansour. 2000. Policy Gradient Methods for Reinforcement Learning with Function Approximation. In NIPS. 1057--1063.
[38]
Carl Vondrick, Hamed Pirsiavash, and Antonio Torralba. 2016. Generating Videos with Scene Dynamics. In NIPS. 613--621.
[39]
Hao Wang, Yanmei Fu, Qinyong Wang, Hongzhi Yin, Changying Du, and Hui Xiong. 2017. A Location-Sentiment-Aware Recommender System for Both Home-Town and Out-of-Town Users. In KDD. 1135--1143.
[40]
Jun Wang, Lantao Yu, Weinan Zhang, Yu Gong, Yinghui Xu, Benyou Wang, Peng Zhang, and Dell Zhang. 2017. IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Models. In SIGIR. ACM, 515--524.
[41]
Qinyong Wang, Hongzhi Yin, Zhiting Hu, Defu Lian, Hao Wang, and Zi Huang. 2018. Neural Memory Streaming Recommender Networks with Adversarial Training. In KDD. 2467--2475.
[42]
Weiqing Wang, Hongzhi Yin, Ling Chen, Yizhou Sun, Shazia Sadiq, and Xiaofang Zhou. 2015. Geo-Sage: A Geographical Sparse Additive Generative Model for Spatial Item Recommendation. In KDD. 1255--1264.
[43]
Hongzhi Yin, Bin Cui, Yizhou Sun, Zhiting Hu, and Ling Chen. 2014. LCARS: A Spatial Item Recommender System. TOIS, Vol. 32, 3 (2014), 11.
[44]
Hongzhi Yin, Qinyong Wang, Kai Zheng, Zhixu Li, Jiali Yang, and Xiaofang Zhou. 2019. Social Influence-Based Group Representation Learning for Group Recommendation. In ICDE .
[45]
Hongzhi Yin, Weiqing Wang, Hao Wang, Ling Chen, and Xiaofang Zhou. 2017. Spatial-Aware Hierarchical Collaborative Deep Learning for POI Recommendation. TKDE, Vol. 29, 11 (2017), 2537--2551.
[46]
Lantao Yu, Weinan Zhang, Jun Wang, and Yong Yu. 2017. SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient. In AAAI. 2852--2858.
[47]
Xiaofeng Zhang, Zhangyang Wang, Dong Liu, and Qing Ling. 2018. DADA: Deep Adversarial Data Augmentation for Extremely Low Data Regime Classification. arXiv (2018).
[48]
Lei Zheng, Vahid Noroozi, and Philip S Yu. 2017. Joint Deep Modeling of Users and Items Using Reviews for Recommendation. In WSDM. 425--434.

Cited By

View all
  • (2025)Relieving popularity bias in recommender systems via user group-level augmentationApplied Soft Computing10.1016/j.asoc.2024.112610169(112610)Online publication date: Jan-2025
  • (2024)Generative Adversarial Networks: Applications, Challenges, and Open IssuesDeep Learning - Recent Findings and Research10.5772/intechopen.113098Online publication date: 29-May-2024
  • (2024)Enhanced Spark Cluster Recommendation Engine Powered by Generative AIInternational Journal of Research in Science and Technology10.37648/ijrst.v14i01.00414:1(26-32)Online publication date: 2024
  • Show More Cited By

Index Terms

  1. Enhancing Collaborative Filtering with Generative Augmentation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    KDD '19: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
    July 2019
    3305 pages
    ISBN:9781450362016
    DOI:10.1145/3292500
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 25 July 2019

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. adversarial training
    2. collaborative filtering
    3. data sparsit

    Qualifiers

    • Research-article

    Funding Sources

    • ARC Discovery Projects

    Conference

    KDD '19
    Sponsor:

    Acceptance Rates

    KDD '19 Paper Acceptance Rate 110 of 1,200 submissions, 9%;
    Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

    Upcoming Conference

    KDD '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)126
    • Downloads (Last 6 weeks)14
    Reflects downloads up to 27 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Relieving popularity bias in recommender systems via user group-level augmentationApplied Soft Computing10.1016/j.asoc.2024.112610169(112610)Online publication date: Jan-2025
    • (2024)Generative Adversarial Networks: Applications, Challenges, and Open IssuesDeep Learning - Recent Findings and Research10.5772/intechopen.113098Online publication date: 29-May-2024
    • (2024)Enhanced Spark Cluster Recommendation Engine Powered by Generative AIInternational Journal of Research in Science and Technology10.37648/ijrst.v14i01.00414:1(26-32)Online publication date: 2024
    • (2024)Revisiting Bundle Recommendation for Intent-aware Product BundlingACM Transactions on Recommender Systems10.1145/3652865Online publication date: 15-Mar-2024
    • (2024)Neural Click Models for Recommender SystemsProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657939(2553-2558)Online publication date: 10-Jul-2024
    • (2024)Diff-MSR: A Diffusion Model Enhanced Paradigm for Cold-Start Multi-Scenario RecommendationProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635807(779-787)Online publication date: 4-Mar-2024
    • (2024)HD-KT: Advancing Robust Knowledge Tracing via Anomalous Learning Interaction DetectionProceedings of the ACM Web Conference 202410.1145/3589334.3645718(4479-4488)Online publication date: 13-May-2024
    • (2024)Is Contrastive Learning Necessary? A Study of Data Augmentation vs Contrastive Learning in Sequential RecommendationProceedings of the ACM Web Conference 202410.1145/3589334.3645661(3854-3863)Online publication date: 13-May-2024
    • (2024)PromptMM: Multi-Modal Knowledge Distillation for Recommendation with Prompt-TuningProceedings of the ACM Web Conference 202410.1145/3589334.3645359(3217-3228)Online publication date: 13-May-2024
    • (2024)TiCoSeRec: Augmenting Data to Uniform Sequences by Time Intervals for Effective RecommendationIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.332431236:6(2686-2700)Online publication date: Jun-2024
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media