Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3097983.3098077acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Collaborative Variational Autoencoder for Recommender Systems

Published: 04 August 2017 Publication History
  • Get Citation Alerts
  • Abstract

    Modern recommender systems usually employ collaborative filtering with rating information to recommend items to users due to its successful performance. However, because of the drawbacks of collaborative-based methods such as sparsity, cold start, etc., more attention has been drawn to hybrid methods that consider both the rating and content information. Most of the previous works in this area cannot learn a good representation from content for recommendation task or consider only text modality of the content, thus their methods are very limited in current multimedia scenario. This paper proposes a Bayesian generative model called collaborative variational autoencoder (CVAE) that considers both rating and content for recommendation in multimedia scenario. The model learns deep latent representations from content data in an unsupervised manner and also learns implicit relationships between items and users from both content and rating. Unlike previous works with denoising criteria, the proposed CVAE learns a latent distribution for content in latent space instead of observation space through an inference network and can be easily extended to other multimedia modalities other than text. Experiments show that CVAE is able to significantly outperform the state-of-the-art recommendation methods with more robust performance.

    Supplementary Material

    MP4 File (li_recommender_systems.mp4)

    References

    [1]
    Gediminas Adomavicius and Alexander Tuzhilin 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering, Vol. 17, 6 (2005), 734--749.
    [2]
    Deepak Agarwal and Bee-Chung Chen 2009. Regression-based latent factor models. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 19--28.
    [3]
    Daniel Billsus and Michael J Pazzani 1998. Learning collaborative information filters. In Proceedings of the 15th International Conference on Machine Learning, Vol. Vol. 98. 46--54.
    [4]
    David M Blei, Andrew Y Ng, and Michael I Jordan. 2003. Latent dirichlet allocation. Journal of Machine Learning Research Vol. 3, Jan (2003), 993--1022.
    [5]
    Samuel R Bowman, Luke Vilnis, Oriol Vinyals, Andrew M Dai, Rafal Jozefowicz, and Samy Bengio. 2016. Generating sentences from a continuous space. In CONLL. 10--21.
    [6]
    Mark Claypool, Anuja Gokhale, Tim Miranda, Pavel Murnikov, Dmitry Netes, and Matthew Sartin. 1999. Combining content-based and collaborative filters in an online newspaper Proceedings of ACM SIGIR workshop on recommender systems, Vol. Vol. 60. Citeseer.
    [7]
    Kostadin Georgiev and Preslav Nakov 2013. A non-IID framework for collaborative filtering with restricted Boltzmann machines. Proceedings of the 30th International Conference on Machine Learning. 1148--1156.
    [8]
    Alex Graves, Santiago Fernández, Faustino Gomez, and Jürgen Schmidhuber 2006. Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks. In Proceedings of the 23rd International Conference on Machine Learning. ACM, 369--376.
    [9]
    Diederik P Kingma and Max Welling 2013. Auto-encoding variational bayes. In Proceedings of the 2nd International Conference on Learning Representations.
    [10]
    Daphne Koller and Nir Friedman 2009. Probabilistic graphical models: principles and techniques. MIT press.
    [11]
    Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks Advances in Neural Information Processing Systems. 1097--1105.
    [12]
    Ken Lang 1995. Newsweeder: Learning to filter netnews. In Proceedings of the 12th International Conference on Machine Learning. 331--339.
    [13]
    Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. Nature, Vol. 521, 7553 (2015), 436--444.
    [14]
    Wu-Jun Li, Dit-Yan Yeung, and Zhihua Zhang 2011. Generalized latent factor models for social network analysis Proceedings of the 22nd International Joint Conference on Artificial Intelligence, Barcelona, Spain. 1705.
    [15]
    Xiaopeng Li, Ming Cheung, and James She 2016. Connection Discovery using Shared Images by Gaussian Relational Topic Model International Conference on Big Data. IEEE, 931--936.
    [16]
    Kevin P Murphy. 2012. Machine learning: a probabilistic perspective. MIT press.
    [17]
    Michael Pazzani and Daniel Billsus 1997. Learning and revising user profiles: The identification of interesting web sites. Machine Learning, Vol. 27, 3 (1997), 313--331.
    [18]
    Michael J Pazzani. 1999. A framework for collaborative, content-based and demographic filtering. Artificial Intelligence Review Vol. 13, 5--6 (1999), 393--408.
    [19]
    Yunchen Pu, Zhe Gan, Ricardo Henao, Xin Yuan, Chunyuan Li, Andrew Stevens, and Lawrence Carin 2016natexlaba. Variational autoencoder for deep learning of images, labels and captions Advances in Neural Information Processing Systems. 2352--2360.
    [20]
    Yunchen Pu, Xin Yuan, Andrew Stevens, Chunyuan Li, and Lawrence Carin 2016. A deep generative deconvolutional image model. In Proceedings of the 19th International Conference on Artificial Intelligence and Statistics. 741--750.
    [21]
    Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme 2009. BPR: Bayesian personalized ranking from implicit feedback Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence. AUAI Press, 452--461.
    [22]
    Ruslan Salakhutdinov and Andriy Mnih 2007. Probabilistic matrix factorization. In Advances in Neural Information Processing Systems, Vol. Vol. 1. 2--1.
    [23]
    Ruslan Salakhutdinov, Andriy Mnih, and Geoffrey Hinton. 2007. Restricted Boltzmann machines for collaborative filtering Proceedings of the 24th International Conference on Machine Learning. ACM, 791--798.
    [24]
    Ajit P Singh and Geoffrey J Gordon 2008. Relational learning via collective matrix factorization Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 650--658.
    [25]
    Aaron Van den Oord, Sander Dieleman, and Benjamin Schrauwen. 2013. Deep content-based music recommendation. In Advances in Neural Information Processing Systems. 2643--2651.
    [26]
    Pascal Vincent, Hugo Larochelle, Isabelle Lajoie, Yoshua Bengio, and Pierre-Antoine Manzagol. 2010. Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion. Journal of Machine Learning Research Vol. 11, Dec (2010), 3371--3408.
    [27]
    Chong Wang and David M Blei 2011. Collaborative topic modeling for recommending scientific articles Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 448--456.
    [28]
    Hao Wang, Binyi Chen, and Wu-Jun Li 2013. Collaborative topic regression with social regularization for tag recommendation. International Joint Conference on Artificial Intelligence.
    [29]
    Hao Wang, Naiyan Wang, and Dit-Yan Yeung 2015. Collaborative deep learning for recommender systems Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1235--1244.
    [30]
    Hao Wang, SHI Xingjian, and Dit-Yan Yeung 2016. Collaborative recurrent autoencoder: Recommend while learning to fill in the blanks Advances in Neural Information Processing Systems. 415--423.
    [31]
    Xinxi Wang and Ye Wang 2014. Improving content-based and hybrid music recommendation using deep learning Proceedings of the 22nd ACM International Conference on Multimedia. ACM, 627--636.

    Cited By

    View all
    • (2024)GSRec: A Graph-Sequence Recommendation System Based on Reverse-Order Graph and User EmbeddingMathematics10.3390/math1201016412:1(164)Online publication date: 4-Jan-2024
    • (2024)MultArtRec: A Multimodal Neural Topic Modeling for Integrating Image and Text Features in Artwork RecommendationElectronics10.3390/electronics1302030213:2(302)Online publication date: 10-Jan-2024
    • (2024)VGE: Gene-Disease Association by Variational Graph EmbeddingInternational Journal of Crowd Science10.26599/IJCS.2024.91000048:2(95-99)Online publication date: May-2024
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    KDD '17: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
    August 2017
    2240 pages
    ISBN:9781450348874
    DOI:10.1145/3097983
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 August 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. autoencoder
    2. bayesian
    3. deep learning
    4. generative models
    5. recommender systems
    6. variational inference

    Qualifiers

    • Research-article

    Conference

    KDD '17
    Sponsor:

    Acceptance Rates

    KDD '17 Paper Acceptance Rate 64 of 748 submissions, 9%;
    Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

    Upcoming Conference

    KDD '24

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)236
    • Downloads (Last 6 weeks)32
    Reflects downloads up to 26 Jul 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)GSRec: A Graph-Sequence Recommendation System Based on Reverse-Order Graph and User EmbeddingMathematics10.3390/math1201016412:1(164)Online publication date: 4-Jan-2024
    • (2024)MultArtRec: A Multimodal Neural Topic Modeling for Integrating Image and Text Features in Artwork RecommendationElectronics10.3390/electronics1302030213:2(302)Online publication date: 10-Jan-2024
    • (2024)VGE: Gene-Disease Association by Variational Graph EmbeddingInternational Journal of Crowd Science10.26599/IJCS.2024.91000048:2(95-99)Online publication date: May-2024
    • (2024)PheSeq, a Bayesian deep learning model to enhance and interpret the gene-disease association studiesGenome Medicine10.1186/s13073-024-01330-716:1Online publication date: 16-Apr-2024
    • (2024)A Survey on Variational Autoencoders in Recommender SystemsACM Computing Surveys10.1145/366336456:10(1-40)Online publication date: 24-Jun-2024
    • (2024)Disentangled Graph Variational Auto-Encoder for Multimodal Recommendation With InterpretabilityIEEE Transactions on Multimedia10.1109/TMM.2024.336987526(7543-7554)Online publication date: 2024
    • (2024)Approaching the Information-Theoretic Limit of Privacy Disclosure With Utility GuaranteesIEEE Transactions on Information Forensics and Security10.1109/TIFS.2024.335441219(3339-3352)Online publication date: 2024
    • (2024)Multi-view Attentive Variational Learning for Group Recommendation2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00381(5022-5034)Online publication date: 13-May-2024
    • (2024)An efficient evolutionary architecture search for variational autoencoder with alternating optimization and adaptive crossoverSwarm and Evolutionary Computation10.1016/j.swevo.2024.10152086(101520)Online publication date: May-2024
    • (2024)AdaMO: Adaptive Meta-Optimization for cold-start recommendationNeurocomputing10.1016/j.neucom.2024.127417580(127417)Online publication date: May-2024
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media