Article

Restricted Boltzmann machines for collaborative filtering

Authors:

Ruslan Salakhutdinov,

Geoffrey HintonAuthors Info & Claims

ICML '07: Proceedings of the 24th international conference on Machine learning

Pages 791 - 798

https://doi.org/10.1145/1273496.1273596

Published: 20 June 2007 Publication History

Abstract

Most of the existing approaches to collaborative filtering cannot handle very large data sets. In this paper we show how a class of two-layer undirected graphical models, called Restricted Boltzmann Machines (RBM's), can be used to model tabular data, such as user's ratings of movies. We present efficient learning and inference procedures for this class of models and demonstrate that RBM's can be successfully applied to the Netflix data set, containing over 100 million user/movie ratings. We also show that RBM's slightly outperform carefully-tuned SVD models. When the predictions of multiple RBM models and multiple SVD models are linearly combined, we achieve an error rate that is well over 6% better than the score of Netflix's own system.

References

[1]

Canny, J. F. (2002). Collaborative filtering with privacy via factor analysis. SIGIR (pp. 238--245). ACM.

Digital Library

[2]

Carreira-Perpinan, M., & Hinton, G. (2005). On contrastive divergence learning. 10th Int. Work-shop on Artificial Intelligence and Statistics (AISTATS'2005).

[3]

Deerwester, S. C., Dumais, S. T., Landauer, T. K., Furnas, G. W., & Harshman, R. A. (1990). Indexing by latent semantic analysis. Journal of the American Society of Information Science, 41, 391--407.

[4]

Hinton, & Salakhutdinov (2006). Reducing the dimensionality of data with neural networks. Science, 313.

[5]

Hinton, G. E. (2002). Training products of experts by minimizing contrastive divergence. Neural Computation, 14, 1711--1800.

Digital Library

[6]

Hinton, G. E., Osindero, S., & Teh, Y. W. (2006). A fast learning algorithm for deep belief nets. Neural Computation, 18, 1527--1554.

Digital Library

[7]

Hofmann, T. (1999). Probabilistic latent semantic analysis. Proceedings of the 15th Conference on Uncertainty in AI (pp. 289--296). San Fransisco, California: Morgan Kaufmann.

Digital Library

[8]

Marlin, B., & Zemel, R. S. (2004). The multiple multiplicative factor model for collaborative filtering. Machine Learning, Proceedings of the Twenty-first International Conference (ICML 2004), Banff, Alberta, Canada, July 4--8, 2004. ACM.

Digital Library

[9]

Neal, R. M. (1993). Probabilistic inference using Markov chain Monte Carlo methods (Technical Report CRG-TR-93-1). Department of Computer Science, University of Toronto.

[10]

Salakhutdinov, R., & Hinton, G. E. (2007). Learning a nonlinear embedding by preserving class neighbourhood structure. AI and Statistics.

[11]

Srebro, N., & Jaakkola, T. (2003). Weighted low-rank approximations. Machine Learning, Proceedings of the Twentieth International Conference (ICML 2003), August 21--24, 2003, Washington, DC, USA (pp. 720--727). AAAI Press.

[12]

Srebro, N., Rennie, J. D. M., & Jaakkola, T. (2004). Maximum-margin matrix factorization. Advances in Neural Information Processing Systems.

Digital Library

[13]

Sutskever, I., & Hinton, G. E. (2006). Learning multilevel distributed representations for high-dimensional sequences (Technical Report UTML TR 2006-003). Dept. of Computer Science, University of Toronto.

[14]

Taylor, G. W., Hinton, G. E., & Roweis, S. T. (2006). Modeling human motion using binary latent variables. Advances in Neural Information Processing Systems. MIT Press.

[15]

Welling, M., Rosen-Zvi, M., & Hinton, G. (2005). Exponential family harmoniums with an application to information retrieval. NIPS 17 (pp. 1481--1488). Cambridge, MA: MIT Press.

Cited By

Quiroz Monnens SPeters CHesselink LSmeets KEnglitz B(2024)The recurrent temporal restricted Boltzmann machine captures neural assembly dynamics in whole-brain activityeLife10.7554/eLife.98489.313Online publication date: 5-Nov-2024
https://doi.org/10.7554/eLife.98489.3
Quiroz Monnens SPeters CHesselink LSmeets KEnglitz B(2024)The recurrent temporal restricted Boltzmann machine captures neural assembly dynamics in whole-brain activityeLife10.7554/eLife.9848913Online publication date: 5-Nov-2024
https://doi.org/10.7554/eLife.98489
Ceyda Yelgel ÖYelgel C(2024)The Role of Machine Learning Methods for Renewable Energy ForecastingAdvances in Energy Recovery and Efficiency Technologies [Working Title]10.5772/intechopen.1007556Online publication date: 28-Oct-2024
https://doi.org/10.5772/intechopen.1007556
Show More Cited By

Restricted Boltzmann machines for collaborative filtering
1. Computing methodologies

Recommendations

Trust-based collaborative filtering: tackling the cold start problem using regular equivalence
RecSys '18: Proceedings of the 12th ACM Conference on Recommender Systems

User-based Collaborative Filtering (CF) is one of the most popular approaches to create recommender systems. This approach is based on finding the most relevant k users from whose rating history we can extract items to recommend. CF, however, suffers ...
A non-IID framework for collaborative filtering with restricted Boltzmann machines
ICML'13: Proceedings of the 30th International Conference on International Conference on Machine Learning - Volume 28

We propose a framework for collaborative filtering based on Restricted Boltzmann Machines (RBM), which extends previous RBM-based approaches in several important directions. First, while previous RBM research has focused on modeling the correlation ...
Typicality-Based Collaborative Filtering Recommendation

Collaborative filtering (CF) is an important and popular technology for recommender systems. However, current CF methods suffer from such problems as data sparsity, recommendation inaccuracy, and big-error in predictions. In this paper, we borrow ideas ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICML '07: Proceedings of the 24th international conference on Machine learning

June 2007

1233 pages

ISBN:9781595937933

DOI:10.1145/1273496

Editor:
Zoubin Ghahramani
University of Cambridge, United Kingdom

Copyright © 2007 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Machine Learning Journal

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 June 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

ICML '07 & ILP '07

Sponsor:

ICML '07 & ILP '07: The 24th Annual International Conference on Machine Learning held in conjunction with the 2007 International Conference on Inductive Logic Programming

June 20 - 24, 2007

Oregon, Corvalis, USA

Acceptance Rates

Overall Acceptance Rate 140 of 548 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1,147
Total Citations
View Citations
7,014
Total Downloads

Downloads (Last 12 months)228
Downloads (Last 6 weeks)29

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Quiroz Monnens SPeters CHesselink LSmeets KEnglitz B(2024)The recurrent temporal restricted Boltzmann machine captures neural assembly dynamics in whole-brain activityeLife10.7554/eLife.98489.313Online publication date: 5-Nov-2024
https://doi.org/10.7554/eLife.98489.3
Quiroz Monnens SPeters CHesselink LSmeets KEnglitz B(2024)The recurrent temporal restricted Boltzmann machine captures neural assembly dynamics in whole-brain activityeLife10.7554/eLife.9848913Online publication date: 5-Nov-2024
https://doi.org/10.7554/eLife.98489
Ceyda Yelgel ÖYelgel C(2024)The Role of Machine Learning Methods for Renewable Energy ForecastingAdvances in Energy Recovery and Efficiency Technologies [Working Title]10.5772/intechopen.1007556Online publication date: 28-Oct-2024
https://doi.org/10.5772/intechopen.1007556
Sanjay Suryawanshi N(2024)Predicting Consumer Behavior in E-Commerce Using Recommendation SystemsInternational Journal of Innovative Science and Research Technology (IJISRT)10.38124/ijisrt/IJISRT19SEP1550(806-813)Online publication date: 21-Oct-2024
https://doi.org/10.38124/ijisrt/IJISRT19SEP1550
Zeng XHuang MZhang HJi ZGanchev I(2024)Novel Human Activity Recognition and Recommendation Models for Maintaining Good Health of Mobile UsersWSEAS TRANSACTIONS ON INFORMATION SCIENCE AND APPLICATIONS10.37394/23209.2024.21.421(33-46)Online publication date: 23-Jan-2024
https://doi.org/10.37394/23209.2024.21.4
Lin WZhu MZhou XZhang RZhao XShen SSun L(2024)A Deep Neural Collaborative Filtering Based Service Recommendation Method with Multi-Source Data for Smart Cloud-Edge Collaboration ApplicationsTsinghua Science and Technology10.26599/TST.2023.901005029:3(897-910)Online publication date: Jun-2024
https://doi.org/10.26599/TST.2023.9010050
Karabila IDarraz NEl-Ansari AAlami NEl mallahi M(2024)Enhanced E-commerce Recommender System Based on Deep Learning and Ensemble ApproachesProceedings of the 7th International Conference on Networking, Intelligent Systems and Security10.1145/3659677.3659747(1-8)Online publication date: 18-Apr-2024
https://dl.acm.org/doi/10.1145/3659677.3659747
He BMa CSerra ESpezzano F(2024)Interpretable Triplet Importance for Personalized RankingProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679536(809-818)Online publication date: 21-Oct-2024
https://dl.acm.org/doi/10.1145/3627673.3679536
Zheng XNi ZZhong XLuo Y(2024)Kernelized Deep Learning for Matrix Factorization Recommendation System Using Explicit and Implicit InformationIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2022.318294235:1(1205-1216)Online publication date: Jan-2024
https://doi.org/10.1109/TNNLS.2022.3182942
Kwon DSohn S(2024)Convergence Technology Opportunity Discovery for Firms Based on Technology Portfolio Using the Stacked Denoising AutoEncoder (SDAE)IEEE Transactions on Engineering Management10.1109/TEM.2022.320887171(1804-1818)Online publication date: 2024
https://doi.org/10.1109/TEM.2022.3208871
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents