research-article

Open access

The Netflix Recommender System: Algorithms, Business Value, and Innovation

Authors:

Carlos A. Gomez-Uribe,

Neil HuntAuthors Info & Claims

ACM Transactions on Management Information Systems (TMIS), Volume 6, Issue 4

Article No.: 13, Pages 1 - 19

https://doi.org/10.1145/2843948

Published: 28 December 2015 Publication History

Abstract

This article discusses the various algorithms that make up the Netflix recommender system, and describes its business purpose. We also describe the role of search and related algorithms, which for us turns into a recommendations problem as well. We explain the motivations behind and review the approach that we use to improve the recommendation algorithms, combining A/B testing focused on improving member retention and medium term engagement, as well as offline experimentation using historical member engagement data. We discuss some of the issues in designing and interpreting A/B tests. Finally, we describe some current areas of focused innovation, which include making our recommender system global and language aware.

References

[1]

Chris Alvino and Justin Basilico. 2015. Learning a Personalized Homepage. Retrieved December 6, 2015 from http://techblog.netflix.com/2015/04/learning-personalized-homepage.html.

[2]

Xavier Amatriain and Justin Basilico. 2012. Netflix Recommendations: Beyond the 5 stars (Part 2). Retrieved December 6, 2015 from http://techblog.netflix.com/2012/06/netflix-recommendations-beyond-5-stars.html

[3]

David M Blei, Andrew Y. Ng, and Michael I. Jordan. 2003. Latent Dirichlet allocation. The Journal of Machine Learning Research 3, 993--1022.

Digital Library

[4]

Olivier Chapelle, Thorsten Joachims, Filip Radlinski, and Yisong Yue. 2012. Large-scale validation and analysis of interleaved search evaluation. ACM Transactions on Information Systems 30, 1.

Digital Library

[5]

Alex Deng, Ya Xu, Ron Kohavi, and Toby Walker. 2013. Improving the sensitivity of online controlled experiments by utilizing pre-experiment data. In WSDM.

Digital Library

[6]

Trevor Hastie, Robert Tibshirani, and Jerome Friedman. 2011. The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2nd. ed.). Springer.

[7]

Yehuda Koren. 2008. Factorization meets the neighborhood: A multifaceted collaborative filtering model. In 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (New York, NY).

Digital Library

[8]

Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 8, 30--37.

Digital Library

[9]

Andriy Mnih and Ruslan Salakhutdinov. 2007. Probabilistic matrix factorization. In Advances in Neural Information Processing Systems. 1257--1264.

[10]

Kevin P. Murphy. 2012. Machine Learning: A Probabilistic Perspective. MIT Press, Cambridge MA.

Digital Library

[11]

Prasanna Padmanabhan, Kedar Sadekar, and Gopal Krishnan. 2015. What’s trending on Netflix. Retrieved December 6, 2015 from http://techblog.netflix.com/2015/02/whats-trending-on-netflix.html.

[12]

Arkadiusz Paterek. 2007. Improving regularized singular value decomposition for collaborative filtering. In Proceedings of KDD Cup and Workshop. 5--8.

[13]

Leo Pekelis, David Walsh, and Ramesh Johari. 2015. The New Stats Engine. Internet. Retrieved December 6, 2015 from http://pages.optimizely.com/rs/optimizely/images/stats_engine_technical_paper.pdf.

[14]

Netflix Prize. 2009. The Netflix Prize. Retrieved December 6, 2015 from http://www.netflixprize.com/.

[15]

Steffen Rendle. 2010. Factorization machines. In 2010 IEEE 10th International Conference on Data Mining (ICDM). IEEE, 995--1000.

Digital Library

[16]

Joseph L. Schafer. 1997. Analysis of Incomplete Multivariate Data. CRC Press, Boca Raton, FL.

[17]

Barry Schwartz. 2015. The Paradox of Choice: Why More Is Less. Harper Perennial, New York, NY.

[18]

Bryan Gumm. 2013. Appendix 2: Metrics and the Statistics Behind A/B Testing. In A/B Testing: The Most Powerful Way to Turn Clicks into Customers, Dan Siroker and Pete Koomen (Eds.). Wiley, Hoboken, NJ.

[19]

Yee Whye Teh, Michael I. Jordan, Matthew J. Beal, and David M. Blei. 2006. Hierarchical Dirichlet processes. Journal of the American Statistical Association 101, 476.

Cited By

Çiçeklioğlu A(2024)HABERE ÇEVRİM İÇİ ERİŞİMDE YENİ DÖNEM: KİŞİSELLEŞTİRİLMİŞ HABER UYGULAMALARIKritik İletişim Çalışmaları Dergisi10.53281/kritik.14383066:1(99-130)Online publication date: 2-Jul-2024
https://doi.org/10.53281/kritik.1438306
He SLi Y(2024)An Improved Intelligent Machine Learning Approach to Music Recommendation Based on Big Data Techniques and DSO AlgorithmsICST Transactions on Scalable Information Systems10.4108/eetsis.517611:5Online publication date: 8-Apr-2024
https://doi.org/10.4108/eetsis.5176
Bharti IChauhan KAggarwal P(2024)Generative AIEnhancing Communication and Decision-Making With AI10.4018/979-8-3693-9246-1.ch001(1-36)Online publication date: 27-Sep-2024
https://doi.org/10.4018/979-8-3693-9246-1.ch001
Show More Cited By

Index Terms

The Netflix Recommender System: Algorithms, Business Value, and Innovation
1. Networks
  1. Network protocols

Recommendations

A Scalable, Accurate Hybrid Recommender System
WKDD '10: Proceedings of the 2010 Third International Conference on Knowledge Discovery and Data Mining

Recommender systems apply machine learning techniques for filtering unseen information and can predict whether a user would like a given resource. There are three main types of recommender systems: collaborative filtering, content-based filtering, and ...
Acquiring User Information Needs for Recommender Systems
WI-IAT '13: Proceedings of the 2013 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT) - Volume 03

Most recommender systems attempt to use collaborative filtering, content-based filtering or hybrid approach to recommend items to new users. Collaborative filtering recommends items to new users based on their similar neighbours, and content-based ...
Investigating serendipity in recommender systems based on real user feedback
SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied Computing

Over the past several years, research in recommender systems has emphasized the importance of serendipity, but there is still no consensus on the definition of this concept and whether serendipitous items should be recommended is still not a well-...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Management Information Systems

ACM Transactions on Management Information Systems Volume 6, Issue 4

January 2016

73 pages

ISSN:2158-656X

EISSN:2158-6578

DOI:10.1145/2869770

Editor:
Alexander Tuzhilin
New York University, USA

Issue’s Table of Contents

Copyright © 2015 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 December 2015

Accepted: 01 November 2015

Revised: 01 September 2015

Received: 01 July 2015

Published in TMIS Volume 6, Issue 4

Check for updates

Author Tag

Recommender systems

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

768
Total Citations
View Citations
174,377
Total Downloads

Downloads (Last 12 months)19,222
Downloads (Last 6 weeks)2,398

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Çiçeklioğlu A(2024)HABERE ÇEVRİM İÇİ ERİŞİMDE YENİ DÖNEM: KİŞİSELLEŞTİRİLMİŞ HABER UYGULAMALARIKritik İletişim Çalışmaları Dergisi10.53281/kritik.14383066:1(99-130)Online publication date: 2-Jul-2024
https://doi.org/10.53281/kritik.1438306
He SLi Y(2024)An Improved Intelligent Machine Learning Approach to Music Recommendation Based on Big Data Techniques and DSO AlgorithmsICST Transactions on Scalable Information Systems10.4108/eetsis.517611:5Online publication date: 8-Apr-2024
https://doi.org/10.4108/eetsis.5176
Bharti IChauhan KAggarwal P(2024)Generative AIEnhancing Communication and Decision-Making With AI10.4018/979-8-3693-9246-1.ch001(1-36)Online publication date: 27-Sep-2024
https://doi.org/10.4018/979-8-3693-9246-1.ch001
Sharma VBose I(2024)Unlocking AI's Potential in Customer Service MarketingAI Innovations in Service and Tourism Marketing10.4018/979-8-3693-7909-7.ch005(80-103)Online publication date: 26-Jul-2024
https://doi.org/10.4018/979-8-3693-7909-7.ch005
Mitra ADas S(2024)Exploring the Synergy of Artificial Intelligence and Big Data Analytics in Enhancing Customer Engagement StrategiesImproving Service Quality and Customer Engagement With Marketing Intelligence10.4018/979-8-3693-6813-8.ch008(196-210)Online publication date: 30-Jun-2024
https://doi.org/10.4018/979-8-3693-6813-8.ch008
Motadi M(2024)Harnessing AI for Ethical Digital Consumer Behavior AnalysisEnhancing and Predicting Digital Consumer Behavior with AI10.4018/979-8-3693-4453-8.ch012(211-237)Online publication date: 12-Apr-2024
https://doi.org/10.4018/979-8-3693-4453-8.ch012
Kulkarni MDeshmukh SBehare NWaghulkar SSane AGupta SShelke ASharma S(2024)Interdisciplinary Perspectives in Data-Driven MarketingData-Driven Marketing for Strategic Success10.4018/979-8-3693-3455-3.ch011(293-322)Online publication date: 12-Jul-2024
https://doi.org/10.4018/979-8-3693-3455-3.ch011
Kumari MDutt A(2024)Consumer Awareness and Perception of Online ServicesSmart and Sustainable Interactive Marketing10.4018/979-8-3693-1339-8.ch011(178-197)Online publication date: 8-Mar-2024
https://doi.org/10.4018/979-8-3693-1339-8.ch011
Keskin E(2024)OTT Platforms From the Perspective of Critical Algorithm StudiesThe Rise of Over-the-Top (OTT) Media and Implications for Media Consumption and Production10.4018/979-8-3693-0116-6.ch007(95-113)Online publication date: 26-Jan-2024
https://doi.org/10.4018/979-8-3693-0116-6.ch007
Bhavani KAslesha Lakshmi Sai K(2024)Netflix Movies Recommendation SystemInternational Journal of Innovative Science and Research Technology (IJISRT)10.38124/ijisrt/IJISRT24FEB1527(2006-2010)Online publication date: 1-Apr-2024
https://doi.org/10.38124/ijisrt/IJISRT24FEB1527
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents