Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Ranking-Oriented Collaborative Filtering: A Listwise Approach

Published: 21 September 2016 Publication History

Abstract

Collaborative filtering (CF) is one of the most effective techniques in recommender systems, which can be either rating oriented or ranking oriented. Ranking-oriented CF algorithms demonstrated significant performance gains in terms of ranking accuracy, being able to estimate a precise preference ranking of items for each user rather than the absolute ratings (as rating-oriented CF algorithms do). Conventional memory-based ranking-oriented CF can be referred to as pairwise algorithms. They represent each user as a set of preferences on each pair of items for similarity calculations and predictions. In this study, we propose ListCF, a novel listwise CF paradigm that seeks improvement in both accuracy and efficiency in comparison with pairwise CF. In ListCF, each user is represented as a probability distribution of the permutations over rated items based on the Plackett-Luce model, and the similarity between users is measured based on the Kullback--Leibler divergence between their probability distributions over the set of commonly rated items. Given a target user and the most similar users, ListCF directly predicts a total order of items for each user based on similar users’ probability distributions over permutations of the items. Besides, we also reveal insightful connections among pointwise, pairwise, and listwise CF algorithms from the perspective of the matrix representations. In addition, to make our algorithm more scalable and adaptive, we present an incremental algorithm for ListCF, which allows incrementally updating the similarities between users when certain user submits a new rating or updates an existing rating. Extensive experiments on benchmark datasets in comparison with the state-of-the-art approaches demonstrate the promise of our approach.

Supplementary Material

a10-wang-apndx.pdf (wang.zip)
Supplemental movie, appendix, image and software files for, Ranking-Oriented Collaborative Filtering: A Listwise Approach

References

[1]
John S. Breese, David Heckerman, and Carl Kadie. 1998. Empirical analysis of predictive algorithms for collaborative filtering. In Proceedings of the 14th Conference on Uncertainty in Artificial Intelligence (UAI). 43--52.
[2]
Zhe Cao, Tao Qin, Tie-Yan Liu, Ming-Feng Tsai, and Hang Li. 2007. Learning to rank: From pairwise approach to listwise approach. In Proceedings of the 24th International Conference on Machine Learning (ICML). 129--136.
[3]
Edward Challis and David Barber. 2013. Gaussian Kullback-Leibler approximate inference. J. Mach. Learn. Res. 14, 1 (2013), 2239--2286.
[4]
Tianqi Chen, Weinan Zhang, Qiuxia Lu, Kailong Chen, Zhao Zheng, and Yong Yu. 2012. SVDFeature: A toolkit for feature-based collaborative filtering. J. Mach. Learn. Res. 13, 1 (2012), 3619--3622.
[5]
Paolo Cremonesi, Yehuda Koren, and Roberto Turrin. 2010. Performance of recommender algorithms on top-n recommendation tasks. In Proceedings of the 4th ACM Conference on Recommender Systems (RecSys). 39--46.
[6]
Mukund Deshpande and George Karypis. 2004. Item-based top-N recommendation algorithms. ACM Trans. Inform. Syst. 22, 1 (2004), 143--177.
[7]
David Goldberg, David Nichols, Brian M. Oki, and Douglas Terry. 1992. Using collaborative filtering to weave an information tapestry. Commun. ACM 35, 12 (1992), 61--70.
[8]
Jonathan L. Herlocker, Joseph A. Konstan, Al Borchers, and John Riedl. 1999. An algorithmic framework for performing collaborative filtering. In Proceedings of the 22nd ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 230--237.
[9]
Jonathan L. Herlocker, Joseph A. Konstan, and John T. Riedl. 2002. An empirical analysis of design choices in neighborhood-based collaborative filtering algorithms. ACM Trans. Inform. Syst. 5 (2002), 287--310. Issue 4.
[10]
Thomas Hofmann. 2004. Latent semantic models for collaborative filtering. ACM Trans. Inform. Syst. 22, 1 (2004), 89--115.
[11]
Shanshan Huang, Jun Ma, Peizhe Cheng, and Shuaiqiang Wang. 2015a. A hybrid multigroup coclustering recommendation framework based on information fusion. ACM Trans. Intell. Syst. Technol. 6, 2 (2015), 27:1--27:22.
[12]
Shanshan Huang, Shuaiqiang Wang, Tie-Yan Liu, Jun Ma, Zhumin Chen, and Jari Veijalainen. 2015b. Listwise collaborative filtering. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 343--352.
[13]
Mohsen Jamali and Martin Ester. 2010. A matrix factorization technique with trust propagation for recommendation in social networks. In Proceedings of the 4th ACM Conference on Recommender Systems (RecSys). 135--142.
[14]
Kalervo Järvelin and Jaana Kekäläinen. 2000. IR evaluation methods for retrieving highly relevant documents. In Proceedings of the 23rd ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 41--48.
[15]
Kalervo Järvelin and Jaana Kekäläinen. 2002. Cumulated gain-based evaluation of IR techniques. ACM Trans. Inform. Syst. 20, 4 (2002), 422--446.
[16]
Meng Jiang, Peng Cui, Rui Liu, Qiang Yang, Fei Wang, Wenwu Zhu, and Shiqiang Yang. 2012. Social contextual recommendation. In Proceedings of the 21st ACM Conference on Information and Knowledge Management (CIKM). 45--54.
[17]
Minsuk Kahng, Sangkeun Lee, and Sang-goo Lee. 2011. Ranking in context-aware recommender systems. In Proceedings of the 20th International Conference Companion on World Wide Web (WWW). 65--66.
[18]
Maurice G. Kendall. 1938. A new measure of rank corelation. Biometrika 30, 1--2 (1938), 81--93.
[19]
Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30--37.
[20]
Yehuda Koren and Joe Sill. 2011. OrdRec: An ordinal model for predicting personalized item rating distributions. In Proceedings of the 5th ACM Conference on Recommender Systems (RecSys). 117--124.
[21]
Solomon Kullback. 1997. Information Theory and Statistics. Dover Publications.
[22]
Daniel D. Lee and H. Sebastian Seung. 2000. Algorithms for non-negative matrix factorization. In Proceedings of the 14th Conference on Neural Information Processing Systems (NIPS). 556--562.
[23]
Xirong Li, Efstratios Gavves, Cees G. M. Snoek, Marcel Worring, and Arnold W. M. Smeulders. 2011. Personalizing automated image annotation using cross-entropy. In Proceedings of the 19th ACM Conference on Multimedia (MM). 233--242.
[24]
Greg Linden, Brent Smith, and Jeremy York. 2003. Amazon.com recommendations: Item-to-item collaborative filtering. IEEE Internet Comput. 7, 1 (2003), 76--80.
[25]
Zhenhua Ling and Lirong Dai. 2012. Minimum Kullback--Leibler divergence parameter generation for HMM-based speech synthesis. IEEE Trans. Audio Speech Lang. Process. 20, 5 (2012), 1492--1502.
[26]
Nathan N. Liu and Qiang Yang. 2008. Eigenrank: A ranking-oriented approach to collaborative filtering. In Proceedings of the 31st ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 83--90.
[27]
Pasquale Lops, Marco de Gemmis, and Giovanni Semeraro. 2011. Content-based recommender systems: State of the art and trends. In Recommender Systems Handbook. Springer, 73--105.
[28]
Xin Luo, Yunni Xia, and Qingsheng Zhu. 2012. Incremental collaborative filtering recommender based on regularized matrix factorization. Knowl.-Bas. Syst. 27 (2012), 271--280.
[29]
John I. Marden. 1996. Analyzing and Modeling Rank Data. CRC Press.
[30]
Sean M. McNee, John Riedl, and Joseph A. Konstan. 2006. Being accurate is not enough: How accuracy metrics have hurt recommender systems. In Proceedings of Extended Abstracts of the 24th ACM Conference on Human Factors in Computing Systems (CHI). 1097--1101.
[31]
Catarina Miranda and Alípio Mário Jorge. 2009. Item-based and user-based incremental collaborative filtering for web recommendations. In Proceedings of the 14th Portuguese Conference on Artificial Intelligence: Progress in Artificial Intelligence (EPIA). 673--684.
[32]
Andriy Mnih and Ruslan Salakhutdinov. 2007. Probabilistic matrix factorization. In Proceedings of the 21th Conference on Neural Information Processing Systems (NIPS). 1257--1264.
[33]
Manos Papagelis, Ioannis Rousidis, Dimitris Plexousakis, and Elias Theoharopoulos. 2005. Incremental collaborative filtering for highly-scalable recommendation algorithms. In Proceedings of the 15th International Conference on Foundations of Intelligent Systems (ISMIS). 553--561.
[34]
Zhaochun Ren, Shangsong Liang, Edgar Meij, and Maarten de Rijke. 2013. Personalized time-aware tweets summarization. In Proceedings of the 36th ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 513--522.
[35]
Steffen Rendle. 2012. Factorization machines with libFM. ACM Trans. Intellig. Syst. Technol. 3, 3 (2012), No. 57.
[36]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Schmidt-Thie Lars. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty in Artificial Intelligence (UAI). 452--461.
[37]
Jasson D. M. Rennie and Nathan Srebro. 2005. Fast maximum margin matrix factorization for collaborative prediction. In Proceedings of the 22nd International Conference on Machine Learning (ICML). 713--719.
[38]
Paul Resnick, Neophytos Iacovou, Mitesh Suchak, Peter Bergstrom, and John Riedl. 1994. GroupLens: An open architecture for collaborative filtering of netnews. In Proceedings of the 5th ACM Conference on Computer Supported Cooperative Work (CSCW). 175--186.
[39]
Badrul M. Sarwar, George Karypis, Joseph A. Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th International Conference on World Wide Web (WWW). 285--295.
[40]
Badrul M. Sarwar, George Karypis, Joseph A. Konstan, and John Riedl. 2002. Incremental singular value decomposition algorithms for highly scalable recommender systems. In Proceedings of the 5th International Conference on Computer and Information Technology (ICCIT). 27--28.
[41]
Abd-Krim Seghouane. 2011. A Kullback--Leibler divergence approach to blind image restoration. IEEE Trans. Image Process. 20, 7 (2011), 2078--2083.
[42]
Guy Shani, David Heckerman, and Ronen I. Brafman. 2005. An MDP-based recommender system. J. Mach. Learn. Res. 6 (2005), 1265--1295.
[43]
Yue Shi, Alexandros Karatzoglou, Linas Baltrunas, Martha Larson, Nuria Oliver, and Alan Hanjalic. 2012. CLiMF: Learning to maximize reciprocal rank with collaborative less-is-more filtering. In Proceedings of the 6th ACM Conference on Recommender Systems (RecSys). 139--146.
[44]
Yue Shi, Martha Larson, and Alan Hanjalic. 2010. List-wise learning to rank with matrix factorization for collaborative filtering. In Proceedings of the 4th ACM Conference on Recommender Systems (RecSys). 269--272.
[45]
Yue Shi, Martha Larson, and Alan Hanjalic. 2014. Collaborative filtering beyond the user-item matrix: A survey of the state of the art and future challenges. ACM Comput. Surv. 47, 1 (2014), 3:1--3:45.
[46]
Luo Si and Rong Jin. 2003. Flexible mixture model for collaborative filtering. In Proceedings of the 20th International Conference on Machine Learning (ICML). 704--711.
[47]
Herbert A. Simon. 1971. Designing organizations for an information rich world. In Computers, Communications, and the Public Interest. Baltimore, 37--72.
[48]
Yaniv Taigman, Ming Yang, Marc’Aurelio Ranzato, and Lior Wolf. 2014. DeepFace: Closing the gap to human-level performance in face verification. In Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 1701--1708.
[49]
Jiliang Tang, Xia Hu, Huiji Gao, and Huan Liu. 2013. Exploiting local and global social context for recommendation. In Proceedings of the 23rd International Joint Conference on Artificial Intelligence (IJCAI). 2712--2718.
[50]
Slobodan Vucetic and Zoran Obradovic. 2005. Collaborative filtering using a regression-based approach. Knowl. Inform. Syst. 7, 1 (2005), 1--22.
[51]
Shuaiqiang Wang, Jiankai Sun, Byron J. Gao, and Jun Ma. 2012b. Adapting vector space model to ranking-based collaborative filtering. In Proceedings of the 21st ACM International Conference on Information and Knowledge Management (CIKM). 1487--1491.
[52]
Shuaiqiang Wang, Jiankai Sun, Byron J. Gao, and Jun Ma. 2014. VSRank: A novel framework for ranking-based collaborative filtering. ACM Trans. Intell. Syst. Technol. 5, 3 (2014), No. 51.
[53]
Yongchang Wang, Kai Liu, Qi Hao, Xianwang Wang, Daniel L. Lau, and Laurence G. Hassebrook. 2012a. Robust active stereo vision using Kullback--Leibler divergence. IEEE Trans. Pattern Anal. Mach. Intell. 34, 3 (2012), 548--563.
[54]
Markus Weimer, Alexandros Karatzoglou, Quoc Viet Le, and Alex Smola. 2007. CofiRank - Maximum margin matrix factorization for collaborative ranking. In Proceedings of the 21th Conference on Neural Information Processing Systems (NIPS). 1329--1336.
[55]
Shuang-Hong Yang, Bo Long, Alexander J. Smola, Hongyuan Zha, and Zhaohui Zheng. 2011. Collaborative competitive filtering: Learning recommender using context of user choice. In Proceedings of the 34th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 295--304.
[56]
Xiao Yang, Zhaoxin Zhang, and Ke Wang. 2012. Scalable collaborative filtering using incremental update and local link prediction. In Proceedings of the 21st ACM Conference on Information and Knowledge Management (CIKM). 2371--2374.
[57]
Yongfeng Zhang, Guokun Lai, Min Zhang, Yi Zhang, Yiqun Liu, and Shaoping Ma. 2014. Explicit factor models for explainable recommendation based on phrase-level sentiment analysis. In Proceedings of the 37th ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 83--92.

Cited By

View all
  • (2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
  • (2023)Similarity matrix enhanced collaborative filtering for e-government recommendationData & Knowledge Engineering10.1016/j.datak.2023.102179145:COnline publication date: 1-May-2023
  • (2022)A Ranking Recommendation Algorithm Based on Dynamic User PreferenceSensors10.3390/s2222868322:22(8683)Online publication date: 10-Nov-2022
  • Show More Cited By

Index Terms

  1. Ranking-Oriented Collaborative Filtering: A Listwise Approach

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Information Systems
      ACM Transactions on Information Systems  Volume 35, Issue 2
      April 2017
      232 pages
      ISSN:1046-8188
      EISSN:1558-2868
      DOI:10.1145/3001595
      Issue’s Table of Contents
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 21 September 2016
      Accepted: 01 June 2016
      Revised: 01 May 2016
      Received: 01 December 2015
      Published in TOIS Volume 35, Issue 2

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Collaborative filtering
      2. ranking-oriented collaborative filtering
      3. recommender systems

      Qualifiers

      • Research-article
      • Research
      • Refereed

      Funding Sources

      • Natural Science Foundation of Shandong Province
      • Academy of Finland
      • Microsoft research fund
      • Doctoral Fund of Ministry of Education of China
      • Natural Science Foundation of China

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)20
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 26 Sep 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661563(1875-1894)Online publication date: 1-Jul-2024
      • (2023)Similarity matrix enhanced collaborative filtering for e-government recommendationData & Knowledge Engineering10.1016/j.datak.2023.102179145:COnline publication date: 1-May-2023
      • (2022)A Ranking Recommendation Algorithm Based on Dynamic User PreferenceSensors10.3390/s2222868322:22(8683)Online publication date: 10-Nov-2022
      • (2022)Recommendation Algorithm Using SVD and Weight Point Rank (SVD-WPR)Big Data and Cognitive Computing10.3390/bdcc60401216:4(121)Online publication date: 21-Oct-2022
      • (2022)Group decision making under uncertain preferences: powered by AI, empowered by AIAnnals of the New York Academy of Sciences10.1111/nyas.147341511:1(22-39)Online publication date: 4-Feb-2022
      • (2022) User Preference Modeling on Heterogeneous Implicit Feedback with Transfer Learning 1 2022 IEEE 25th International Conference on Computer Supported Cooperative Work in Design (CSCWD)10.1109/CSCWD54268.2022.9776249(214-220)Online publication date: 4-May-2022
      • (2022)CoCNN: Co-occurrence CNN for recommendationExpert Systems with Applications10.1016/j.eswa.2022.116595195(116595)Online publication date: Jun-2022
      • (2021)Deleuze and the Digital: On the Materiality of Algorithmic InfrastructuresDeleuze and Guattari Studies10.3366/dlgs.2021.045915:4(593-609)Online publication date: Nov-2021
      • (2021)Pairwise deep learning to rank for top-N recommendationJournal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology10.3233/JIFS-20209240:6(10969-10980)Online publication date: 1-Jan-2021
      • (2021)User profile correlation-based similarity (UPCSim) algorithm in movie recommendation systemJournal of Big Data10.1186/s40537-021-00425-x8:1Online publication date: 29-Mar-2021
      • Show More Cited By

      View Options

      Get Access

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media