Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3240323.3240352acmconferencesArticle/Chapter ViewAbstractPublication PagesrecsysConference Proceedingsconference-collections
research-article
Open access

Preference elicitation as an optimization problem

Published: 27 September 2018 Publication History

Abstract

The new user coldstart problem arises when a recommender system does not yet have any information about a user. A common solution to it is to generate a profile by asking the user to rate a number of items. Which items are selected determines the quality of the recommendations made, and thus has been studied extensively. We propose a new elicitation method to generate a static preference questionnaire (SPQ) that poses relative preference questions to the user. Using a latent factor model, we show that SPQ improves personalized recommendations by choosing a minimal and diverse set of questions. We are the first to rigorously prove which optimization task should be solved to select each question in static questionnaires. Our theoretical results are confirmed by extensive experimentation. We test the performance of SPQ on two real-world datasets, under two experimental conditions: simulated, when users behave according to a latent factor model (LFM), and real, in which only real user judgments are revealed as the system asks questions. We show that SPQ reduces the necessary length of a questionnaire by up to a factor of three compared to state-of-the-art preference elicitation methods. Moreover, solving the right optimization task, SPQ also performs better than baselines with dynamically generated questions.

Supplementary Material

MP4 File (p172-graus.mp4)

References

[1]
Xavier Amatriain, Josep M Pujol, and Nuria Oliver. 2009. I like it... I like it not: Evaluating user ratings noise in recommender systems. In UMAP. Springer, 247--258.
[2]
Oren Anava, Shahar Golan, Nadav Golbandi, Zohar Karnin, Ronny Lempel, Oleg Rokhlenko, and Oren Somekh. 2015. Budget-constrained item cold-start handling in collaborative filtering recommenders via optimal design. In WWW. ACM, 45--54.
[3]
Lucas Bernardi, Jaap Kamps, Julia Kiseleva, and Melanie J. I. Müller. 2015. The continuous cold start problem in e-commerce recommender systems. In Proceedings of the Workshop on New Trends on Content-Based Recommender Systems co-located with ACM Conference on Recommender Systems. 30--33.
[4]
Christopher JC Burges. 2010. From RankNet to LambdaRank to LambdaMART: An overview. Learning 11, 23--581 (2010), 81.
[5]
Census Bureau 2015. E-Stats: Measuring the electronic economy. https://www.census.gov/econ/estats/.
[6]
Konstantina Christakopoulou, Filip Radlinski, and Katja Hofmann. 2016. Towards conversational recommender systems. In KDD. ACM, 815--824.
[7]
Ömer Egecioglu and Bahman Kalantari. 1989. Approximating the diameter of a set of points in the Euclidean space. Inform. Process. Lett. 32, 4 (1989), 205--211.
[8]
Daniele V. Finocchiaro and Marco Pellegrini. 2002. On computing the diameter of a point set in high dimensional Euclidean space. Theoretical Computer Science 287, 2 (2002), 501--514.
[9]
Alexander Fonarev, Alexander Mikhalev, Pavel Serdyukov, Gleb Gusev, and Ivan Oseledets. 2016. Efficient rectangular maximal-volume algorithm for rating elicitation in collaborative filtering. arXiv preprint arXiv:1610.04850.
[10]
Jerome H. Friedman, Ron Kohavi, and Yeogirl Yun. 1996. Lazy decision trees. In AAAI/IAAI, Vol. 1. 717--724.
[11]
Nadav Golbandi, Yehuda Koren, and Ronny Lempel. 2010. On bootstrapping recommender systems. In CIKM. ACM, 1805--1808.
[12]
Nadav Golbandi, Yehuda Koren, and Ronny Lempel. 2011. Adaptive bootstrapping of recommender systems using decision trees. In WSDM. ACM, 595--604.
[13]
Sergei A. Goreinov, Ivan V. Oseledets, Dimitry V. Savostyanov, Eugene E. Tyrtyshnikov, and Nikolay L. Zamarashkin. 2010. How to find a good submatrix. In Matrix Methods: Theory, Algorithms, Applications, Vadim Olshevsky and Eugene E. Tyrtyshnikov (Eds.). World Scientific, Hackensack, NY, 247--256.
[14]
William W. Hager. 1989. Updating the inverse of a matrix. SIAM Rev. 31, 2 (1989), 221--239.
[15]
F. Maxwell Harper and Joseph A. Konstan. 2016. The movielens datasets: History and context. ACM Transactions on Interactive Intelligent Systems 5, 4 (2016), 19.
[16]
Fangwei Hu and Yong Yu. 2013. Interview process learning for top-n recommendation. In RecSys. ACM, 331--334.
[17]
Nicolas Jones, Armelle Brun, and Anne Boyer. 2011. Comparisons instead of ratings: Towards more stable preferences. In Proceedings of the 2011IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology-Volume 01. IEEE Computer Society, 451--456.
[18]
Saikishore Kalloori, Francesco Ricci, and Marko Tkalcic. 2016. Pairwise preferences based matrix factorization and nearest neighbor recommendation techniques. In RecSys. ACM, 143--146.
[19]
Julia Kiseleva, Alexander Tuzhilin, Jaap Kamps, Melanie J. I. Muller, Lucas Bernardi, Chad Davis, Ivan Kovacek, Mats Stafseng Einarsen, and Djoerd Hiemstra. 2016. Beyond movie recommendations: Solving the continuous cold start problem in e-commerce recommendations. CoRR 1607.07904 (2016).
[20]
Yehuda Koren. 2010. Collaborative filtering with temporal dynamics. Commun. ACM 53, 4 (2010), 89--97.
[21]
Lihong Li, Wei Chu, John Langford, and Robert E. Schapire. 2010. A contextual-bandit approach to personalized news article recommendation. In WWW. ACM, 661--670.
[22]
Nathan N. Liu, Xiangrui Meng, Chao Liu, and Qiang Yang. 2011. Wisdom of the better few: cold start recommendation via representative based rating elicitation. In RecSys. ACM, 37--44.
[23]
Julian McAuley, Christopher Targett, Qinfeng Shi, and Anton Van Den Hengel. 2015. Image-based recommendations on styles and substitutes. In SIGIR. ACM, 43--52.
[24]
Al Mamunur Rashid, Istvan Albert, Dan Cosley, Shyong K. Lam, Sean M. McNee, Joseph A. Konstan, and John Riedl. 2002. Getting to know you: learning new user preferences in recommender systems. In IUI. ACM, 127--134.
[25]
Al Mamunur Rashid, George Karypis, and John Riedl. 2008. Learning preferences of new users in recommender systems: an information theoretic approach. ACM SIGKDD Explorations Newsletter 10, 2 (2008), 90--100.
[26]
Lior Rokach and Slava Kisilevich. 2012. Initial profile generation in recommender systems using pairwise comparison. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) 42, 6 (2012), 1854--1859.
[27]
Ruslan Salakhutdinov and Andriy Mnih. 2008. Probabilistic matrix factorization. In NIPS, Vol. 1. 1257--1264.
[28]
J. Ben Schafer, Dan Frankowski, Jon Herlocker, and Shilad Sen. 2007. Collaborative filtering recommender systems. In The Adaptive Web. Springer, 291--324.
[29]
Hans Schwerdtfeger. 1950. Introduction to Linear Algebra and the Theory of Matrices. Noordhoff.
[30]
Anna Sepliarskaia, Filip Radlinski, and Maarten de Rijke. 2017. Simple personalized search based on long-term behavioral signals. In ECIR (LNCS). Springer, 95--107.
[31]
Amit Sharma and Baoshi Yan. 2013. Pairwise learning in recommendation: experiments with community recommendation on linkedin. In RecSys. ACM, 193--200.
[32]
Lyle H. Ungar and Dean P. Foster. 1998. Clustering methods for collaborative filtering. In AAAI Workshop on Recommendation Systems. AAAI, 114--129.

Cited By

View all
  • (2024)Knowledge-Enhanced Conversational Recommendation via Transformer-Based Sequential ModelingACM Transactions on Information Systems10.1145/367737642:6(1-27)Online publication date: 18-Oct-2024
  • (2024)Our Model Achieves Excellent Performance on MovieLens: What Does It Mean?ACM Transactions on Information Systems10.1145/367516342:6(1-25)Online publication date: 18-Oct-2024
  • (2023)Citizen-Centric Multiagent SystemsProceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems10.5555/3545946.3598843(1802-1807)Online publication date: 30-May-2023
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
RecSys '18: Proceedings of the 12th ACM Conference on Recommender Systems
September 2018
600 pages
ISBN:9781450359016
DOI:10.1145/3240323
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 September 2018

Check for updates

Author Tags

  1. cold start problem
  2. mixed initiative search and recommendation
  3. preference elicitation

Qualifiers

  • Research-article

Funding Sources

  • Google Faculty Research Awards program
  • Microsoft Research Ph.D. program

Conference

RecSys '18
Sponsor:
RecSys '18: Twelfth ACM Conference on Recommender Systems
October 2, 2018
British Columbia, Vancouver, Canada

Acceptance Rates

RecSys '18 Paper Acceptance Rate 32 of 181 submissions, 18%;
Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)223
  • Downloads (Last 6 weeks)41
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Knowledge-Enhanced Conversational Recommendation via Transformer-Based Sequential ModelingACM Transactions on Information Systems10.1145/367737642:6(1-27)Online publication date: 18-Oct-2024
  • (2024)Our Model Achieves Excellent Performance on MovieLens: What Does It Mean?ACM Transactions on Information Systems10.1145/367516342:6(1-25)Online publication date: 18-Oct-2024
  • (2023)Citizen-Centric Multiagent SystemsProceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems10.5555/3545946.3598843(1802-1807)Online publication date: 30-May-2023
  • (2023)Generating Usage-related Questions for Preference Elicitation in Conversational Recommender SystemsACM Transactions on Recommender Systems10.1145/36299812:2(1-24)Online publication date: 27-Oct-2023
  • (2023)Multi-Interest Multi-Round Conversational Recommendation System with Fuzzy Feedback Based User SimulatorACM Transactions on Recommender Systems10.1145/36163792:4(1-29)Online publication date: 24-Aug-2023
  • (2023)Large Language Models are Competitive Near Cold-start Recommenders for Language- and Item-based PreferencesProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3608845(890-896)Online publication date: 14-Sep-2023
  • (2023)On Reducing User Interaction Data for PersonalizationACM Transactions on Recommender Systems10.1145/36000971:3(1-28)Online publication date: 7-Aug-2023
  • (2023)Enhancing Conversational Recommendation Systems with Representation FusionACM Transactions on the Web10.1145/357703417:1(1-34)Online publication date: 21-Feb-2023
  • (2023)Users Meet Clarifying Questions: Toward a Better Understanding of User Interactions for Search ClarificationACM Transactions on Information Systems10.1145/352411041:1(1-25)Online publication date: 9-Jan-2023
  • (2023)Generating Relevant and Informative Questions for Open-Domain ConversationsACM Transactions on Information Systems10.1145/351061241:1(1-30)Online publication date: 9-Jan-2023
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media