research-article

Public Access

Personalized explanations for hybrid recommender systems

Authors:

James Schaffer,

John O'Donovan,

Lise GetoorAuthors Info & Claims

IUI '19: Proceedings of the 24th International Conference on Intelligent User Interfaces

Pages 379 - 390

https://doi.org/10.1145/3301275.3302306

Published: 17 March 2019 Publication History

Abstract

Recommender systems have become pervasive on the web, shaping the way users see information and thus the decisions they make. As these systems get more complex, there is a growing need for transparency. In this paper, we study the problem of generating and visualizing personalized explanations for hybrid recommender systems, which incorporate many different data sources. We build upon a hybrid probabilistic graphical model and develop an approach to generate real-time recommendations along with personalized explanations. To study the benefits of explanations for hybrid recommender systems, we conduct a crowd-sourced user study where our system generates personalized recommendations and explanations for real users of the last.fm music platform. We experiment with 1) different explanation styles (e.g., user-based, item-based), 2) manipulating the number of explanation styles presented, and 3) manipulating the presentation format (e.g., textual vs. visual). We apply a mixed model statistical analysis to consider user personality traits as a control variable and demonstrate the usefulness of our approach in creating personalized hybrid explanations with different style, number, and format.

Supplementary Material

MP4 File (p379-kouki.mp4)

Download
540.82 MB

References

[1]

G. Adomavicius, N. Manouselis, and Y. Kwon. 2015. Multi-Criteria Recommender Systems. Recommender Systems Handbook, Second Edition, Springer US.

Digital Library

[2]

I. Andjelkovic, D. Parra, and J. O'Donovan. 2019. Moodplay: interactive music recommendation based on artists' mood similarity. International Journal of Human-Computer Studies, 121.

[3]

S. Bach, M. Broecheler, B. Huang, and L. Getoor. 2017. Hinge-loss markov random fields and probabilistic soft logic. Journal of Machine Learning Research. (JMLR'17) 18, 109.

Digital Library

[4]

Y. Benjamini and Y. Hochberg. 1995. Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. (JRSS '95) 18, 109.

[5]

S. Berkovsky, R. Taib, and D. Conway. 2017. How to recommend?: user trust factors in movie recommender systems. In Proceedings of the 22nd International Conference on Intelligent User Interfaces (IUI '17).

Digital Library

[6]

M. Bilgic and R. Mooney. 2005. Explaining recommendations: satisfaction vs. promotion. In Beyond Personalization Workshop in conjunction with International Conference on Intelligent User Interfaces (IUI '05).

[7]

S. Bostandjiev, J. O'Donovan, and T. Höllerer. 2012. Tasteweights: a visual interactive hybrid recommender system. In Proceedings of the 6th ACM Conference on Recommender Systems (RecSys '12).

Digital Library

[8]

D. Campbell and D. Fiske. 1959. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 2.

[9]

S. Chang, F. Harper, and L. Terveen. 2016. Crowd-based personalized natural language explanations for recommendations. In Proceedings of the 10th ACM Conference on Recommender Systems (RecSys '16).

Digital Library

[10]

R. Cribbie. 2007. Multiplicity control in structural equation modeling. Structural Equation Modeling, 14, 1.

[11]

G. Friedrich and M. Zanker. 2017. A taxonomy for generating explanations in recommender systems. AI Magazine, 32, 3.

[12]

Z. Gantner, S. Rendle, C. Freudenthaler, and L. Schmidt-Thieme. 2011. My-medialite: a free recommender system library. In Proceedings of the 5th ACM Conference on Recommender Systems (RecSys '11).

Digital Library

[13]

F. Gedikli, D. Jannach, and M. Ge. 2014. How should i explain? a comparison of different explanation types for recommender systems. International Journal of Human-Computer Studies, 72, 4.

Digital Library

[14]

S. Gosling, P. Rentfrow, and W. Swann. 2003. A very brief measure of the big-five personality domains. Journal of Research in Personality, 37, 6.

[15]

J. Herlocker, J. Konstan, and J. Riedl. 2000. Explaining collaborative filtering recommendations. In Proceedings of the Conference on Computer Supported Cooperative Work (CSCW '00).

Digital Library

[16]

J. Herlocker, J. Konstan, L. Terveen, and J. Riedl. 2004. Evaluating collaborative filtering recommender systems. ACM Transactions on Information Systems. (TOIS '04) 22, 1.

Digital Library

[17]

Y. Hu, Y. Koren, and C. Volinsky. 2008. Collaborative filtering for implicit feedback datasets. In IEEE International Conference on Data Mining (ICDM '08).

Digital Library

[18]

P. Ipeirotis. 2010. Mechanical turk: now with 40.92% spam. http://www.behind-the-enemy-lines.com/2010/12/mechanical-turk-now-with-4092-spam.html.Blog. (2010).

[19]

D. Jannach, I. Kamehkhosh, and L. Lerche. 2017. Leveraging multi-dimensional user models for personalized next-track music recommendation. In Proceedings of the Symposium on Applied Computing (SAC '17).

Digital Library

[20]

B. Knijnenburg, S. Bostandjiev, J. O'Donovan, and A. Kobsa. 2012. Inspectability and control in social recommenders. In Proceedings of the 6th ACM Conference on Recommender Systems (RecSys '12).

Digital Library

[21]

P. Kouki, S. Fakhraei, J. Foulds, M. Eirinaki, and L. Getoor. 2015. Hyper: a flexible and extensible probabilistic framework for hybrid recommender systems. In Proceedings of the 9th ACM Conference on Recommender Systems (RecSys '15).

Digital Library

[22]

P. Kouki, J. Schaffer, J. Pujara, J. O'Donovan, and L. Getoor. 2017. User preferences for hybrid explanations. In Proceedings of the 11th ACM Conference on Recommender Systems (RecSys '17).

Digital Library

[23]

T. Nguyen, D. Kluver, T. Wang, P. Hui, M. Ekstrand, M. Willemsen, and J. Riedl. 2013. Rating support interfaces to improve user experience and recommender accuracy. In Proceedings of the 7th ACM Conference on Recommender Systems (RecSys '13).

Digital Library

[24]

X. Ning, C. Desrosiers, and G. Karypis. 2015. A comprehensive survey of neighborhood based recommendation methods. Recommender Systems Handbook, Second Edition, Springer US.

Digital Library

[25]

I. Nunes and D. Jannach. 2017. A systematic review and taxonomy of explanations in decision support and recommender systems. User Modeling and User-Adapted Interaction. (UMUAI'17) 27, 3--5.

Digital Library

[26]

J. O'Donovan, B. Smyth, B. Gretarsson, S. Bostandjiev, and T. Höllerer. 2008. Peerchooser: visual interactive recommendation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08).

Digital Library

[27]

S. Oramas, L. Espinosa-Anke, M. Sordo, H. Saggion, and X. Serra. 2016. Information extraction for knowledge base construction in the music domain. Data & Knowledge Engineering, 106, C.

Digital Library

[28]

A. Papadimitriou, P. Symeonidis, and Y. Manolopoulos. 2012. A generalized taxonomy of explanations styles for traditional and social recommender systems. Data Mining and Knowledge Discovery, 24, 3.

Digital Library

[29]

D. Parra, P. Brusilovsky, and C. Trattner. 2014. See what you want to see: visual user-driven approach for hybrid recommendation. In Proceedings of the 19th International Conference on Intelligent User Interfaces (IUI '14).

Digital Library

[30]

S. Rendle, C. Freudenthaler, Z. Gantner, and L. Schmidt-Thieme. 2009. BPR: bayesian personalized ranking from implicit feedback. In Proceedings of the 25th Conference on Uncertainty under Artificial Intelligence (UAI '09).

Digital Library

[31]

M. Sato, B. Ahsan, K. Nagatani, T. Sonoda, Q. Zhang, and T. Ohkuma. 2018. Explaining recommendations using contexts. In Proceedings of the 23rd International Conference on Intelligent User Interfaces (IUI '18).

Digital Library

[32]

J. Schaffer, J. O'Donovan, and T. Höllerer. 2018. Easy to please: separating user experience from choice satisfaction. In Proceedings of the 26th Conference on User Modeling, Adaptation and Personalization (UMAP'18).

Digital Library

[33]

P. Symeonidis, A. Nanopoulos, and Y. Manolopoulos. 2009. Moviexplain: a recommender system with explanations. In Proceedings of the 3rd ACM Conference on Recommender Systems (RecSys '09).

Digital Library

[34]

M. Tavakol and R. Dennick. 2011. Making sense of cronbach's alpha. International Journal of Medical Education, 2.

[35]

N. Tintarev and J. Masthoff. 2012. Evaluating the effectiveness of explanations for recommender systems. User Modeling and User-Adapted Interaction. (UMUAI'12) 22, 4--5.

Digital Library

[36]

M. Tkalcic and L. Chen. 2015. Personality and Recommender Systems. Recommender Systems Handbook, Second Edition, Springer US.

Digital Library

[37]

J. Tukey. 1949. Comparing individual means in the analysis of variance. Biometrics.

[38]

J. Ullman and P. Bentler. 2003. Structural equation modeling. Wiley Online Library.

[39]

K. Verbert, D. Parra, P. Brusilovsky, and E. Duval. 2013. Visualizing recommendations to support exploration, transparency and controllability. In Proceedings of the 18th International Conference on Intelligent User Interfaces (IUI '13).

Digital Library

[40]

J. Vig, S. Sen, and J. Riedl. 2009. Tagsplanations: explaining recommendations using tags. In Proceedings of the 14th International Conference on Intelligent User Interfaces (IUI '09).

Digital Library

Cited By

Naveed SStevens GRobin-Kern D(2024)An Overview of the Empirical Evaluation of Explainable AI (XAI): A Comprehensive Guideline for User-Centered Evaluation in XAIApplied Sciences10.3390/app14231128814:23(11288)Online publication date: 3-Dec-2024
https://doi.org/10.3390/app142311288
Schütze CRichter BLammert OThommes KWrede B(2024)Static Socio-demographic and Individual Factors for Generating Explanations in XAI: Can they serve as a prior in DSS for adaptation of explanation strategies?Proceedings of the 12th International Conference on Human-Agent Interaction10.1145/3687272.3688300(141-149)Online publication date: 24-Nov-2024
https://dl.acm.org/doi/10.1145/3687272.3688300
Wang YChu CLi K(2024)Research on Game Recommendation Algorithms Based on Hybrid ModelsProceedings of the 3rd International Conference on Computer, Artificial Intelligence and Control Engineering10.1145/3672758.3672803(267-274)Online publication date: 26-Jan-2024
https://dl.acm.org/doi/10.1145/3672758.3672803
Show More Cited By

Index Terms

Personalized explanations for hybrid recommender systems
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing systems and tools
      1. Social networking sites
  2. Visualization
    1. Empirical studies in visualization
2. Information systems
  1. Information systems applications
    1. Data mining
      1. Collaborative filtering
    2. Decision support systems

Recommendations

Generating and Understanding Personalized Explanations in Hybrid Recommender Systems
Special Issue on IUI 2019 Highlights

Recommender systems are ubiquitous and shape the way users access information and make decisions. As these systems become more complex, there is a growing need for transparency and interpretability. In this article, we study the problem of generating ...
The Adaptive Ontology-Based Personalized Recommender System

Recommender systems provide strategies that help users search or make decisions within the overwhelming information spaces nowadays. They have played an important role in various areas such as e-commerce and e-learning. In this paper, we propose a ...
Dynamic generation of personalized hybrid recommender systems
RecSys '13: Proceedings of the 7th ACM conference on Recommender systems

The problem of information overload has been a relevant and active research topic for the past twenty years. Since then, numerous algorithms and recommendation approaches have been proposed, which gives rise to a new type of problem: recommendation ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '19: Proceedings of the 24th International Conference on Intelligent User Interfaces

March 2019

713 pages

ISBN:9781450362726

DOI:10.1145/3301275

General Chairs:
Wai-Tat Fu,
Shimei Pan,
Program Chairs:
Oliver Brdiczka,
Polo Chau,
Gaelle Calvary

Copyright © 2019 ACM.

© 2019 Association for Computing Machinery. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of the United States government. As such, the United States Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 March 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

IUI '19

Sponsor:

IUI '19: 24th International Conference on Intelligent User Interfaces

March 17 - 20, 2019

California, Marina del Ray

Acceptance Rates

IUI '19 Paper Acceptance Rate 71 of 282 submissions, 25%;

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

107
Total Citations
View Citations
4,431
Total Downloads

Downloads (Last 12 months)842
Downloads (Last 6 weeks)91

Reflects downloads up to 31 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Naveed SStevens GRobin-Kern D(2024)An Overview of the Empirical Evaluation of Explainable AI (XAI): A Comprehensive Guideline for User-Centered Evaluation in XAIApplied Sciences10.3390/app14231128814:23(11288)Online publication date: 3-Dec-2024
https://doi.org/10.3390/app142311288
Schütze CRichter BLammert OThommes KWrede B(2024)Static Socio-demographic and Individual Factors for Generating Explanations in XAI: Can they serve as a prior in DSS for adaptation of explanation strategies?Proceedings of the 12th International Conference on Human-Agent Interaction10.1145/3687272.3688300(141-149)Online publication date: 24-Nov-2024
https://dl.acm.org/doi/10.1145/3687272.3688300
Wang YChu CLi K(2024)Research on Game Recommendation Algorithms Based on Hybrid ModelsProceedings of the 3rd International Conference on Computer, Artificial Intelligence and Control Engineering10.1145/3672758.3672803(267-274)Online publication date: 26-Jan-2024
https://dl.acm.org/doi/10.1145/3672758.3672803
Chatti MGuesmi MMuslim A(2024)Visualization for Recommendation Explainability: A Survey and New PerspectivesACM Transactions on Interactive Intelligent Systems10.1145/367227614:3(1-40)Online publication date: 11-Jun-2024
https://dl.acm.org/doi/10.1145/3672276
Alsayed ADam HNguyen CSpinellis DConstantinou EBacchelli A(2024)MicroRec: Leveraging Large Language Models for Microservice RecommendationProceedings of the 21st International Conference on Mining Software Repositories10.1145/3643991.3644916(419-430)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3643991.3644916
Tran TPolat Erdeniz SFelfernig ALubos SEl Mansi MLe V(2024)Less is More: Towards Sustainability-Aware Persuasive Explanations in Recommender SystemsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3691708(1108-1112)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3640457.3691708
Shashaani S(2024)Explainability in Music Recommender SystemProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688028(1395-1401)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3640457.3688028
Jeng J(2024)Bridging Viewpoints in News with Recommender SystemsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688008(1283-1289)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3640457.3688008
Jafari EBoratto LGena CMarras MGermanakos PPopescus E(2024)Balanced Explanations in Recommender SystemsAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664915(25-29)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3631700.3664915
Suchmann LKrämer NZiegler JBoratto LGena CMarras MGermanakos PPopescus E(2024)Dynamic Ridge Plot Sliders: Supporting Users' Understanding of the Item Space Structure and Feature Dependencies in Interactive Recommender SystemsAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664872(106-113)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3631700.3664872
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten