research-article

Understanding Assimilation-contrast Effects in Online Rating Systems: Modelling, Debiasing, and Applications

Authors:

Xiaoying Zhang,

John C. S. LuiAuthors Info & Claims

ACM Transactions on Information Systems (TOIS), Volume 38, Issue 1

Article No.: 2, Pages 1 - 25

https://doi.org/10.1145/3362651

Published: 17 October 2019 Publication History

Abstract

“Unbiasedness,” which is an important property to ensure that users’ ratings indeed reflect their true evaluations of products, is vital both in shaping consumer purchase decisions and providing reliable recommendations in online rating systems. Recent experimental studies showed that distortions from historical ratings would ruin the unbiasedness of subsequent ratings. How to “discover” historical distortions in each single rating (or at the micro-level), and perform the “debiasing operations” are our main objective. Using 42M real customer ratings, we first show that users either “assimilate” or “contrast” to historical ratings under different scenarios, which can be further explained by a well-known psychological argument: the “Assimilate-Contrast” theory. This motivates us to propose the Historical Influence Aware Latent Factor Model (HIALF), the “first” model for real rating systems to capture and mitigate historical distortions in each single rating. HIALF allows us to study the influence patterns of historical ratings from a modelling perspective, which perfectly matches the assimilation and contrast effects observed in experiments. Moreover, HIALF achieves significant improvements in predicting subsequent ratings and characterizing relationships in ratings. It also contributes to better recommendations, wiser consumer purchase decisions, and deeper understanding of historical distortions in both honest rating and misbehaving rating settings.

References

[1]

Wikipedia. 2017. Internet Water Army. Retrived from https://en.wikipedia.org/wiki/Internet_Water_Army.

[2]

Gediminas Adomavicius, Jesse Bockstedt, Shawn Curley, and Jingjing Zhang. 2014. De-biasing user preference ratings in recommender systems. In Proceedings of the IntRS Workshop@RecSys’14. 2--9.

[3]

Gediminas Adomavicius, Jesse Bockstedt, Shawn P. Curley, and Jingjing Zhang. 2016. Understanding effects of personalized vs. aggregate ratings on user preferences. In Proceedings of the IntRS Workshop@RecSys’16. 14--21.

[4]

Mohammad Aliannejadi and Fabio Crestani. 2018. Personalized context-aware point of interest recommendation. ACM Trans. Inf. Syst. 36, 4, Article 45 (Oct. 2018), 28 pages.

Digital Library

[5]

Rolph E. Anderson. 1973. Consumer dissatisfaction: The effect of disconfirmed expectancy on perceived product performance. J. Mark. Res. 10, 1 (1973), 38--44.

[6]

Jia Chen, Qin Jin, Shiwan Zhao, Shenghua Bao, Li Zhang, Zhong Su, and Yong Yu. 2016. Boosting recommendation in unexplored categories by user price preference. ACM Trans. Inf. Syst. 35, 2, Article 12 (Oct. 2016), 27 pages.

Digital Library

[7]

Abhimanyu Das, Sreenivas Gollapudi, Rina Panigrahy, and Mahyar Salek. 2013. Debiasing social wisdom. In Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 500--508.

Digital Library

[8]

Anirban Dasgupta, Ravi Kumar, and D. Sivakumar. 2012. Social sampling. In Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 235--243.

[9]

James Davidson, Benjamin Liebald, Junning Liu, Palash Nandy, Taylor Van Vleet, Ullas Gargi, Sujoy Gupta, Yu He, Mike Lambert, Blake Livingston et al. 2010. The YouTube video recommendation system. In Proceedings of the 4th ACM Conference on Recommender Systems. ACM, 293--296.

[10]

Rana Forsati, Iman Barjasteh, Farzan Masrour, Abdol-Hossein Esfahanian, and Hayder Radha. 2015. Pushtrust: An efficient recommendation algorithm by leveraging trust and distrust relations. In Proceedings of the 9th ACM Conference on Recommender Systems. ACM, 51--58.

Digital Library

[11]

Yong Ge and Jingjing Li. 2015. Measure and mitigate the dimensional bias in online reviews and ratings. In Proceedings of the 36th International Conference on Information Systems, Fort Worth, TX.

[12]

Fangjian Guo and David B. Dunson. 2015. Uncovering systematic bias in ratings across categories: A Bayesian approach. In Proceedings of the 9th ACM Conference on Recommender Systems. ACM, 317--320.

[13]

Radu Jurca, Florent Garcin, Arjun Talwar, and Boi Faltings. 2010. Reporting incentives and biases in online review forums. ACM Trans. Web 4, 2 (2010), 5.

Digital Library

[14]

Yehuda Koren. 2008. Factorization meets the neighborhood: A multifaceted collaborative filtering model. In Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 426--434.

Digital Library

[15]

Yehuda Koren. 2009. Collaborative filtering with temporal dynamics. In Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 447--456.

Digital Library

[16]

Sanjay Krishnan, Jay Patel, Michael Franklin, and Ken Goldberg. 2014. Social influence bias in recommender systems: A methodology for learning, analyzing, and mitigating bias in ratings. In Proceedings of the 8th ACM Conference on Recommender Systems. 137--144.

Digital Library

[17]

Bibb Latané. 1981. The psychology of social impact. Amer. Psychol. 36, 4 (1981), 343.

[18]

Ee-Peng Lim, Viet-An Nguyen, Nitin Jindal, Bing Liu, and Hady Wirawan Lauw. 2010. Detecting product review spammers using rating behaviors. In Proceedings of the 19th ACM International Conference on Information and Knowledge Management. ACM, 939--948.

Digital Library

[19]

Guang Ling, Michael R. Lyu, and Irwin King. 2014. Ratings meet reviews, a combined approach to recommend. In Proceedings of the 8th ACM Conference on Recommender Systems. ACM, 105--112.

[20]

Julian McAuley and Jure Leskovec. 2013. From amateurs to connoisseurs: Modeling the evolution of user expertise through online reviews. In Proceedings of the 22nd International World Wide Web Conference (WWW’13).

Digital Library

[21]

Julian McAuley, Rahul Pandey, and Jure Leskovec. 2015. Inferring networks of substitutable and complementary products. In Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 785--794.

Digital Library

[22]

Lev Muchnik, Sinan Aral, and Sean J. Taylor. 2013. Social influence bias: A randomized experiment. Science 341, 6146 (2013), 647--651.

[23]

Hung T. Nguyen, Preetam Ghosh, Michael L. Mayo, and Thang N. Dinh. 2017. Social influence spectrum at scale: Near-optimal solutions for multiple budgets at once. ACM Trans. Inf. Syst. 36, 2 (2017), 14.

Digital Library

[24]

Richard L. Oliver. 2014. Satisfaction: A Behavioral Perspective on the Consumer. Routledge.

[25]

Francesco Ricci, Lior Rokach, and Bracha Shapira. 2011. Introduction to Recommender Systems Handbook. Springer.

Digital Library

[26]

Matthew J. Salganik, Peter Sheridan Dodds, and Duncan J. Watts. 2006. Experimental study of inequality and unpredictability in an artificial cultural market. Science 311, 5762 (2006), 854--856.

[27]

Franklin E. Satterthwaite. 1946. An approximate distribution of estimates of variance components. Biomet. Bull. 2, 6 (1946), 110--114.

[28]

Patrick Shafto and Olfa Nasraoui. 2016. Human-recommender systems: From benchmark data to benchmark cognitive models. In Proceedings of the 10th ACM Conference on Recommender Systems. ACM, 127--130.

Digital Library

[29]

James Surowiecki, Mark P. Silverman, et al. 2007. The wisdom of crowds. Amer. J. Phys. 75, 2 (2007), 190--192.

[30]

Hongning Wang, Yue Lu, and ChengXiang Zhai. 2011. Latent aspect rating analysis without aspect keyword supervision. In Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 618--626.

Digital Library

[31]

Jian Wang and Yi Zhang. 2013. Opportunity models for e-commerce recommendation: Right product, right time. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR’13).

Digital Library

[32]

Ting Wang, Dashun Wang, and Fei Wang. 2014. Quantifying herding effects in crowd wisdom. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1087--1096.

Digital Library

[33]

Larry Wasserman. 2013. All of Statistics: A Concise Course in Statistical Inference. Springer Science 8 Business Media.

Digital Library

[34]

Tim Weninger, Thomas James Johnston, and Maria Glenski. 2015. Random voting effects in social-digital spaces: A case study of Reddit post submissions. In Proceedings of the 26th ACM Conference on Hypertext 8 Social Media. ACM, 293--297.

Digital Library

[35]

Fang Wu and Bernardo A. Huberman. 2010. Opinion formation under costly expression. ACM Trans. Intell. Syst. Technol. 1, 1 (2010), 5.

Digital Library

[36]

Ming Yan, Jitao Sang, and Changsheng Xu. 2015. Unified YouTube video recommendation via cross-network collaboration. In Proceedings of the International Conference on Multimedia Retrieval (ICMR’15).

Digital Library

[37]

Huiling Zhang, Md Abdul Alim, Xiang Li, My T. Thai, and Hien T. Nguyen. 2016. Misinformation in online social networks: Detect them all with a limited budget. ACM Trans. Inf. Syst. 34, 3 (2016), 18.

Digital Library

[38]

Haiyi Zhu and Bernardo A. Huberman. 2014. To switch or not to switch: Understanding social influence in online choices. Amer. Behav. Sci. 58, 10 (2014), 1329--1344.

Cited By

T M SK John ASharma RBerde PMurthy C(2024)Expertise Identification Using TransformersProceedings of the 7th Joint International Conference on Data Science & Management of Data (11th ACM IKDD CODS and 29th COMAD)10.1145/3632410.3632454(454-458)Online publication date: 4-Jan-2024
https://dl.acm.org/doi/10.1145/3632410.3632454
Xie HZhong MShi XZhang XZhong JShang M(2024)Probabilistic Modeling of Assimilate-Contrast Effects in Online Rating SystemsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.329235236:2(795-808)Online publication date: Mar-2024
https://doi.org/10.1109/TKDE.2023.3292352
Jia PWang PLi RZhao JFeng JWang XGuan X(2024)A Compact and Accurate Sketch for Estimating a Large Range of Set Difference Cardinalities2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00110(1338-1351)Online publication date: 13-May-2024
https://doi.org/10.1109/ICDE60146.2024.00110
Show More Cited By

Index Terms

Understanding Assimilation-contrast Effects in Online Rating Systems: Modelling, Debiasing, and Applications
1. Information systems
  1. Information systems applications
    1. Data mining
2. Social and professional topics
  1. User characteristics

Recommendations

Modeling the Assimilation-Contrast Effects in Online Product Rating Systems: Debiasing and Recommendations
RecSys '17: Proceedings of the Eleventh ACM Conference on Recommender Systems

The unbiasedness of online product ratings, an important property to ensure that users' ratings indeed reflect their true evaluations to products, is vital both in shaping consumer purchase decisions and providing reliable recommendations. Recent ...
Modeling the assimilation-contrast effects in online product rating systems: debiasing and recommendations
IJCAI'18: Proceedings of the 27th International Joint Conference on Artificial Intelligence

The unbiasedness of online product ratings, an important property to ensure that users' ratings indeed reflect their true evaluations to products, is vital both in shaping consumer purchase decisions and providing reliable recommendations. Recent ...
New Recommendation Techniques for Multicriteria Rating Systems

Traditional single-rating recommender systems have been successful in a number of personalization applications, but the research area of multicriteria recommender systems has been largely untouched. Taking full advantage of multicriteria ratings in ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Information Systems

ACM Transactions on Information Systems Volume 38, Issue 1

January 2020

301 pages

ISSN:1046-8188

EISSN:1558-2868

DOI:10.1145/3368262

Editor:
Maarten de Rijke
University of Amsterdam, The Netherlands

Issue’s Table of Contents

Copyright © 2019 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2019

Accepted: 01 August 2019

Revised: 01 July 2019

Received: 01 December 2018

Published in TOIS Volume 38, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

GRF

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
435
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)2

Reflects downloads up to 26 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

T M SK John ASharma RBerde PMurthy C(2024)Expertise Identification Using TransformersProceedings of the 7th Joint International Conference on Data Science & Management of Data (11th ACM IKDD CODS and 29th COMAD)10.1145/3632410.3632454(454-458)Online publication date: 4-Jan-2024
https://dl.acm.org/doi/10.1145/3632410.3632454
Xie HZhong MShi XZhang XZhong JShang M(2024)Probabilistic Modeling of Assimilate-Contrast Effects in Online Rating SystemsIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.329235236:2(795-808)Online publication date: Mar-2024
https://doi.org/10.1109/TKDE.2023.3292352
Jia PWang PLi RZhao JFeng JWang XGuan X(2024)A Compact and Accurate Sketch for Estimating a Large Range of Set Difference Cardinalities2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00110(1338-1351)Online publication date: 13-May-2024
https://doi.org/10.1109/ICDE60146.2024.00110
Zhu QLo LXia MChen ZMa X(2022)Bias-Aware Design for Informed Decisions: Raising Awareness of Self-Selection Bias in User Ratings and ReviewsProceedings of the ACM on Human-Computer Interaction10.1145/35555976:CSCW2(1-31)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555597
Liang SLuo YMeng Z(2021)Profiling Users for Question Answering Communities via Flow-Based Constrained Co-Embedding ModelACM Transactions on Information Systems10.1145/347056540:2(1-38)Online publication date: 24-Nov-2021
https://dl.acm.org/doi/10.1145/3470565
Zhang RGuo JChen LFan YCheng X(2021)A Review on Question Generation from Natural Language TextACM Transactions on Information Systems10.1145/346888940:1(1-43)Online publication date: 8-Sep-2021
https://dl.acm.org/doi/10.1145/3468889
Zhang CYao HYu LHuang CSong DChen HJiang MChawla N(2021)Inductive Contextual Relation Learning for PersonalizationACM Transactions on Information Systems10.1145/345035339:3(1-22)Online publication date: 25-May-2021
https://dl.acm.org/doi/10.1145/3450353
Zhong MXie HZhu QZhu FChin Ooi BMiao C(2021)Quantifying Assimilate-Contrast Effects in Online Rating SystemsProceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining10.1145/3447548.3467244(2369-2377)Online publication date: 14-Aug-2021
https://doi.org/10.1145/3447548.3467244
Xie HZhong MLi YLui J(2021)Understanding Persuasion Cascades in Online Product Rating Systems: Modeling, Analysis, and InferenceACM Transactions on Knowledge Discovery from Data10.1145/344088715:3(1-29)Online publication date: 21-Apr-2021
https://dl.acm.org/doi/10.1145/3440887
Jin BCheng KZhang LFu YYin MJiang Ld'Aquin MDietze SHauff CCurry ECudre Mauroux P(2020)Partial Relationship Aware Influence Diffusion via a Multi-channel Encoding Scheme for Social RecommendationProceedings of the 29th ACM International Conference on Information & Knowledge Management10.1145/3340531.3412016(585-594)Online publication date: 19-Oct-2020
https://dl.acm.org/doi/10.1145/3340531.3412016
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents