Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3308558.3313523acmotherconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

Product-Aware Helpfulness Prediction of Online Reviews

Published: 13 May 2019 Publication History

Abstract

Helpful reviews are essential for e-commerce and review websites, as they can help customers make quick purchase decisions and merchants to increase profits. Due to a great number of online reviews with unknown helpfulness, it recently leads to promising research on building automatic mechanisms to assess review helpfulness. The mainstream methods generally extract various linguistic and embedding features solely from the text of a review as the evidence for helpfulness prediction. We, however, consider that the helpfulness of a review should be fully aware of the metadata (such as the title, the brand, the category, and the description) of its target product, besides the textual content of the review itself. Hence, in this paper we propose an end-to-end deep neural architecture directly fed by both the metadata of a product and the raw text of its reviews to acquire product-aware review representations for helpfulness prediction. The learned representations do not require tedious labor on feature engineering and are expected to be more informative as the target-aware evidence to assess the helpfulness of online reviews. We also construct two large-scale datasets which are a portion of the real-world web data in Amazon and Yelp, respectively, to train and test our approach. Experiments are conducted on two different tasks: helpfulness identification and regression of online reviews, and results demonstrate that our approach can achieve state-of-the-art performance with substantial improvements.

References

[1]
Chih-Chung Chang and Chih-Jen Lin. 2011. LIBSVM: a library for support vector machines. ACM transactions on intelligent systems and technology 2, 3 (2011), 27.
[2]
Cen Chen, Minghui Qiu, Yinfei Yang, Jun Zhou, Jun Huang, Xiaolong Li, and Forrest Bao. 2018. Review Helpfulness Prediction with Embedding-Gated CNN.
[3]
Cen Chen, Yinfei Yang, Jun Zhou, Xiaolong Li, and Forrest Sheng Bao. 2018. Cross-Domain Review Helpfulness Prediction Based on Convolutional Neural Networks with Auxiliary Domain Discriminators. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL), Volume 2 (Short Papers). Association for Computational Linguistics, 602-607.
[4]
Miao Fan, Yue Feng, Mingming Sun, Ping Li, Haifeng Wang, and Jianmin Wang. 2018. Multi-Task Neural Learning Architecture for End-to-End Identification of Helpful Reviews. In Proceedings of the 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM). 343-350.
[5]
Rong-En Fan, Kai-Wei Chang, Cho-Jui Hsieh, Xiang-Rui Wang, and Chih-Jen Lin. 2008. LIBLINEAR: A Library for Large Linear Classification. Journal of Machine Learning Research (JMLR) 9 (2008), 1871-1874.
[6]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR). 770-778.
[7]
Ruining He and Julian McAuley. 2016. Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering. In Proceedings of the 25th International Conference on World Wide Web (WWW). International World Wide Web Conferences Steering Committee, 507-517.
[8]
Soo-Min Kim, Patrick Pantel, Tim Chklovski, and Marco Pennacchiotti. 2006. Automatically Assessing Review Helpfulness. In Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, 423-430.
[9]
Yoon Kim. 2014. Convolutional Neural Networks for Sentence Classification. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, 1746-1751.
[10]
Yann LeCun and Yoshua Bengio. 1998. The Handbook of Brain Theory and Neural Networks. (1998), 255-258.
[11]
Yann LeCun, Yoshua Bengio, and Geoffrey Hinton. 2015. Deep learning. Nature 521, 7553 (2015), 436-444.
[12]
Andy Liaw, Matthew Wiener, 2002. Classification and regression by randomForest. R news 2, 3 (2002), 18-22.
[13]
Haijing Liu, Yang Gao, Pin Lv, Mengxue Li, Shiqiang Geng, Minglan Li, and Hao Wang. 2017. Using Argument-based Features to Predict and Analyse Review Helpfulness. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, 1369-1374.
[14]
Lionel Martin and Pearl Pu. 2014. Prediction of Helpful Reviews Using Emotions Extraction. In Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence (AAAI). AAAI Press, 1551-1557.
[15]
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems (NIPS). 3111-3119.
[16]
Susan M. Mudambi and David Schuff. 2010. What Makes a Helpful Online Review? A Study of Customer Reviews on Amazon.Com. MIS Quarterly 34, 1 (March 2010), 185-200.
[17]
Gerardo Ocampo Diaz and Vincent Ng. 2018. Modeling and Prediction of Online Product Review Helpfulness: A Survey. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (ACL). Association for Computational Linguistics, 698-708.
[18]
Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1532-1543.
[19]
Matthew Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. 2018. Deep Contextualized Word Representations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL). Association for Computational Linguistics, 2227-2237.
[20]
Klaus R Scherer. 2005. What are emotions? And how can they be measured?Social science information 44, 4 (2005), 695-729.
[21]
Mike Schuster and Kuldip K Paliwal. 1997. Bidirectional recurrent neural networks. IEEE Transactions on Signal Processing (TSP) 45, 11 (1997), 2673-2681.
[22]
Philip J Stone, Robert F Bales, J Zvi Namenwirth, and Daniel M Ogilvie. 1962. The general inquirer: A computer system for content analysis and retrieval based on the sentence as a unit of information. Behavioral Science 7, 4 (1962), 484-498.
[23]
Vladimir Svetnik, Andy Liaw, Christopher Tong, J Christopher Culberson, Robert P Sheridan, and Bradley P Feuston. 2003. Random forest: a classification and regression tool for compound classification and QSAR modeling. Journal of chemical information and computer sciences 43, 6 (2003), 1947-1958.
[24]
Wenting Xiong and Diane Litman. 2011. Automatically Predicting Peer-Review Helpfulness. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL). Association for Computational Linguistics, 502-507.
[25]
Wenting Xiong and Diane J Litman. 2014. Empirical analysis of exploiting review helpfulness for extractive summarization of online reviews. In Proceedings of the 25th International Conference on Computational Linguistics (COLING). Association for Computational Linguistics, 1985-1995.
[26]
Yinfei Yang, Yaowei Yan, Minghui Qiu, and Forrest Bao. 2015. Semantic Analysis and Helpfulness Prediction of Text for Online Product Reviews. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics (ACL). Association for Computational Linguistics, 38-44.

Cited By

View all
  • (2024)Effectiveness of ELMo embeddings, and semantic models in predicting review helpfulnessIntelligent Data Analysis10.3233/IDA-23034928:4(1045-1065)Online publication date: 17-Jul-2024
  • (2024)Navigating the New Normal: Redefining N95 Respirator Design with an Integrated Text Mining and Quality Function Deployment-Based Optimization ModelComputers & Industrial Engineering10.1016/j.cie.2024.109962(109962)Online publication date: Feb-2024
  • (2024)Apple doesn’t fall far from the tree: Effect of extrinsic factors of online reviews on predicting useless reviewsElectronic Commerce Research10.1007/s10660-024-09919-1Online publication date: 7-Nov-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
WWW '19: The World Wide Web Conference
May 2019
3620 pages
ISBN:9781450366748
DOI:10.1145/3308558
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • IW3C2: International World Wide Web Conference Committee

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. E-commerce
  2. benchmark datasets
  3. helpfulness prediction
  4. neural networks
  5. online reviews

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

WWW '19
WWW '19: The Web Conference
May 13 - 17, 2019
CA, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)153
  • Downloads (Last 6 weeks)16
Reflects downloads up to 25 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Effectiveness of ELMo embeddings, and semantic models in predicting review helpfulnessIntelligent Data Analysis10.3233/IDA-23034928:4(1045-1065)Online publication date: 17-Jul-2024
  • (2024)Navigating the New Normal: Redefining N95 Respirator Design with an Integrated Text Mining and Quality Function Deployment-Based Optimization ModelComputers & Industrial Engineering10.1016/j.cie.2024.109962(109962)Online publication date: Feb-2024
  • (2024)Apple doesn’t fall far from the tree: Effect of extrinsic factors of online reviews on predicting useless reviewsElectronic Commerce Research10.1007/s10660-024-09919-1Online publication date: 7-Nov-2024
  • (2024)HORIE: Helpfulness of Online Reviews with Improved EmbeddingPattern Recognition and Machine Intelligence10.1007/978-3-031-12700-7_62(607-616)Online publication date: 24-Jul-2024
  • (2023)A Novel Review Helpfulness Measure Based on the User-Review-Item ParadigmACM Transactions on the Web10.1145/358528017:4(1-31)Online publication date: 11-Jul-2023
  • (2023)Assessing the Quality of Student-Generated Content at Scale: A Comparative Analysis of Peer-Review ModelsIEEE Transactions on Learning Technologies10.1109/TLT.2022.322902216:1(106-120)Online publication date: 1-Feb-2023
  • (2023)Mobile Game Recommendation Based on Clustering Reliable Reviews2023 IEEE 6th International Conference on Electronic Information and Communication Technology (ICEICT)10.1109/ICEICT57916.2023.10244945(72-77)Online publication date: 21-Jul-2023
  • (2023)Review helpfulness prediction on e-commerce websites: A comprehensive surveyEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.107075126(107075)Online publication date: Nov-2023
  • (2023)Utilizing a feature-aware external memory network for helpfulness prediction in e-commerce reviewsApplied Soft Computing10.1016/j.asoc.2023.110923148(110923)Online publication date: Nov-2023
  • (2022)Toward Personalized Answer Generation in E-Commerce via Multi-perspective Preference ModelingACM Transactions on Information Systems10.1145/350778240:4(1-28)Online publication date: 9-Mar-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media