Abstract
Reviews are widely used in recommendation systems to handle the sparsity problem of rating matrix. However, learning the representations of users and items only from reviews would be challenging since there are less meaningful words and reviews while modeling users or items. In fact, in addition to reviews there are rich off-the-shelf summaries written by users along with reviews, but existing recommendation methods ignore this useful information. The summary of a review is to describe the review with shorter sentences, and can be seen as a high-level abstraction of the review. Thus the summary can play a guidance role to indicate the important parts in a review and the informativeness of the review. Hence, we propose a neural recommendation method to learn summary-aware representations of users and items from reviews. We firstly apply a summary encoder to learn representations of text summary, which will be used as the guidance indicator. We design a summary-aware review encoder to learn representations of reviews from raw words, and another summary-aware user/item encoder to learn representations of users or items from reviews. To be specific, we propose a hierarchical attention model with summary representations as attention vectors under word- and review-level to select important words and reviews for users/items respectively. We conduct extensive experiments on real-world benchmark datasets and the results demonstrate that our approach can effectively improve the performance of neural recommendation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Chen, C., Zhang, M., Liu, Y., Ma, S.: Neural attentional rating regression with review-level explanations. In: WWW, pp. 1583–1592 (2018)
Diao, Q., Qiu, M., Wu, C.Y., Smola, A.J., Jiang, J., Wang, C.: Jointly modeling aspects, ratings and sentiments for movie recommendation (JMARS). In: KDD, pp. 193–202 (2014)
Hyun, D., Park, C., Yang, M.C., Song, I., Lee, J.T., Yu, H.: Review sentiment-guided scalable deep recommender system. In: SIGIRE, pp. 965–968 (2018)
Kim, D., Park, C., Oh, J., Lee, S., Yu, H.: Convolutional matrix factorization for document context-aware recommendation. In: RecSys, pp. 233–240. ACM (2016)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: International Conference on Learning Representations (2015)
Koren, Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: SIGKDD, pp. 426–434 (2008)
Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 8, 30–37 (2009)
Lee, D.D., Seung, H.S.: Algorithms for non-negative matrix factorization. In: NIPS, pp. 556–562. MIT Press, Cambridge (2000)
Linden, G., Smith, B., York, J.: Amazon. com recommendations: item-to-item collaborative filtering. IEEE Internet Comput. 1, 76–80 (2003)
Lu, Y., Dong, R., Smyth, B.: Coevolutionary recommendation model: Mutual learning between ratings and reviews. In: WWW, pp. 773–782 (2018)
Ma, S., Sun, X., Lin, J., Ren, X.: A hierarchical end-to-end model for jointly improving text summarization and sentiment classification. CoRR (2018)
McAuley, J., Leskovec, J.: Hidden factors and hidden topics: understanding rating dimensions with review text. In: RecSys, pp. 165–172. ACM (2013)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)
Mnih, A., Salakhutdinov, R.R.: Probabilistic matrix factorization. In: NIPS, pp. 1257–1264 (2008)
Rendle, S.: Factorization machines. In: ICDM, pp. 995–1000 (2010)
Salakhutdinov, R., Mnih, A.: Probabilistic matrix factorization. In: NIPS, pp. 1257–1264 (2008)
Schafer, J.B., Frankowski, D., Herlocker, J., Sen, S.: Collaborative filtering recommender systems. In: The adaptive web, pp. 291–324 (2007)
Seo, S., Huang, J., Yang, H., Liu, Y.: Interpretable convolutional neural networks with dual local and global attention for review rating prediction. In: Proceedings of the Eleventh ACM Conference on Recommender Systems, pp. 297–305 (2017)
Seo, S., Huang, J., Yang, H., Liu, Y.: Representation learning of users and items for review rating prediction using attention-based convolutional neural network (2017)
Wang, C., Blei, D.M.: Collaborative topic modeling for recommending scientific articles, pp. 448–456 (2011)
Zheng, L., Noroozi, V., Yu, P.S.: Joint deep modeling of users and items using reviews for recommendation. In: WSDM, pp. 425–434 (2017)
Acknowledgments
This research was supported by grants from the National Key R&D Program of China (2018YFC0832101, 2018YFC0809800).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Peng, Q., Wang, P., Wang, W., Liu, H., Sun, Y., Jiao, P. (2019). NRSA: Neural Recommendation with Summary-Aware Attention. In: Douligeris, C., Karagiannis, D., Apostolou, D. (eds) Knowledge Science, Engineering and Management. KSEM 2019. Lecture Notes in Computer Science(), vol 11775. Springer, Cham. https://doi.org/10.1007/978-3-030-29551-6_12
Download citation
DOI: https://doi.org/10.1007/978-3-030-29551-6_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-29550-9
Online ISBN: 978-3-030-29551-6
eBook Packages: Computer ScienceComputer Science (R0)