Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3159652.3159668acmconferencesArticle/Chapter ViewAbstractPublication PageswsdmConference Proceedingsconference-collections
research-article
Public Access

Sequential Recommendation with User Memory Networks

Published: 02 February 2018 Publication History

Abstract

User preferences are usually dynamic in real-world recommender systems, and a user»s historical behavior records may not be equally important when predicting his/her future interests. Existing recommendation algorithms -- including both shallow and deep approaches -- usually embed a user»s historical records into a single latent vector/representation, which may have lost the per item- or feature-level correlations between a user»s historical records and future interests. In this paper, we aim to express, store, and manipulate users» historical records in a more explicit, dynamic, and effective manner. To do so, we introduce the memory mechanism to recommender systems. Specifically, we design a memory-augmented neural network (MANN) integrated with the insights of collaborative filtering for recommendation. By leveraging the external memory matrix in MANN, we store and update users» historical records explicitly, which enhances the expressiveness of the model. We further adapt our framework to both item- and feature-level versions, and design the corresponding memory reading/writing operations according to the nature of personalized recommendation scenarios. Compared with state-of-the-art methods that consider users» sequential behavior for recommendation, e.g., sequential recommenders with recurrent neural networks (RNN) or Markov chains, our method achieves significantly and consistently better performance on four real-world datasets. Moreover, experimental analyses show that our method is able to extract the intuitive patterns of how users» future actions are affected by previous behaviors.

References

[1]
S. Chen, J. L. Moore, D. Turnbull, and T. Joachims. Playlist prediction via metric embedding. In KDD, 2012.
[2]
X. Chen, Z. Qin, Y. Zhang, and T. Xu. Learning to rank features for recommendation over multiple categories. In SIGIR, 2016.
[3]
C. Cheng, H. Yang, M. R. Lyu, and I. King. Where you like to go next: Successive point-of-interest recommendation. In IJCAI, 2013.
[4]
S. Feng, X. Li, Y. Zeng, G. Cong, Y. M. Chee, and Q. Yuan. Personalized ranking metric embedding for next new poi recommendation. In IJCAI, 2015.
[5]
A. Graves, G. Wayne, and I. Danihelka. Neural turing machines. arXiv preprint arXiv:1410.5401, 2014.
[6]
A. Graves, G. Wayne, M. Reynolds, T. Harley, I. Danihelka, A. Grabska-Barwi'nska, S. G. Colmenarejo, E. Grefenstette, T. Ramalho, J. Agapiou, et al. Hybrid computing using a neural network with dynamic external memory. 2016.
[7]
E. Grefenstette, K. M. Hermann, M. Suleyman, and P. Blunsom. Learning to transduce with unbounded memory. In NIPS, 2015.
[8]
N. Hariri, B. Mobasher, and R. Burke. Context-aware music recommendation based on latent topic sequential patterns. In RecSys, 2012.
[9]
R. He, W.-C. Kang, and J. McAuley. Translation-based recommendation. Recsys, 2017.
[10]
R. He and J. McAuley. Fusing similarity models with markov chains for sparse sequential recommendation. In ICDM, 2016.
[11]
R. He and J. McAuley. Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering. In WWW, 2016.
[12]
X. He, T. Chen, M.-Y. Kan, and X. Chen. Trirank: Review-aware explainable recommendation by modeling aspects. In CIKM, 2015.
[13]
X. He, L. Liao, H. Zhang, L. Nie, X. Hu, and T.-S. Chua. Neural collaborative filtering. In WWW, 2017.
[14]
B. Hidasi, A. Karatzoglou, L. Baltrunas, and D. Tikk. Session-based recommendations with recurrent neural networks. ICLR, 2016.
[15]
K. J"arvelin and J. Kek"al"ainen. Ir evaluation methods for retrieving highly relevant documents. In SIGIR, 2000.
[16]
G. Karypis. Evaluation of item-based top-n recommendation algorithms. In CIKM, 2001.
[17]
Y. Koren, R. Bell, and C. Volinsky. Matrix factorization techniques for recommender systems. Computer, 2009.
[18]
A. Kumar, O. Irsoy, P. Ondruska, M. Iyyer, J. Bradbury, I. Gulrajani, V. Zhong, R. Paulus, and R. Socher. Ask me anything: Dynamic memory networks for natural language processing. In ICML, 2016.
[19]
Q. Liu, S. Wu, D. Wang, Z. Li, and L. Wang. Context-aware sequential recommendation. In ICDM, 2016.
[20]
J. McAuley, C. Targett, Q. Shi, and A. Van Den Hengel. Image-based recommendations on styles and substitutes. In SIGIR, 2015.
[21]
A. Miller, A. Fisch, J. Dodge, A.-H. Karimi, A. Bordes, and J. Weston. Key-value memory networks for directly reading documents. EMNLP, 2016.
[22]
S. Rendle, C. Freudenthaler, Z. Gantner, and L. Schmidt-Thieme. Bpr: Bayesian personalized ranking from implicit feedback. In UAI, 2009.
[23]
S. Rendle, C. Freudenthaler, and L. Schmidt-Thieme. Factorizing personalized markov chains for next-basket recommendation. In WWW, 2010.
[24]
A. Santoro, S. Bartunov, M. Botvinick, D. Wierstra, and T. Lillicrap. Meta-learning with memory-augmented neural networks. In ICML, 2016.
[25]
S. Sukhbaatar, J. Weston, R. Fergus, et al. End-to-end memory networks. In NIPS, 2015.
[26]
Y. K. Tan, X. Xu, and Y. Liu. Improved recurrent neural networks for session-based recommendations. In Proceedings of the 1st Workshop on DLRS, 2016.
[27]
P. Wang, J. Guo, Y. Lan, J. Xu, S. Wan, and X. Cheng. Learning hierarchical representation model for nextbasket recommendation. In SIGIR, 2015.
[28]
J. Weston, S. Chopra, and A. Bordes. Memory networks. ICLR, 2015.
[29]
X. Wu, Q. Liu, E. Chen, L. He, J. Lv, C. Cao, and G. Hu. Personalized next-song recommendation in online karaokes. In Recsys, 2013.
[30]
L. Xiang, Q. Yuan, S. Zhao, L. Chen, X. Zhang, Q. Yang, and J. Sun. Temporal recommendation on graphs via long-and short-term preference fusion. In KDD, 2010.
[31]
F. Yu, Q. Liu, S. Wu, L. Wang, and T. Tan. A dynamic recurrent model for next basket recommendation. In SIGIR, 2016.
[32]
J. Zhang, X. Shi, I. King, and D.-Y. Yeung. Dynamic key-value memory networks for knowledge tracing. In WWW, 2017.
[33]
Y. Zhang. Incorporating phrase-level sentiment analysis on textual reviews for personalized recommendation. In WSDM, 2015.
[34]
Y. Zhang, G. Lai, M. Zhang, Y. Zhang, Y. Liu, and S. Ma. Explicit factor models for explainable recommendation based on phrase-level sentiment analysis. In SIGIR, 2014.
[35]
Y. Zhang, M. Zhang, Y. Liu, C. Tat-Seng, Y. Zhang, and S. Ma. Task-based recommendation on a web-scale. In BigData, 2015.

Cited By

View all
  • (2025)Graphical contrastive learning for multi-interest sequential recommendationExpert Systems with Applications10.1016/j.eswa.2024.125285259(125285)Online publication date: Jan-2025
  • (2024)End-to-End Modeling and Long Short-Term Memory Application in Time Series ModelingJournal of Organizational and End User Computing10.4018/JOEUC.34973236:1(1-27)Online publication date: 30-Jul-2024
  • (2024)GAT4Rec: Sequential Recommendation with a Gated Recurrent Unit and TransformersMathematics10.3390/math1214218912:14(2189)Online publication date: 12-Jul-2024
  • Show More Cited By

Recommendations

Reviews

Xiannong Meng

Chen et al. demonstrate a new algorithm that makes recommendation systems more efficient and effective, especially for systems that keep track of user behaviors such as those found on shopping websites. The proposed algorithm makes good use of the history records left by users. Unlike currently known systems, the proposed system selects only the relevant items for the recommendation rather than using the user's entire shopping history, which makes the system more effective and efficient. The newly proposed memory-augmented neural network (MANN) system makes use of two types of known successful models: the sequential recommendation model and memory-augmented neural networks. The sequential recommendation model "embeds the transition information between adjacent behaviors into the item latent factors for recommendation." The model is effective in working with "local sequential patterns between every two adjacent records." Memory-augmented neural networks can store historical hidden states. MANN takes advantage of both models, allowing the model to capture the essence of user behaviors on selected items. It thus can better predict user behavior based on past records. The authors test their model in a large real-world dataset from Amazon, which includes about 7000 customers who purchased about 67000 items in four categories. Results show improved performance over other state-of-the-art models. The model proposed by the authors is novel. It can be used in applications where the historical behaviors of users are stored.

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WSDM '18: Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining
February 2018
821 pages
ISBN:9781450355810
DOI:10.1145/3159652
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 February 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. collaborative filtering
  2. memory networks
  3. sequential recommendation

Qualifiers

  • Research-article

Funding Sources

Conference

WSDM 2018

Acceptance Rates

WSDM '18 Paper Acceptance Rate 81 of 514 submissions, 16%;
Overall Acceptance Rate 498 of 2,863 submissions, 17%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)863
  • Downloads (Last 6 weeks)107
Reflects downloads up to 03 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2025)Graphical contrastive learning for multi-interest sequential recommendationExpert Systems with Applications10.1016/j.eswa.2024.125285259(125285)Online publication date: Jan-2025
  • (2024)End-to-End Modeling and Long Short-Term Memory Application in Time Series ModelingJournal of Organizational and End User Computing10.4018/JOEUC.34973236:1(1-27)Online publication date: 30-Jul-2024
  • (2024)GAT4Rec: Sequential Recommendation with a Gated Recurrent Unit and TransformersMathematics10.3390/math1214218912:14(2189)Online publication date: 12-Jul-2024
  • (2024)Aggregating knowledge and collaborative information for sequential recommendationIntelligent Data Analysis10.3233/IDA-22719828:1(279-298)Online publication date: 3-Feb-2024
  • (2024)Time-Aware LSTM Neural Networks for Dynamic Personalized Recommendation on Business IntelligenceTsinghua Science and Technology10.26599/TST.2023.901002529:1(185-196)Online publication date: Feb-2024
  • (2024)Enhancing User-Item Interaction Through Counterfactual Classifier For Sequential RecommendationApplied Mathematics and Nonlinear Sciences10.2478/amns-2024-24819:1Online publication date: 3-Sep-2024
  • (2024)Diversifying Sequential Recommendation with Retrospective and Prospective TransformersACM Transactions on Information Systems10.1145/365301642:5(1-37)Online publication date: 29-Apr-2024
  • (2024)A Survey on Trustworthy Recommender SystemsACM Transactions on Recommender Systems10.1145/3652891Online publication date: 13-Apr-2024
  • (2024)Distributional Fairness-aware RecommendationACM Transactions on Information Systems10.1145/365285442:5(1-28)Online publication date: 29-Apr-2024
  • (2024)Towards Differential Privacy in Sequential Recommendation: A Noisy Graph Neural Network ApproachACM Transactions on Knowledge Discovery from Data10.1145/364382118:5(1-21)Online publication date: 30-Jan-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media