research-article

Learning a Hierarchical Intent Model for Next-Item Recommendation

Authors:

Hui XiongAuthors Info & Claims

ACM Transactions on Information Systems (TOIS), Volume 40, Issue 2

Article No.: 38, Pages 1 - 28

https://doi.org/10.1145/3473972

Published: 27 September 2021 Publication History

Abstract

A session-based recommender system (SBRS) captures users’ evolving behaviors and recommends the next item by profiling users in terms of items in a session. User intent and user preference are two factors affecting his (her) decisions. Specifically, the former narrows the selection scope to some item types, while the latter helps to compare items of the same type. Most SBRSs assume one arbitrary user intent dominates a session when making a recommendation. However, this oversimplifies the reality that a session may involve multiple types of items conforming to different intents. In current SBRSs, items conforming to different user intents have cross-interference in profiling users for whom only one user intent is considered. Explicitly identifying and differentiating items conforming to various user intents can address this issue and model rich contextual information of a session. To this end, we design a framework modeling user intent and preference explicitly, which empowers the two factors to play their distinctive roles. Accordingly, we propose a key-array memory network (KA-MemNN) with a hierarchical intent tree to model coarse-to-fine user intents. The two-layer weighting unit (TLWU) in KA-MemNN detects user intents and generates intent-specific user profiles. Furthermore, the hierarchical semantic component (HSC) integrates multiple sets of intent-specific user profiles along with different user intent distributions to model a multi-intent user profile. The experimental results on real-world datasets demonstrate the superiority of KA-MemNN over selected state-of-the-art methods.

References

[1]

Buru Chang, Yonggyu Park, Donghyeon Park, Seongsoon Kim, and Jaewoo Kang. 2018. Content-aware hierarchical point-of-interest embedding model for successive POI recommendation. In Proceedings of the International Joint Conference on Artificial Intelligence. AAAI Press, 3301–3307.

Digital Library

[2]

Liang Chen, Yang Liu, Xiangnan He, Lianli Gao, and Zibin Zheng. 2019. Matching user with item set: Collaborative bundle recommendation with deep attention network. In Proceedings of the International Joint Conference on Artificial Intelligence, 2095–2101.

Digital Library

[3]

Xu Chen, Hongteng Xu, Yongfeng Zhang, Jiaxi Tang, Yixin Cao, Zheng Qin, and Hongyuan Zha. 2018. Sequential recommendation with user memory networks. In Proceedings of the ACM International Conference on Web Search and Data Mining. ACM, 108–116.

Digital Library

[4]

Eunjoon Cho, Seth A. Myers, and Jure Leskovec. 2011. Friendship and mobility: User movement in location-based social networks. In Proceedings of the SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 1082–1090.

Digital Library

[5]

Travis Ebesu, Bin Shen, and Yi Fang. 2018. Collaborative memory network for recommendation systems. In Proceedings of the International SIGIR Conference on Research & Development in Information Retrieval. ACM, 515–524.

Digital Library

[6]

Lei Guo, Hongzhi Yin, Qinyong Wang, Tong Chen, Alexander Zhou, and Nguyen Quoc Viet Hung. 2019. Streaming session-based recommendation. In Proceedings of the International SIGIR Conference on Research & Development in Information Retrieval. ACM, 1569–1577.

Digital Library

[7]

Simon Haykin and Neural Network. 2004. A comprehensive foundation. Neural Networks 2, 2004 (2004), 41.

[8]

Ruining He, Chunbin Lin, Jianguo Wang, and Julian J. McAuley. 2016. Sherlock: Sparse hierarchical embeddings for visually-aware one-class collaborative filtering. In Proceedings of the International Joint Conference on Artificial Intelligence. IJCAI/AAAI Press, 3740–3746.

Digital Library

[9]

Ruining He and Julian McAuley. 2016. Fusing similarity models with Markov chains for sparse sequential recommendation. In Proceedings of the International Conference on Data Mining. IEEE Computer Society, 191–200.

[10]

Ruining He and Julian J. McAuley. 2016. Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering. In Proceedings of the International Conference on World Wide Web. ACM, 507–517.

Digital Library

[11]

Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2016. Session-based recommendations with recurrent neural networks. In Proceedings of the International Conference on Learning Representations. Retrieved from http://arxiv.org/abs/1511.06939.

[12]

Liang Hu, Longbing Cao, Shoujin Wang, Guandong Xu, Jian Cao, and Zhiping Gu. 2017. Diversifying personalized recommendation with user-session context. In Proceedings of the International Joint Conference on Artificial Intelligence. AAAI Press, 1858–1864.

Digital Library

[13]

Liang Hu and Soingkui Jian. 2018. Interpretable recommendation via attraction modeling: Learning multilevel attractiveness over multimodal movie contents. In Proceedings of the International Joint Conference on Artificial Intelligence. AAAI Press, 3400–3406.

Digital Library

[14]

Liang Hu, Songlei Jian, Longbing Cao, and Qingkui Chen. 2018. Interpretable recommendation via attraction modeling: Learning multilevel attractiveness over multimodal movie contents. In Proceedings of the International Joint Conference on Artificial Intelligence. 3400–3406.

Digital Library

[15]

Liang Hu, Songlei Jian, Longbing Cao, Q Chen, and Z. Gu. 2019. HERS: Modeling influential contexts with heterogeneous relations for sparse and cold-start recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence. AAAI Press, 3830–3837.

[16]

Jin Huang, Zhaochun Ren, Wayne Xin Zhao, Gaole He, Ji-Rong Wen, and Daxiang Dong. 2019. Taxonomy-aware multi-hop reasoning networks for sequential recommendation. In Proceedings of the ACM International Conference on Web Search and Data Mining. ACM, 573–581.

Digital Library

[17]

Jizhou Huang, Wei Zhang, Yaming Sun, Haifeng Wang, and Ting Liu. 2018. Improving entity recommendation with search log and multi-task learning. In Proceedings of the International Joint Conference on Artificial Intelligence. AAAI Press, 4107–4114.

Digital Library

[18]

Jin Huang, Wayne Xin Zhao, Hongjian Dou, Ji-Rong Wen, and Edward Y. Chang. 2018. Improving sequential recommendation with knowledge-enhanced memory networks. In Proceedings of the International SIGIR Conference on Research & Development in Information Retrieval. ACM, 505–514.

Digital Library

[19]

Wang-Cheng Kang and Julian J. McAuley. 2018. Self-Attentive sequential recommendation. In Proceedings of the International Conference on Data Mining. IEEE Computer Society, 197–206.

[20]

Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of the International Conference on Learning Representations. Retrieved from http://arxiv.org/abs/1412.6980.

[21]

Dejiang Kong and Fei Wu. 2018. HST-LSTM: A hierarchical spatial-temporal long-short term memory network for location prediction. In Proceedings of the International Joint Conference on Artificial Intelligence. AAAI Press, 2341–2347.

Digital Library

[22]

Juho Lee, Yoonho Lee, Jungtaek Kim, Adam R. Kosiorek, Seungjin Choi, and Yee Whye Teh. 2018. Set transformer: a framework for attention-based permutation-invariant neural networks. In Proceedings of the International Conference on Machine Learning (PMLR’19), Vol. 97. 3744–3753.

[23]

Xin Li, Dongcheng Han, Jing He, Lejian Liao, and Mingzhong Wang. 2019. Next and next new POI recommendation via latent behavior pattern inference. ACM Transactions on Information Systems 37, 4 (2019), 46:1–46:28.

Digital Library

[24]

Yuanzhi Li and Yang Yuan. 2017. Convergence analysis of two-layer neural networks with relu activation. In Proceedings of the Advances in Neural Information Processing Systems, 597–607. Retrieved from http://papers.nips.cc/paper/6662-convergence-analysis-of-two-layer-neural-networks-with-relu-activation.

Digital Library

[25]

Zhi Li, Hongke Zhao, Qi Liu, Zhenya Huang, Tao Mei, and Enhong Chen. 2018. Learning from history and present: Next-item recommendation via discriminatively exploiting user behaviors. In Proceedings of the SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 1734–1743.

Digital Library

[26]

Chen Lin, Xiaolin Shen, Si Chen, Muhua Zhu, and Yanghua Xiao. 2019. Non-Compensatory psychological models for recommender systems. In Proceedings of the AAAI Conference on Artificial Intelligence. AAAI Press, 4304–4311.

[27]

Chen Ma, Peng Kang, and Xue Liu. 2019. Hierarchical gating networks for sequential recommendation. In Proceedings of the SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 825–833.

Digital Library

[28]

Alexander Miller, Adam Fisch, Jesse Dodge, Amir-Hossein Karimi, Antoine Bordes, and Jason Weston. 2016. Key-value memory networks for directly reading documents. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. The Association for Computational Linguistics, 1400–1409.

[29]

Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009. BPR: Bayesian personalized ranking from implicit feedback. In Proceedings of the Conference on Uncertainty in Artificial Intelligence. AUAI Press, 452–461.

Digital Library

[30]

Steffen Rendle, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2010. Factorizing personalized Markov chains for next-basket recommendation. In Proceedings of the WWW Conference on the World Wide Web. ACM, 811–820.

Digital Library

[31]

Shuo Shang, Ruogu Ding, Kai Zheng, Christian S. Jensen, Panos Kalnis, and Xiaofang Zhou. 2014. Personalized trajectory matching in spatial networks. The VLDB Journal–The International Journal on Very Large Data Bases 23, 3 (2014), 449–468.

Digital Library

[32]

Sainbayar Sukhbaatar, Jason Weston, Rob Fergus, Arthur D. Szlam. 2015. End-to-end memory networks. In Proceedings of the 28th International Conference on Advances in Neural Information Processing Systems. 2440–2448. Retrieved from http://papers.nips.cc/paper/5846-end-to-end-memory-networks.

Digital Library

[33]

Zhu Sun, Guibing Guo, and Jie Zhang. 2017. Learning hierarchical category influence on both users and items for effective recommendation. In Proceedings of the Symposium on Applied Computing. ACM, 1679–1684.

Digital Library

[34]

Jianling Wang, Kaize Ding, Liangjie Hong, Huan Liu, and James Caverlee. 2020. Next-item recommendation with sequential hypergraphs. In Proceedings of the International Conference on Research and Development in Information Retrieval, SIGIR. ACM, 1101–1110.

Digital Library

[35]

Pengfei Wang, Jiafeng Guo, Yanyan Lan, Jun Xu, Shengxian Wan, and Xueqi Cheng. 2015. Learning hierarchical representation model for nextbasket recommendation. In Proceedings of the International SIGIR Conference on Research & Development in Information Retrieval. ACM, 403–412.

Digital Library

[36]

Shoujin Wang, Liang Hu, Yan Wang, Quan Z. Sheng, Mehmet A. Orgun, and Longbing Cao. 2019. Modeling multi-purpose sessions for next-item recommendations via mixture-channel purpose routing networks. In Proceedings of the International Joint Conference on Artificial Intelligence. 3771–3777.

Digital Library

[37]

Xiang Wang, Xiangnan He, Fuli Feng, Liqiang Nie, and Tat-Seng Chua. 2018. TEM: Tree-enhanced embedding model for explainable recommendation. In Proceedings of the WWW Conference on World Wide Web. ACM, 1543–1552.

Digital Library

[38]

Chao-Yuan Wu, Amr Ahmed, Alex Beutel, Alexander J. Smola, and How Jing. 2017. Recurrent recommender networks. In Proceedings of the International Conference on Web Search and Data Mining. ACM, 495–503.

Digital Library

[39]

Chengfeng Xu, Pengpeng Zhao, Yanchi Liu, Jiajie Xu, Victor S. Sheng S. Sheng, Zhiming Cui, Xiaofang Zhou, and Hui Xiong. 2019. Recurrent convolutional neural network for sequential recommendation. In Proceedings of the WWW Conference on World Wide Web. ACM, 3398–3404.

Digital Library

[40]

Ghim-Eng Yap, Xiao-Li Li, and S. Yu Philip. 2012. Effective next-items recommendation via personalized sequential pattern mining. In Proceedings of the International Conference on Database Systems for Advanced Applications. Springer, 48–64.

Digital Library

[41]

Haochao Ying, Jian Wu, Guandong Xu, Yanchi Liu, Tingting Liang, Xiao Zhang, and Hui Xiong. 2019. Time-aware metric embedding with asymmetric projection for successive POI recommendation. World Wide Web 22, 5 (2019), 2209–2224.

Digital Library

[42]

Haochao Ying, Fuzhen Zhuang, Fuzheng Zhang, Yanchi Liu, Guandong Xu, Xing Xie, Hui Xiong, and Jian Wu. 2018. Sequential recommender system based on hierarchical attention networks. In Proceedings of the International Joint Conference on Artificial Intelligence. AAAI Press, 3926–3932.

Digital Library

[43]

Tom Young, Devamanyu Hazarika, Soujanya Poria, and Erik Cambria. 2018. Recent trends in deep learning based natural language processing. IEEE Computational Intelligence Magazine 13, 3 (2018), 55–75.

[44]

Zijie Zeng, Jing Lin, Lin Li, Weike Pan, and Zhong Ming. 2020. Next-Item recommendation via collaborative filtering with bidirectional item similarity. ACM Transactions on Information Systems 38, 1 (2020), 7:1–7:22.

Digital Library

[45]

Shuai Zhang, Yi Tay, Lina Yao, Aixin Sun, and Jake An. 2019. Next item recommendation with self-attentive metric learning. In Proceedings of the AAAI Conference on Artificial Intelligence. AAAI Press.

[46]

Yuchen Zhang, Amr Ahmed, Vanja Josifovski, and Alexander J. Smola. 2014. Taxonomy discovery for personalized recommendation. In Proceedings of the ACM International Conference on Web Search and Data Mining. ACM, NY, 243–252.

Digital Library

[47]

Hongke Zhao, Qi Liu, Hengshu Zhu, Yong Ge, Enhong Chen, Yan Zhu, and Junping Du. 2018. A sequential approach to market state modeling and analysis in online p2p lending. IEEE Transactions on Systems, Man and Cybernetics: Systems 48, 1 (2018), 21–33.

[48]

Nengjun Zhu and Jian Cao. 2019. CPL: A combined framework of pointwise prediction and learning to rank for top-N recommendations with implicit feedback. In Proceedings of the International Conference on Web Information Systems Engineering. Springer, 259–273.

Digital Library

[49]

Nengjun Zhu, Jian Cao, Yanchi Liu, Yang Yang, Haochao Ying, and Hui Xiong. 2020. Sequential modeling of hierarchical user intention and preference for next-item recommendation. In Proceedings of the International Conference on Web Search and Data Mining. ACM, 807–815.

Digital Library

[50]

Qianna Zhu, Zeliang Song Xiaofei Zhou, and Li Guo Jianlong Tan. 2019. DAN: Deep attention neural network for news recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence. AAAI Press, 5973–5980.

[51]

Yu Zhu, Hao Li, Yikang Liao, Beidou Wang, Ziyu Guan, Haifeng Liu, and Deng Cai. 2017. What to do next: Modeling user behaviors by Time-LSTM. In Proceedings of the International Joint Conference on Artificial Intelligence. 3602–3608.

Digital Library

Cited By

Xu YLi TYang YChen WYue L(2024)An adaptive category-aware recommender based on dual knowledge graphsInformation Processing & Management10.1016/j.ipm.2023.10363661:3(103636)Online publication date: May-2024
https://doi.org/10.1016/j.ipm.2023.103636
Lian YZhang LSong C(2024)Target-driven user preference transferring recommendationExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.121773238:PBOnline publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1016/j.eswa.2023.121773
Yin YWang JArnob Barua HBao X(2024)TIENExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.121403236:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.eswa.2023.121403
Show More Cited By

Index Terms

Learning a Hierarchical Intent Model for Next-Item Recommendation
1. Information systems
  1. Information retrieval
    1. Retrieval tasks and goals
      1. Recommender systems

Recommendations

Attentive Sequential Models of Latent Intent for Next Item Recommendation
WWW '20: Proceedings of The Web Conference 2020

Users exhibit different intents across e-commerce services (e.g. discovering items, purchasing gifts, etc.) which drives them to interact with a wide variety of items in multiple ways (e.g. click, add-to-cart, add-to-favorites, purchase). To give better ...
Sequential Modeling of Hierarchical User Intention and Preference for Next-item Recommendation
WSDM '20: Proceedings of the 13th International Conference on Web Search and Data Mining

The next-item recommendation has attracted great research interests with both static and dynamic users' preferences considered. Existing approaches typically utilize user-item binary relations, and assume a flat preference distribution over items for ...
Improving Cold Start Recommendation by Mapping Feature-Based Preferences to Item Comparisons
UMAP '17: Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization

Many Recommender Systems (RSs) rely on user preference data in the form of ratings or likes for items. Previous research has shown that item comparisons can also be effectively used to model user preferences and build RS. However, users often express ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Information Systems

ACM Transactions on Information Systems Volume 40, Issue 2

April 2022

587 pages

ISSN:1046-8188

EISSN:1558-2868

DOI:10.1145/3484931

Issue’s Table of Contents

Copyright © 2021 Association for Computing Machinery.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 September 2021

Accepted: 01 July 2021

Revised: 01 May 2021

Received: 01 August 2020

Published in TOIS Volume 40, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Refereed

Funding Sources

National Key Research and Development Plan
NSFC

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
555
Total Downloads

Downloads (Last 12 months)108
Downloads (Last 6 weeks)12

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Xu YLi TYang YChen WYue L(2024)An adaptive category-aware recommender based on dual knowledge graphsInformation Processing & Management10.1016/j.ipm.2023.10363661:3(103636)Online publication date: May-2024
https://doi.org/10.1016/j.ipm.2023.103636
Lian YZhang LSong C(2024)Target-driven user preference transferring recommendationExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.121773238:PBOnline publication date: 27-Feb-2024
https://dl.acm.org/doi/10.1016/j.eswa.2023.121773
Yin YWang JArnob Barua HBao X(2024)TIENExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.121403236:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.eswa.2023.121403
Zhu NHuang JCao JHu LZhu S(2024)Toward medical test recommendation from optimal attribute selection perspectives: a backward reasoning approachComplex & Intelligent Systems10.1007/s40747-024-01629-311:1Online publication date: 11-Nov-2024
https://doi.org/10.1007/s40747-024-01629-3
Wang WLin XWang LFeng FMa YChua T(2023)Causal Disentangled Recommendation against User Preference ShiftsACM Transactions on Information Systems10.1145/359302242:1(1-27)Online publication date: 18-Aug-2023
https://dl.acm.org/doi/10.1145/3593022
Gu XSun YNi FChen SWang XSong RLi BCao XEl Saddik AMei TCucchiara RBertini MTobon Vallejo DAtrey PHossain M(2023)TeViS: Translating Text Synopses to Video StoryboardsProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3612417(4968-4979)Online publication date: 26-Oct-2023
https://dl.acm.org/doi/10.1145/3581783.3612417
Zhu NHuang JCao JLu XLiu HXiong H(2023)MtiRec: A Medical Test Recommender System based on the Analysis of Treatment Programs2023 IEEE International Conference on Data Mining (ICDM)10.1109/ICDM58522.2023.00099(898-907)Online publication date: 1-Dec-2023
https://doi.org/10.1109/ICDM58522.2023.00099
Zhu NHuang JCao JFeng S(2023)Learning User Embeddings Based on Long Short-Term User Group Modeling for Next-Item RecommendationComputer Supported Cooperative Work and Social Computing10.1007/978-981-99-2385-4_2(18-32)Online publication date: 13-May-2023
https://doi.org/10.1007/978-981-99-2385-4_2

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents