research-article

Public Access

RETE: Retrieval-Enhanced Temporal Event Forecasting on Unified Query Product Evolutionary Graph

Authors:

Tarek AbdelzaherAuthors Info & Claims

WWW '22: Proceedings of the ACM Web Conference 2022

Pages 462 - 472

https://doi.org/10.1145/3485447.3511974

Published: 25 April 2022 Publication History

All formats PDF

Abstract

With the increasing demands on e-commerce platforms, numerous user action history is emerging. Those enriched action records are vital to understand users’ interests and intents. Recently, prior works for user behavior prediction mainly focus on the interactions with product-side information. However, the interactions with search queries, which usually act as a bridge between users and products, are still under investigated. In this paper, we explore a new problem named temporal event forecasting, a generalized user behavior prediction task in a unified query product evolutionary graph, to embrace both query and product recommendation in a temporal manner. To fulfill this setting, there involves two challenges: (1) the action data for most users is scarce; (2) user preferences are dynamically evolving and shifting over time. To tackle those issues, we propose a novel Retrieval-Enhanced Temporal Event (RETE) forecasting framework. Unlike existing methods that enhance user representations via roughly absorbing information from connected entities in the whole graph, RETE efficiently and dynamically retrieves relevant entities centrally on each user as high-quality subgraphs, preventing the noise propagation from the densely evolutionary graph structures that incorporate abundant search queries. And meanwhile, RETE autoregressively accumulates retrieval-enhanced user representations from each time step, to capture evolutionary patterns for joint query and product prediction. Empirically, extensive experiments on both the public benchmark and four real-world industrial datasets demonstrate the effectiveness of the proposed RETE method.

References

[1]

Ibrahim Adepoju Adeyanju, Dawei Song, M-Dyaa Albakour, Udo Kruschwitz, Anne De Roeck, and Maria Fasli. 2012. Adaptation of the Concept Hierarchy Model with Search Logs for Query Recommendation on Intranets. In SIGIR ’12.

[2]

Bijaya Adhikari, Parikshit Sondhi, Wenke Zhang, Mohit Sharma, and B. Aditya Prakash. 2018. Mining E-Commerce Query Relations Using Customer Interaction Networks. In WWW ’18.

[3]

Wasi Uddin Ahmad, Kai-Wei Chang, and Hongning Wang. 2019. Context Attentive Document Ranking and Query Suggestion. In SIGIR’19.

[4]

Qingyao Ai, Vahid Azizi, Xu Chen, and Yongfeng Zhang. 2018. Learning Heterogeneous Knowledge Base Embeddings for Explainable Recommendation. CoRR abs/1805.03352(2018).

[5]

Reid Andersen, Fan Chung, and Kevin Lang. 2006. Local Graph Partitioning Using PageRank Vectors. In Proceedings of the 47th Annual IEEE Symposium on Foundations of Computer Science(FOCS ’06). 475–486.

Digital Library

[6]

Ioannis Antonellis, Hector Garcia Molina, and Chi Chao Chang. 2008. Simrank++: Query Rewriting through Link Analysis of the Click Graph. Proc. VLDB Endow. (2008).

Digital Library

[7]

Aleksandar Bojchevski, Johannes Klicpera, Bryan Perozzi, Amol Kapoor, Martin Blais, Benedek Rózemberczki, Michal Lukasik, and Stephan Günnemann. 2020. Scaling Graph Neural Networks with Approximate PageRank. In KDD’20.

[8]

Diego Ceccarelli, Sergiu Gordea, Claudio Lucchese, Franco Maria Nardini, and Raffale Perego. 2013. When Entities Meet Query Recommender Systems: Semantic Search Shortcuts. In SAC ’13.

Digital Library

[9]

Hanjun Dai, Yichen Wang, Rakshit Trivedi, and Le Song. 2016. Recurrent Coevolutionary Latent Feature Processes for Continuous-Time Recommendation. In DLRS 2016.

[10]

Songgaojun Deng, Huzefa Rangwala, and Yue Ning. 2019. Learning Dynamic Context Graphs for Predicting Social Events. In KDD ’19.

[11]

Tim Donkers, Benedikt Loepp, and Jürgen Ziegler. 2017. Sequential User-Based Recurrent Neural Network Recommendations. In RecSys ’17.

[12]

Albrecht Enders, Harald Hungenberg, Hans-Peter Denker, and Sebastian Mauch. 2008. The long tail of social networking.European Management Journal(2008).

[13]

Junheng Hao, Tong Zhao, Jin Li, Xin Luna Dong, Christos Faloutsos, Yizhou Sun, and Wei Wang. 2020. P-Companion: A Principled Framework for Diversified Complementary Product Recommendation. In CIKM ’20.

[14]

Xiangnan He and Tat-Seng Chua. 2017. Neural Factorization Machines for Sparse Predictive Analytics. In SIGIR ’17.

[15]

Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, YongDong Zhang, and Meng Wang. 2020. LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation. In SIGIR ’20.

[16]

Yunlong He, Jiliang Tang, Hua Ouyang, Changsung Kang, Dawei Yin, and Yi Chang. 2016. Learning to Rewrite Queries. In CIKM ’16.

[17]

Balázs Hidasi and Alexandros Karatzoglou. 2017. Recurrent Neural Networks with Top-k Gains for Session-based Recommendations. CoRR abs/1706.03847(2017).

[18]

Glen Jeh and Jennifer Widom. 2003. Scaling Personalized Web Search. In WWW ’03.

[19]

Baoyu Jing, Chanyoung Park, and Hanghang Tong. 2021. Hdmi: High-order deep multiplex infomax. In Proceedings of the Web Conference 2021. 2414–2424.

Digital Library

[20]

Baoyu Jing, Hanghang Tong, and Yada Zhu. 2021. Network of Tensor Time Series. In Proceedings of the Web Conference 2021. 2425–2437.

Digital Library

[21]

Thomas N. Kipf and Max Welling. 2017. Semi-Supervised Classification with Graph Convolutional Networks. In ICLR ’17.

[22]

Johannes Klicpera, Aleksandar Bojchevski, and Stephan Günnemann. 2019. Predict then Propagate: Graph Neural Networks meet Personalized PageRank. In ICLR’19.

[23]

Srijan Kumar, Xikun Zhang, and Jure Leskovec. 2019. Predicting Dynamic Embedding Trajectory in Temporal Interaction Networks. In KDD ’19.

[24]

Jianxun Lian, Xiaohua Zhou, Fuzheng Zhang, Zhongxia Chen, Xing Xie, and Guang zhong Sun. 2018. xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems. In KDD’18.

[25]

Yankai Lin, Zhiyuan Liu, Maosong Sun, Yang Liu, and Xuan Zhu. 2015. Learning Entity and Relation Embeddings for Knowledge Graph Completion. In AAAI’15.

[26]

Fan Liu, Zhiyong Cheng, Lei Zhu, Zan Gao, and Liqiang Nie. 2021. Interest-aware Message-Passing GCN for Recommendation. In Proceedings of the Web Conference 2021.

Digital Library

[27]

Bhaskar Mitra and Nick Craswell. 2015. Query Auto-Completion for Rare Prefixes. In CIKM ’15.

[28]

Dae Hoon Park and Rikio Chiba. 2017. A Neural Language Model for Query Auto-Completion. In SIGIR ’17.

[29]

Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. DeepWalk: Online Learning of Social Representations. In KDD ’14.

[30]

Jiarui Qin, Kan Ren, Yuchen Fang, Weinan Zhang, and Yong Yu. 2020. Sequential Recommendation with Dual Side Neighbor-based Collaborative Relation Modeling. In WSDM ’20.

[31]

Lakshmanan Rakkappan and Vaibhav Rajan. 2019. Context-Aware Sequential Recommendations WithStacked Recurrent Neural Networks. In WWW ’19.

[32]

Steffen Rendle, Zeno Gantner, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2011. Fast Context-Aware Recommendations with Factorization Machines. In SIGIR ’11.

[33]

Aravind Sankar, Yanhong Wu, Liang Gou, Wei Zhang, and Hao Yang. 2020. DySAT: Deep Neural Representation Learning on Dynamic Graphs via Self-Attention Networks. In WSDM’20.

[34]

Jingbo Shang, Jialu Liu, Meng Jiang, Xiang Ren, Clare R. Voss, and Jiawei Han. 2017. Automated Phrase Mining from Massive Text Corpora. In SIGMOD’15.

[35]

H. Shao, S. Yao, A. Jing, S. Liu, D. Liu, T. Wang, J. Li, C. Yang, R. Wang, and T. Abdelzaher. 2020. Misinformation Detection and Adversarial Attack Cost Analysis in Directional Social Networks. In ICCCN’20.

[36]

Weiping Song, Zhiping Xiao, Yifan Wang, Laurent Charlin, Ming Zhang, and Jian Tang. 2019. Session-Based Social Recommendation via Dynamic Graph Attention Networks. In WSDM ’19.

[37]

Fei Sun, Jun Liu, Jian Wu, Changhua Pei, Xiao Lin, Wenwu Ou, and Peng Jiang. 2019. BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer. In CIKM ’19.

[38]

Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. 2017. Graph Attention Networks. In ICLR’17.

[39]

Haiwen Wang, Ruijie Wang, Chuan Wen, Shuhao Li, Yuting Jia, Weinan Zhang, and Xinbing Wang. 2020. Author Name Disambiguation on Heterogeneous Information Network with Adversarial Representation Learning. In AAAI ’20.

[40]

Hongwei Wang, Fuzheng Zhang, Jialin Wang, Miao Zhao, Wenjie Li, Xing Xie, and Minyi Guo. 2018. RippleNet: Propagating User Preferences on the Knowledge Graph for Recommender Systems. In CIKM ’18.

[41]

Ruijie Wang, Zijie Huang, Shengzhong Liu, Huajie Shao, Dongxin Liu, Jinyang Li, Tianshi Wang, Dachun Sun, Shuochao Yao, and Tarek Abdelzaher. 2021. DyDiff-VAE: A Dynamic Variational Framework for Information Diffusion Prediction. In SIGIR’21.

[42]

Ruijie Wang, Yuchen Yan, Jialu Wang, Yuting Jia, Ye Zhang, Weinan Zhang, and Xinbing Wang. 2018. AceKG: A Large-Scale Knowledge Graph for Academic Data Mining. In CIKM ’18.

[43]

Weiqing Wang, Hongzhi Yin, Zi Huang, Qinyong Wang, Xingzhong Du, and Quoc Viet Hung Nguyen. 2018. Streaming Ranking Based Recommender Systems. In SIGIR ’18.

[44]

Xiang Wang, Xiangnan He, Yixin Cao, Meng Liu, and Tat-Seng Chua. 2019. KGAT: Knowledge Graph Attention Network for Recommendation. In KDD ’19.

Digital Library

[45]

Jason Weston, Samy Bengio, and Nicolas Usunier. 2011. WSABIE: Scaling up to Large Vocabulary Image Annotation. In IJCAI’11.

[46]

Yuchen Yan, Lihui Liu, Yikun Ban, Baoyu Jing, and Hanghang Tong. 2021. Dynamic Knowledge Graph Alignment. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35.

[47]

Yuchen Yan, Si Zhang, and Hanghang Tong. 2021. BRIGHT: A Bridging Algorithm for Network Alignment. In Proceedings of the Web Conference 2021.

Digital Library

[48]

Chaoqi Yang, Jinyang Li, Ruijie Wang, Shuochao Yao, Huajie Shao, Dongxin Liu, Shengzhong Liu, Tianshi Wang, and Tarek F. Abdelzaher. 2020. Hierarchical Overlapping Belief Estimation by Structured Matrix Factorization. In ASONAM’20.

[49]

Chaoqi Yang, Ruijie Wang, Shuochao Yao, and Tarek F. Abdelzaher. 2020. Hypergraph Learning with Line Expansion. CoRR abs/2005.04843(2020).

[50]

Chaoqi Yang, Ruijie Wang, Shuochao Yao, Shengzhong Liu, and Tarek F. Abdelzaher. 2020. Revisiting ”Over-smoothing” in Deep GCNs. CoRR abs/2003.13663(2020). https://arxiv.org/abs/2003.13663

[51]

Hanqing Zeng, Muhan Zhang, Yinglong Xia, Ajitesh Srivastava, Andrey Malevich, Rajgopal Kannan, Viktor K. Prasanna, Long Jin, and Ren Chen. 2021. Deep Graph Neural Networks with Shallow Subgraph Samplers. In NeurIPS’21.

[52]

Fuzheng Zhang, Nicholas Jing Yuan, Defu Lian, Xing Xie, and Wei-Ying Ma. 2016. Collaborative Knowledge Base Embedding for Recommender Systems. In KDD ’16.

[53]

Yang Zhang, Fuli Feng, Chenxu Wang, Xiangnan He, Meng Wang, Yan Li, and Yongdong Zhang. 2020. How to Retrain Recommender System? A Sequential Meta-Learning Method. In SIGIR ’20.

[54]

Lingxiao Zhao and Leman Akoglu. 2020. PairNorm: Tackling Oversmoothing in {GNN}s. In International Conference on Learning Representations.

[55]

Sijin Zhou, Xinyi Dai, Haokun Chen, Weinan Zhang, Kan Ren, Ruiming Tang, Xiuqiang He, and Yong Yu. 2020. Interactive Recommender System via Knowledge Graph-enhanced Reinforcement Learning. In SIGIR’20.

Cited By

Wang RHuang JZhang YLi JWang YZhao WLiu SMendis CAbdelzaher THui Yang GWang HHan SHauff CZuccon GZhang Y(2024)TGOnline: Enhancing Temporal Graph Learning with Adaptive Online Meta-LearningProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657791(1659-1669)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657791
Wang RZhang YLi JLiu SSun DWang TWang TChen YKara DAbdelzaher THui Yang GWang HHan SHauff CZuccon GZhang Y(2024)MetaHKG: Meta Hyperbolic Learning for Few-shot Temporal ReasoningProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657711(59-69)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657711
Yu CLiu XMaia JLi YCao TGao YSong YGoutam RZhang HYin BLi ZBarcelo PSanchez-Pi NMeliou ASudarshan S(2024)COSMO: A Large-Scale E-commerce Common Sense Knowledge Generation and Serving System at AmazonCompanion of the 2024 International Conference on Management of Data10.1145/3626246.3653398(148-160)Online publication date: 9-Jun-2024
https://dl.acm.org/doi/10.1145/3626246.3653398
Show More Cited By

Index Terms

RETE: Retrieval-Enhanced Temporal Event Forecasting on Unified Query Product Evolutionary Graph
1. Information systems

Index terms have been assigned to the content through auto-classification.

Recommendations

Unsupervised multi-view feature extraction with dynamic graph learning
Highlights
- We devise a framework that unifies dynamic graph and feature extraction learning.
- An effective optimization solution guaranteed desirable convergence is proposed.
- Extensive experiments on public multi-view datasets demonstrate the ...
Abstract
Graph-based multi-view feature extraction has attracted much attention in literature. However, conventional solutions generally rely on a manually defined affinity graph matrix, which is hard to capture the intrinsic sample relations in multiple ...
Time-aware personalized graph convolutional network for multivariate time series forecasting
Abstract
The use of graph structures to model variable dependencies in multivariate time series data holds promise. Probabilistic graph models, sampling discrete graphs from neural network-parameterized distributions, have shown efficacy. However, the ...
Highlights
- Proposed graph learning method models spatial dependence under heterogeneous information.
- Variables are impacted by self-evolutionary pattern and external variables.
- Proposed graph convolution unifies the effects of self and ...
Constructing narrative event evolutionary graph for script event prediction
IJCAI'18: Proceedings of the 27th International Joint Conference on Artificial Intelligence

Script event prediction requires a model to predict the subsequent event given an existing event context. Previous models based on event pairs or event chains cannot make full use of dense event connections, which may limit their capability of event ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WWW '22: Proceedings of the ACM Web Conference 2022

April 2022

3764 pages

ISBN:9781450390965

DOI:10.1145/3485447

Editors:
Frédérique Laforest
INSA Lyon, France
,
Raphaël Troncy
EURECOM, France
,
Elena Simperl
King’s College London, UK
,
Deepak Agarwal
Pinterest, USA
,
Aristides Gionis
KTH Royal Institute of Technology, Sweden
,
Ivan Herman
W3C / retired
,
Lionel Médini
Université Lyon 1, France

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

DARPA
DARPA award
the Army Research Laboratory
Basic Research Office

Conference

WWW '22

Sponsor:

SIGWEB

WWW '22: The ACM Web Conference 2022

April 25 - 29, 2022

Virtual Event, Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
594
Total Downloads

Downloads (Last 12 months)279
Downloads (Last 6 weeks)23

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang RHuang JZhang YLi JWang YZhao WLiu SMendis CAbdelzaher THui Yang GWang HHan SHauff CZuccon GZhang Y(2024)TGOnline: Enhancing Temporal Graph Learning with Adaptive Online Meta-LearningProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657791(1659-1669)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657791
Wang RZhang YLi JLiu SSun DWang TWang TChen YKara DAbdelzaher THui Yang GWang HHan SHauff CZuccon GZhang Y(2024)MetaHKG: Meta Hyperbolic Learning for Few-shot Temporal ReasoningProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657711(59-69)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657711
Yu CLiu XMaia JLi YCao TGao YSong YGoutam RZhang HYin BLi ZBarcelo PSanchez-Pi NMeliou ASudarshan S(2024)COSMO: A Large-Scale E-commerce Common Sense Knowledge Generation and Serving System at AmazonCompanion of the 2024 International Conference on Management of Data10.1145/3626246.3653398(148-160)Online publication date: 9-Jun-2024
https://dl.acm.org/doi/10.1145/3626246.3653398
Yan YHu YZhou QLiu LZeng ZChen YPan MChen HDas MTong HChua TNgo CKa-Wei Lee RKumar RLauw H(2024)PaCEr: Network Embedding From Positional to StructuralProceedings of the ACM Web Conference 202410.1145/3589334.3645516(2485-2496)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589334.3645516
Xiao GWang CWang QSong JLu J(2024)Sequence-Aware Service Recommendation Based on Graph Convolutional Networks2024 International Conference on Computer, Information and Telecommunication Systems (CITS)10.1109/CITS61189.2024.10607990(1-7)Online publication date: 17-Jul-2024
https://doi.org/10.1109/CITS61189.2024.10607990
Yan YChen YChen HXu MDas MYang HTong HOh ANaumann TGloberson ASaenko KHardt MLevine S(2023)From trainable negative depth to edge heterophily in graphsProceedings of the 37th International Conference on Neural Information Processing Systems10.5555/3666122.3669196(70162-70178)Online publication date: 10-Dec-2023
https://dl.acm.org/doi/10.5555/3666122.3669196
Bian QXu JFang HKe YFrommholz IHopfgartner FLee MOakes MLalmas MZhang MSantos R(2023)CPMR: Context-Aware Incremental Sequential Recommendation with Pseudo-Multi-Task LearningProceedings of the 32nd ACM International Conference on Information and Knowledge Management10.1145/3583780.3615512(120-130)Online publication date: 21-Oct-2023
https://dl.acm.org/doi/10.1145/3583780.3615512
Wang RLi ZYang JCao TZhang CYin BAbdelzaher T(2023)Mutually-paced Knowledge Distillation for Cross-lingual Temporal Knowledge Graph ReasoningProceedings of the ACM Web Conference 202310.1145/3543507.3583407(2621-2632)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3543507.3583407
Liu LChen YDas MYang HTong H(2023)Knowledge Graph Question Answering with Ambiguous QueryProceedings of the ACM Web Conference 202310.1145/3543507.3583316(2477-2486)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3543507.3583316
Liu LCai LZhang CZhao XGao JWang WLv YFan WWang YHe MLiu ZLi QChen HDuh WHuang HKato MMothe JPoblete B(2023)LinRec: Linear Attention Mechanism for Long-term Sequential Recommender SystemsProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591717(289-299)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3539618.3591717
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents