Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3534678.3539221acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

CausalInt: Causal Inspired Intervention for Multi-Scenario Recommendation

Published: 14 August 2022 Publication History

Abstract

Building appropriate scenarios to meet the personalized demands of different user groups is a common practice. Despite various scenario brings personalized service, it also leads to challenges for the recommendation on multiple scenarios, especially the scenarios with limited traffic. To give desirable recommendation service for all scenarios and reduce the cost of resource consumption, how to leverage the information from multiple scenarios to construct a unified model becomes critical. Unfortunately, the performance of existing multi-scenario recommendation approaches is poor since they introduce unnecessary information from other scenarios to target scenario. In this paper, we show it is possible to selectively utilize the information from different scenarios to construct the scenario-aware estimators in a unified model. Specifically, we first do analysis on multi-scenario modeling with causal graph from the perspective of users and modeling processes, and then propose the Causal Inspired Intervention (CausalInt) framework for multi-scenario recommendation. CausalInt consists of three modules: (1) Invariant Representation Modeling module to squeeze out the scenario-aware information through disentangled representation learning and obtain a scenario-invariant representation; (2) Negative Effects Mitigating module to resolve conflicts between different scenarios and conflicts between scenario-specific and scenario-invariant representations via gradient based orthogonal regularization and model-agnostic meta learning, respectively; (3) Inter-Scenario Transferring module designs a novel TransNet to simulate a counterfactual intervention and effectively fuse the information from other scenarios. Offline experiments over two real-world dataset and online A/B test are conducted to demonstrate the superiority of CausalInt.

Supplemental Material

MP4 File
presentation video

References

[1]
Rich Caruana. 1997. Multitask learning. Machine learning (1997).
[2]
Bo Chen, Yichao Wang, Zhirong Liu, Ruiming Tang, Wei Guo, Hongkun Zheng, Weiwei Yao, Muyu Zhang, and Xiuqiang He. 2021. Enhancing Explicit and Implicit Feature Interactions via Information Sharing for Parallel Deep CTR Models. In Proc. of CIKM.
[3]
Heng-Tze Cheng, Levent Koc, Jeremiah Harmsen, Tal Shaked, Tushar Chandra, Hrishi Aradhye, Glen Anderson, Greg Corrado, Wei Chai, Mustafa Ispir, et al. 2016. Wide & deep learning for recommender systems. In Proceedings of the 1st workshop on deep learning for recommender systems.
[4]
Mehrdad Farajtabar, Navid Azizan, Alex Mott, and Ang Li. 2020. Orthogonal gradient descent for continual learning. In AISTATS.
[5]
Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-agnostic metalearning for fast adaptation of deep networks. In Proc. of ICML.
[6]
Huifeng Guo, Ruiming Tang, Yunming Ye, Zhenguo Li, and Xiuqiang He. 2017. DeepFM: a factorization-machine based neural network for CTR prediction. arXiv preprint arXiv:1703.04247 (2017).
[7]
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al. 2017. Overcoming catastrophic forgetting in neural networks. Proceedings of the national academy of sciences (2017).
[8]
Jiaqi Ma, Zhe Zhao, Xinyang Yi, Jilin Chen, Lichan Hong, and Ed H Chi. 2018. Modeling task relationships in multi-task learning with multi-gate mixture-ofexperts. In Proc. of KDD.
[9]
Judea Pearl. 2009. Causality. Cambridge university press.
[10]
Qi Pi, Guorui Zhou, Yujing Zhang, Zhe Wang, Lejian Ren, Ying Fan, Xiaoqiang Zhu, and Kun Gai. 2020. Search-based user interest modeling with lifelong sequential behavior data for click-through rate prediction. In Proc. of CIKM.
[11]
Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, and Jeff Dean. 2017. Outrageously large neural networks: The sparsely-gated mixture-of-experts layer. arXiv preprint arXiv:1701.06538 (2017).
[12]
Qijie Shen,Wanjie Tao, Jing Zhang, HongWen, Zulong Chen, and Quan Lu. 2021. SAR-Net: A Scenario-Aware Ranking Network for Personalized Fair Recommendation in Hundreds of Travel Scenarios. In Proc. of CIKM.
[13]
Xiang-Rong Sheng, Liqin Zhao, Guorui Zhou, Xinyao Ding, Binding Dai, Qiang Luo, Siran Yang, Jingshan Lv, Chi Zhang, Hongbo Deng, et al. 2021. One Model to Serve All: Star Topology Adaptive Recommender for Multi-Domain CTR Prediction. In Proc. of CIKM.
[14]
Mihai Suteu and Yike Guo. 2019. Regularizing deep multi-task networks using orthogonal gradients. arXiv preprint arXiv:1912.06844 (2019).
[15]
Hongyan Tang, Junning Liu, Ming Zhao, and Xudong Gong. 2020. Progressive layered extraction (ple): A novel multi-task learning (mtl) model for personalized recommendations. In RecSys.
[16]
Mei Wang and Weihong Deng. 2018. Deep visual domain adaptation: A survey. Neurocomputing (2018).
[17]
Yichao Wang, Huifeng Guo, Ruiming Tang, Zhirong Liu, and Xiuqiang He. 2020. A Practical Incremental Method to Train Deep CTR Models. arXiv preprint arXiv:2009.02147 (2020).
[18]
Dongbo Xi, Zhen Chen, Peng Yan, Yinger Zhang, Yongchun Zhu, Fuzhen Zhuang, and Yu Chen. 2021. Modeling the Sequential Dependence among Audience Multistep Conversions with Multi-task Learning in Targeted Display Advertising. arXiv preprint arXiv:2105.08489 (2021).
[19]
Yang Zhang, Fuli Feng, Xiangnan He, Tianxin Wei, Chonggang Song, Guohui Ling, and Yongdong Zhang. 2021. Causal intervention for leveraging popularity bias in recommendation. In Proc. of SIGIR. 11--20.
[20]
Guorui Zhou, Xiaoqiang Zhu, Chengru Song, Ying Fan, Han Zhu, Xiao Ma, Yanghui Yan, Junqi Jin, Han Li, and Kun Gai. 2018. Deep Interest Network for Click-Through Rate Prediction. In Proc. of KDD.

Cited By

View all
  • (2025)Hybrid contrastive multi-scenario learning for multi-task sequential-dependence recommendationNeural Networks10.1016/j.neunet.2024.106953183(106953)Online publication date: Mar-2025
  • (2024)Tag Tree-Guided Multi-grained Alignment for Multi-Domain Short Video RecommendationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681692(5683-5691)Online publication date: 28-Oct-2024
  • (2024)ECRT: Flexible Sequence Enhancement Framework for Cross-Domain Information Reuse in RecommendationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3680038(5094-5101)Online publication date: 21-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
KDD '22: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining
August 2022
5033 pages
ISBN:9781450393850
DOI:10.1145/3534678
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 August 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. invariant representation
  2. multi-scenario
  3. negative mitigating
  4. transfer learning

Qualifiers

  • Research-article

Conference

KDD '22
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

Upcoming Conference

KDD '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)238
  • Downloads (Last 6 weeks)33
Reflects downloads up to 27 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2025)Hybrid contrastive multi-scenario learning for multi-task sequential-dependence recommendationNeural Networks10.1016/j.neunet.2024.106953183(106953)Online publication date: Mar-2025
  • (2024)Tag Tree-Guided Multi-grained Alignment for Multi-Domain Short Video RecommendationProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681692(5683-5691)Online publication date: 28-Oct-2024
  • (2024)ECRT: Flexible Sequence Enhancement Framework for Cross-Domain Information Reuse in RecommendationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3680038(5094-5101)Online publication date: 21-Oct-2024
  • (2024)LLM4MSR: An LLM-Enhanced Paradigm for Multi-Scenario RecommendationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679743(2472-2481)Online publication date: 21-Oct-2024
  • (2024)MMLRec: A Unified Multi-Task and Multi-Scenario Learning Benchmark for RecommendationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679691(3063-3072)Online publication date: 21-Oct-2024
  • (2024)HierRec: Scenario-Aware Hierarchical Modeling for Multi-scenario RecommendationsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679615(653-662)Online publication date: 21-Oct-2024
  • (2024)Modeling Domains as Distributions with Uncertainty for Cross-Domain RecommendationProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657930(2517-2521)Online publication date: 10-Jul-2024
  • (2024)Scenario-Adaptive Fine-Grained Personalization Network: Tailoring User Behavior Representation to the Scenario ContextProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657803(1557-1566)Online publication date: 10-Jul-2024
  • (2024)M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation FrameworkProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657686(893-902)Online publication date: 10-Jul-2024
  • (2024)IncMSR: An Incremental Learning Approach for Multi-Scenario RecommendationProceedings of the 17th ACM International Conference on Web Search and Data Mining10.1145/3616855.3635828(939-948)Online publication date: 4-Mar-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media