Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Free access
Just Accepted

Distributed Recommendation Systems: Survey and Research Directions

Online AM: 06 September 2024 Publication History

Abstract

With the explosive growth of online information, recommendation systems have become essential tools for alleviating information overload. In recent years, researchers have increasingly focused on centralized recommendation systems, capitalizing on the powerful computing capabilities of cloud servers and the rich historical data they store. However, the rapid development of edge computing and mobile devices in recent years has provided new alternatives for building recommendation systems. These alternatives offer advantages such as privacy protection and low-latency recommendations. To leverage the advantages of different computing nodes, including cloud servers, edge servers, and terminal devices, researchers have proposed recommendation systems that involve the collaboration of these nodes, known as distributed recommendation systems. This survey provides a systematic review of distributed recommendation systems. Specifically, we design a taxonomy for these systems from four perspectives and comprehensively summarize each study by category. In particular, we conduct a detailed analysis of the collaboration mechanisms of distributed recommendation systems. Finally, we discuss potential future research directions in this field.

References

[1]
Shuai Zhang, Lina Yao, Aixin Sun, and Yi Tay. 2019. Deep learning based recommender system: A survey and new perspectives. ACM computing surveys (CSUR) 52, 1 (2019), 1–38.
[2]
Yifang Qin, Wei Ju, Hongjun Wu, Xiao Luo, and Ming Zhang. 2024. Learning graph ODE for continuous-time sequential recommendation. IEEE Transactions on Knowledge and Data Engineering (2024).
[3]
Wei Ju, Yifang Qin, Ziyue Qiao, Xiao Luo, Yifan Wang, Yanjie Fu, and Ming Zhang. 2022. Kernel-based substructure exploration for next POI recommendation. In 2022 IEEE International Conference on Data Mining (ICDM). IEEE, 221–230.
[4]
Zeyuan Chen, Jiangchao Yao, Feng Wang, Kunyang Jia, Bo Han, Wei Zhang, and Hongxia Yang. 2021. MC ^2-SF: Slow-Fast Learning for Mobile-Cloud Collaborative Recommendation. arXiv preprint arXiv:2109.12314 (2021).
[5]
Keyan Cao, Yefan Liu, Gongjie Meng, and Qimeng Sun. 2020. An overview on edge computing research. IEEE access 8 (2020), 85714–85728.
[6]
Liu Yang, Ben Tan, Vincent W Zheng, Kai Chen, and Qiang Yang. 2020. Federated recommendation systems. Federated Learning: Privacy and Incentive (2020), 225–239.
[7]
Zheqi Lv, Wenqiao Zhang, Shengyu Zhang, Kun Kuang, Feng Wang, Yongwei Wang, Zhengyu Chen, Tao Shen, Hongxia Yang, Beng Chin Ooi, et al. 2023. DUET: A Tuning-Free Device-Cloud Collaborative Parameters Generation Framework for Efficient Device Model Generalization. In Proceedings of the ACM Web Conference 2023. 3077–3085.
[8]
Alex Nichol, Joshua Achiam, and John Schulman. 2018. On first-order meta-learning algorithms. arXiv preprint arXiv:1803.02999 (2018).
[9]
Marko Harasic, Felix-Sebastian Keese, Denny Mattern, and Adrian Paschke. 2023. Recent advances and future challenges in federated recommender systems. International Journal of Data Science and Analytics (2023), 1–21.
[10]
Zareen Alamgir, Farwa K Khan, and Saira Karim. 2022. Federated recommenders: methods, challenges and future. Cluster Computing 25, 6 (2022), 4075–4096.
[11]
Jiangchao Yao, Shengyu Zhang, Yang Yao, Feng Wang, Jianxin Ma, Jianwei Zhang, Yunfei Chu, Luo Ji, Kunyang Jia, Tao Shen, et al. 2022. Edge-cloud polarization and collaboration: A comprehensive survey for ai. IEEE Transactions on Knowledge and Data Engineering 35, 7 (2022), 6866–6886.
[12]
Shadi Al Awawdeh and Abdallah Tubaishat. 2014. An information security awareness program to address common security concerns in IT unit. In 2014 11th International Conference on Information Technology: New Generations. IEEE, 273–278.
[13]
Mingzhe Chen, Nir Shlezinger, H Vincent Poor, Yonina C Eldar, and Shuguang Cui. 2021. Communication-efficient federated learning. Proceedings of the National Academy of Sciences 118, 17 (2021), e2024789118.
[14]
Qinyong Wang, Hongzhi Yin, Tong Chen, Junliang Yu, Alexander Zhou, and Xiangliang Zhang. 2021. Fast-adapting and privacy-preserving federated recommender system. The VLDB Journal (2021), 1–20.
[15]
Lin Zhang, Yong Luo, Yan Bai, Bo Du, and Ling-Yu Duan. 2021. Federated learning for non-iid data via unified feature learning and optimization objective alignment. In Proceedings of the IEEE/CVF international conference on computer vision. 4420–4428.
[16]
Hangyu Zhu, Jinjin Xu, Shiqing Liu, and Yaochu Jin. 2021. Federated learning on non-IID data: A survey. Neurocomputing 465 (2021), 371–390.
[17]
Xiang Li, Kaixuan Huang, Wenhao Yang, Shusen Wang, and Zhihua Zhang. 2019. On the convergence of fedavg on non-iid data. arXiv preprint arXiv:1907.02189 (2019).
[18]
Marco V Barbera, Sokol Kosta, Alessandro Mei, and Julinda Stefa. 2013. To offload or not to offload? the bandwidth and energy costs of mobile cloud computing. In 2013 Proceedings Ieee Infocom. IEEE, 1285–1293.
[19]
Yuanming Shi, Kai Yang, Tao Jiang, Jun Zhang, and Khaled B Letaief. 2020. Communication-efficient edge AI: Algorithms and systems. IEEE Communications Surveys & Tutorials 22, 4 (2020), 2167–2191.
[20]
Jun Xiao, Minjuan Wang, Bingqian Jiang, and Junli Li. 2018. A personalized recommendation system with combinational algorithm for online learning. Journal of ambient intelligence and humanized computing 9 (2018), 667–677.
[21]
Aminu Da’u and Naomie Salim. 2020. Recommendation system based on deep learning methods: a systematic review and new directions. Artificial Intelligence Review 53, 4 (2020), 2709–2748.
[22]
Jiahui Liu, Peter Dolan, and Elin Rønby Pedersen. 2010. Personalized news recommendation based on click behavior. In Proceedings of the 15th international conference on Intelligent user interfaces. 31–40.
[23]
Georgios Theocharous, Philip S Thomas, and Mohammad Ghavamzadeh. 2015. Ad recommendation systems for life-time value optimization. In Proceedings of the 24th international conference on world wide web. 1305–1310.
[24]
Tao Qi, Fangzhao Wu, Chuhan Wu, Yongfeng Huang, and Xing Xie. 2020. Privacy-preserving news recommendation model learning. arXiv preprint arXiv:2003.09592 (2020).
[25]
Chen Zhang, Yu Xie, Hang Bai, Bin Yu, Weihong Li, and Yuan Gao. 2021. A survey on federated learning. Knowledge-Based Systems 216 (2021), 106775.
[26]
Harald Steck. 2013. Evaluation of recommendations: rating-prediction and ranking. In Proceedings of the 7th ACM conference on Recommender systems. 213–220.
[27]
Bingkun Wang, Bing Chen, Li Ma, and Gaiyun Zhou. 2018. User-personalized review rating prediction method based on review text content and user-item rating matrix. Information 10, 1 (2018), 1.
[28]
Xiaoyue Li, Haonan Zhao, Zhuo Wang, and Zhezhou Yu. 2020. Research on movie rating prediction algorithms. In 2020 5th IEEE international conference on big data analytics (ICBDA). IEEE, 121–125.
[29]
Mazhar Javed Awan, Rafia Asad Khan, Haitham Nobanee, Awais Yasin, Syed Muhammad Anwar, Usman Naseem, and Vishwa Pratap Singh. 2021. A recommendation engine for predicting movie ratings using a big data approach. Electronics 10, 10 (2021), 1215.
[30]
Yu Gong, Ziwen Jiang, Yufei Feng, Binbin Hu, Kaiqi Zhao, Qingwen Liu, and Wenwu Ou. 2020. EdgeRec: recommender system on edge in Mobile Taobao. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 2477–2484.
[31]
Dwi Utari Iswavigra et al. 2020. Online Shop Recommendations: Decision Support System Based on Multi-Objective Optimization on the Basis of Ratio Analysis. In 2020 8th International Conference on Cyber and IT Service Management (CITSM). IEEE, 1–6.
[32]
Jialiang Han, Yun Ma, Qiaozhu Mei, and Xuanzhe Liu. 2021. Deeprec: On-device deep learning for privacy-preserving sequential recommendation in mobile commerce. In Proceedings of the Web Conference 2021. 900–911.
[33]
Yao Wu, Jian Cao, and Guandong Xu. 2023. Fairness in Recommender Systems: Evaluation Approaches and Assurance Strategies. ACM Transactions on Knowledge Discovery from Data (2023).
[34]
Yehuda Koren, Steffen Rendle, and Robert Bell. 2021. Advances in collaborative filtering. Recommender systems handbook (2021), 91–142.
[35]
Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl. 2001. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th international conference on World Wide Web. 285–295.
[36]
Charu C Aggarwal and Charu C Aggarwal. 2016. Model-based collaborative filtering. Recommender systems: the textbook (2016), 71–138.
[37]
Yehuda Koren, Robert Bell, and Chris Volinsky. 2009. Matrix factorization techniques for recommender systems. Computer 42, 8 (2009), 30–37.
[38]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017. Neural collaborative filtering. In Proceedings of the 26th international conference on world wide web. 173–182.
[39]
Xiangnan He, Kuan Deng, Xiang Wang, Yan Li, Yongdong Zhang, and Meng Wang. 2020. Lightgcn: Simplifying and powering graph convolution network for recommendation. In Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval. 639–648.
[40]
Poonam B Thorat, Rajeshwari M Goudar, and Sunita Barve. 2015. Survey on collaborative filtering, content-based filtering and hybrid recommendation system. International Journal of Computer Applications 110, 4 (2015), 31–36.
[41]
Jill C Stoltzfus. 2011. Logistic regression: a brief primer. Academic emergency medicine 18, 10 (2011), 1099–1104.
[42]
Chanapa Channarong, Chawisa Paosirikul, Saranya Maneeroj, and Atsuhiro Takasu. 2022. HybridBERT4Rec: A Hybrid (Content-Based Filtering and Collaborative Filtering) Recommender System Based on BERT. IEEE Access 10 (2022), 56193–56206.
[43]
Jingwei Yi, Fangzhao Wu, Chuhan Wu, Ruixuan Liu, Guangzhong Sun, and Xing Xie. 2021. Efficient-FedRec: Efficient federated learning framework for privacy-preserving news recommendation. arXiv preprint arXiv:2109.05446 (2021).
[44]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).
[45]
Per E Kummervold, Javier De la Rosa, Freddy Wetjen, and Svein Arne Brygfjeld. 2021. Operationalizing a national digital library: The case for a Norwegian transformer model. arXiv preprint arXiv:2104.09617 (2021).
[46]
Jiangcheng Qin, Xueyuan Zhang, Baisong Liu, and Jiangbo Qian. 2023. A split-federated learning and edge-cloud based efficient and privacy-preserving large-scale item recommendation model. Journal of Cloud Computing 12, 1 (2023), 1–17.
[47]
Yanru Qu, Han Cai, Kan Ren, Weinan Zhang, Yong Yu, Ying Wen, and Jun Wang. 2016. Product-based neural networks for user response prediction. In 2016 IEEE 16th international conference on data mining (ICDM). IEEE, 1149–1154.
[48]
Shoujin Wang, Liang Hu, Yan Wang, Longbing Cao, Quan Z Sheng, and Mehmet Orgun. 2019. Sequential recommender systems: challenges, progress and prospects. arXiv preprint arXiv:2001.04830 (2019).
[49]
Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk. 2015. Session-based recommendations with recurrent neural networks. arXiv preprint arXiv:1511.06939 (2015).
[50]
Guorui Zhou, Xiaoqiang Zhu, Chenru Song, Ying Fan, Han Zhu, Xiao Ma, Yanghui Yan, Junqi Jin, Han Li, and Kun Gai. 2018. Deep interest network for click-through rate prediction. In Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining. 1059–1068.
[51]
Wang-Cheng Kang and Julian McAuley. 2018. Self-attentive sequential recommendation. In 2018 IEEE international conference on data mining (ICDM). IEEE, 197–206.
[52]
Shanshan Feng, Xutao Li, Yifeng Zeng, Gao Cong, Yeow Meng Chee, and Quan Yuan. 2015. Personalized ranking metric embedding for next new poi recommendation. (2015).
[53]
Qinyong Wang, Hongzhi Yin, Tong Chen, Zi Huang, Hao Wang, Yanchang Zhao, and Nguyen Quoc Viet Hung. 2020. Next point-of-interest recommendation on resource-constrained mobile devices. In Proceedings of the Web conference 2020. 906–916.
[54]
Yakun Huang, Xiuquan Qiao, Schahram Dustdar, Jianwei Zhang, and Jiulin Li. 2022. Toward decentralized and collaborative deep learning inference for intelligent iot devices. IEEE Network 36, 1 (2022), 59–68.
[55]
Wenchen He, Shaoyong Guo, Song Guo, Xuesong Qiu, and Feng Qi. 2020. Joint DNN partition deployment and resource allocation for delay-sensitive deep learning inference in IoT. IEEE Internet of Things Journal 7, 10 (2020), 9241–9254.
[56]
Peter Kairouz, H Brendan McMahan, Brendan Avent, Aurélien Bellet, Mehdi Bennis, Arjun Nitin Bhagoji, Kallista Bonawitz, Zachary Charles, Graham Cormode, Rachel Cummings, et al. 2021. Advances and open problems in federated learning. Foundations and Trends® in Machine Learning 14, 1–2 (2021), 1–210.
[57]
Tian Li, Anit Kumar Sahu, Ameet Talwalkar, and Virginia Smith. 2020. Federated learning: Challenges, methods, and future directions. IEEE signal processing magazine 37, 3 (2020), 50–60.
[58]
YangJie Qin, Ming Li, and Jia Zhu. 2023. Privacy-preserving federated learning framework in multimedia courses recommendation. Wireless Networks 29, 4 (2023), 1535–1544.
[59]
Khalil Muhammad, Qinqin Wang, Diarmuid O’Reilly-Morgan, Elias Tragos, Barry Smyth, Neil Hurley, James Geraci, and Aonghus Lawlor. 2020. Fedfast: Going beyond average for faster training of federated recommender systems. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1234–1242.
[60]
Amir Jalalirad, Marco Scavuzzo, Catalin Capota, and Michael Sprague. 2019. A simple and efficient federated recommender system. In Proceedings of the 6th IEEE/ACM international conference on big data computing, applications and technologies. 53–58.
[61]
Fei Chen, Mi Luo, Zhenhua Dong, Zhenguo Li, and Xiuqiang He. 2019. Federated Meta-Learning with Fast Convergence and Efficient Communication. arXiv:1802.07876 [cs.LG]
[62]
Yichuan Wang, Yuying Tian, Xinyue Yin, and Xinhong Hei. 2020. A trusted recommendation scheme for privacy protection based on federated learning. CCF Transactions on Networking 3 (2020), 218–228.
[63]
Enqi Yu, Zhiwei Ye, Zhiqiang Zhang, Ling Qian, and Meiyi Xie. 2024. A federated recommendation algorithm based on user clustering and meta-learning. Applied Soft Computing 158 (2024), 111483.
[64]
Liang Qu, Wei Yuan, Ruiqi Zheng, Lizhen Cui, Yuhui Shi, and Hongzhi Yin. 2024. Towards Personalized Privacy: User-Governed Data Contribution for Federated Recommendation. In Proceedings of the ACM on Web Conference 2024. 3910–3918.
[65]
Yeting Guo, Fang Liu, Zhiping Cai, Hui Zeng, Li Chen, Tongqing Zhou, and Nong Xiao. 2021. PREFER: Point-of-interest REcommendation with efficiency and privacy-preservation via Federated Edge leaRning. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (2021), 1–25.
[66]
Rodolfo Stoffel Antunes, Cristiano André da Costa, Arne Küderle, Imrana Abdullahi Yari, and Björn Eskofier. 2022. Federated learning for healthcare: Systematic review and architecture proposal. ACM Transactions on Intelligent Systems and Technology (TIST) 13, 4 (2022), 1–23.
[67]
Mubashir Imran, Hongzhi Yin, Tong Chen, Quoc Viet Hung Nguyen, Alexander Zhou, and Kai Zheng. 2023. ReFRS: Resource-efficient federated recommender system for dynamic and diversified user preferences. ACM Transactions on Information Systems 41, 3 (2023), 1–30.
[68]
Chaoyue Niu, Fan Wu, Shaojie Tang, Lifeng Hua, Rongfei Jia, Chengfei Lv, Zhihua Wu, and Guihai Chen. 2020. Billion-scale federated learning on mobile clients: A submodel design with tunable privacy. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1–14.
[69]
Farwa K Khan, Adrian Flanagan, Kuan Eeik Tan, Zareen Alamgir, and Muhammad Ammad-Ud-Din. 2021. A payload optimization method for federated recommender systems. In Proceedings of the 15th ACM Conference on Recommender Systems. 432–442.
[70]
Linze Luo and Baisong Liu. 2022. Dual-Contrastive for Federated Social Recommendation. In 2022 International Joint Conference on Neural Networks (IJCNN). IEEE, 1–8.
[71]
Vito Walter Anelli, Yashar Deldjoo, Tommaso Di Noia, Antonio Ferrara, and Fedelucio Narducci. 2021. Federank: User controlled feedback with federated recommender systems. In Advances in Information Retrieval: 43rd European Conference on IR Research, ECIR 2021, Virtual Event, March 28–April 1, 2021, Proceedings, Part I 43. Springer, 32–47.
[72]
Wenmin Lin, Hui Leng, Ruihan Dou, Lianyong Qi, Zhigeng Pan, and Md Arafatur Rahman. 2023. A federated collaborative recommendation model for privacy-preserving distributed recommender applications based on microservice framework. J. Parallel and Distrib. Comput. 174 (2023), 70–80.
[73]
Xueyong Jiang, Baisong Liu, Jiangchen Qin, Yunchong Zhang, and Jiangbo Qian. 2022. FedNCF: Federated Neural Collaborative Filtering for Privacy-preserving Recommender System. In 2022 International Joint Conference on Neural Networks (IJCNN). IEEE, 1–8.
[74]
Feng Liang, Weike Pan, and Zhong Ming. 2021. Fedrec++: Lossless federated recommendation with explicit feedback. In Proceedings of the AAAI conference on artificial intelligence, Vol. 35. 4224–4231.
[75]
Vasileios Perifanis and Pavlos S Efraimidis. 2022. Federated neural collaborative filtering. Knowledge-Based Systems 242 (2022), 108441.
[76]
Di Chai, Leye Wang, Kai Chen, and Qiang Yang. 2020. Secure federated matrix factorization. IEEE Intelligent Systems 36, 5 (2020), 11–20.
[77]
Honglei Zhang, Fangyuan Luo, Jun Wu, Xiangnan He, and Yidong Li. 2023. LightFR: Lightweight federated recommendation with privacy-preserving matrix factorization. ACM Transactions on Information Systems 41, 4 (2023), 1–28.
[78]
Honglei Zhang, Xin Zhou, Zhiqi Shen, and Yidong Li. 2024. PrivFR: Privacy-Enhanced Federated Recommendation With Shared Hash Embedding. IEEE Transactions on Neural Networks and Learning Systems (2024).
[79]
Xinrui He, Shuo Liu, Jacky Keung, and Jingrui He. 2024. Co-clustering for Federated Recommender System. In Proceedings of the ACM on Web Conference 2024. 3821–3832.
[80]
Guanyu Lin, Feng Liang, Weike Pan, and Zhong Ming. 2020. Fedrec: Federated recommendation with explicit feedback. IEEE Intelligent Systems 36, 5 (2020), 21–30.
[81]
Xuefei Yin, Yanming Zhu, and Jiankun Hu. 2021. A Comprehensive Survey of Privacy-Preserving Federated Learning: A Taxonomy, Review, and Future Directions. 54, 6 (2021). https://doi.org/10.1145/3460427
[82]
Cheng Jin, Xuandong Chen, Yi Gu, and Qun Li. 2023. FedDyn: A dynamic and efficient federated distillation approach on Recommender System. In 2022 IEEE 28th International Conference on Parallel and Distributed Systems (ICPADS). IEEE, 786–793.
[83]
Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, and Blaise Aguera y Arcas. 2017. Communication-efficient learning of deep networks from decentralized data. In Artificial intelligence and statistics. PMLR, 1273–1282.
[84]
Sashank Reddi, Zachary Charles, Manzil Zaheer, Zachary Garrett, Keith Rush, Jakub Konečnỳ, Sanjiv Kumar, and H Brendan McMahan. 2020. Adaptive federated optimization. arXiv preprint arXiv:2003.00295 (2020).
[85]
Borui Zhao, Quan Cui, Renjie Song, Yiyu Qiu, and Jiajun Liang. 2022. Decoupled knowledge distillation. In Proceedings of the IEEE/CVF Conference on computer vision and pattern recognition. 11953–11962.
[86]
Qinbin Li, Zeyi Wen, Zhaomin Wu, Sixu Hu, Naibo Wang, Yuan Li, Xu Liu, and Bingsheng He. 2021. A survey on federated learning systems: Vision, hype and reality for data privacy and protection. IEEE Transactions on Knowledge and Data Engineering (2021).
[87]
Vale Tolpegin, Stacey Truex, Mehmet Emre Gursoy, and Ling Liu. 2020. Data poisoning attacks against federated learning systems. In Computer Security–ESORICS 2020: 25th European Symposium on Research in Computer Security, ESORICS 2020, Guildford, UK, September 14–18, 2020, Proceedings, Part I 25. Springer, 480–501.
[88]
Matt Fredrikson, Somesh Jha, and Thomas Ristenpart. 2015. Model inversion attacks that exploit confidence information and basic countermeasures. In Proceedings of the 22nd ACM SIGSAC conference on computer and communications security. 1322–1333.
[89]
Jingwen Zhang, Jiale Zhang, Junjun Chen, and Shui Yu. 2020. Gan enhanced membership inference: A passive local attack in federated learning. In ICC 2020-2020 IEEE International Conference on Communications (ICC). IEEE, 1–6.
[90]
Cynthia Dwork. 2008. Differential privacy: A survey of results. In International conference on theory and applications of models of computation. Springer, 1–19.
[91]
Zhiqi Bu, Jinshuo Dong, Qi Long, and Weijie J Su. 2020. Deep learning with Gaussian differential privacy. Harvard data science review 2020, 23 (2020), 10–1162.
[92]
Rezak Aziz, Soumya Banerjee, Samia Bouzefrane, and Thinh Le Vinh. 2023. Exploring Homomorphic Encryption and Differential Privacy Techniques towards Secure Federated Learning Paradigm. Future internet 15, 9 (2023), 310.
[93]
Abbas Acar, Hidayet Aksu, A Selcuk Uluagac, and Mauro Conti. 2018. A survey on homomorphic encryption schemes: Theory and implementation. ACM Computing Surveys (Csur) 51, 4 (2018), 1–35.
[94]
Yehuda Lindell. 2020. Secure multiparty computation (MPC). Cryptology ePrint Archive (2020).
[95]
Darapureddy Devendra Kumar, Jerripothula Desai Mukharzee, Chirla Vijay Durga Reddy, and Shinu M Rajagopal. 2024. Safe and Secure Communication Using SSL/TLS. In 2024 International Conference on Emerging Smart Computing and Informatics (ESCI). IEEE, 1–6.
[96]
Min Xu, Xingtong Chen, and Gang Kou. 2019. A systematic review of blockchain. Financial innovation 5, 1 (2019), 1–14.
[97]
Jingdong Wang, Ting Zhang, Nicu Sebe, Heng Tao Shen, et al. 2017. A survey on learning to hash. IEEE transactions on pattern analysis and machine intelligence 40, 4 (2017), 769–790.
[98]
G Ahalya and Hari Mohan Pandey. 2015. Data clustering approaches survey and analysis. In 2015 International Conference on Futuristic Trends on Computational Analysis and Knowledge Management (ABLAZE). IEEE, 532–537.
[99]
Ashish Jaiswal, Ashwin Ramesh Babu, Mohammad Zaki Zadeh, Debapriya Banerjee, and Fillia Makedon. 2020. A survey on contrastive self-supervised learning. Technologies 9, 1 (2020), 2.
[100]
Timothy Hospedales, Antreas Antoniou, Paul Micaelli, and Amos Storkey. 2021. Meta-learning in neural networks: A survey. IEEE transactions on pattern analysis and machine intelligence 44, 9 (2021), 5149–5169.
[101]
Yeongwoo Kim, Ezeddin Al Hakim, Johan Haraldson, Henrik Eriksson, José Mairton B da Silva, and Carlo Fischione. 2021. Dynamic clustering in federated learning. In ICC 2021-IEEE International Conference on Communications. IEEE, 1–6.
[102]
Sudipto Guha, Rajeev Rastogi, and Kyuseok Shim. 1998. CURE: An efficient clustering algorithm for large databases. ACM Sigmod record 27, 2 (1998), 73–84.
[103]
Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-agnostic meta-learning for fast adaptation of deep networks. In International conference on machine learning. PMLR, 1126–1135.
[104]
Liang Qu, Ningzhi Tang, Ruiqi Zheng, Quoc Viet Hung Nguyen, Zi Huang, Yuhui Shi, and Hongzhi Yin. 2023. Semi-decentralized Federated Ego Graph Learning for Recommendation. arXiv preprint arXiv:2302.10900 (2023).
[105]
Junliang Yu, Hongzhi Yin, Jundong Li, Min Gao, Zi Huang, and Lizhen Cui. 2020. Enhancing social recommendation with adversarial graph convolutional networks. IEEE Transactions on knowledge and data engineering 34, 8 (2020), 3727–3739.
[106]
Jiangchao Yao, Feng Wang, Kunyang Jia, Bo Han, Jingren Zhou, and Hongxia Yang. 2021. Device-cloud collaborative learning for recommendation. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 3865–3874.
[107]
Han Cai, Chuang Gan, Ligeng Zhu, and Song Han. 2020. Tinytl: Reduce memory, not parameters for efficient on-device learning. Advances in Neural Information Processing Systems 33 (2020), 11285–11297.
[108]
Alexander Gepperth and Barbara Hammer. 2016. Incremental learning algorithms and applications. In European symposium on artificial neural networks (ESANN).
[109]
Jing Long, Guanhua Ye, Tong Chen, Yang Wang, Meng Wang, and Hongzhi Yin. 2024. Diffusion-Based Cloud-Edge-Device Collaborative Learning for Next POI Recommendations. arXiv preprint arXiv:2405.13811 (2024).
[110]
Hanqun Cao, Cheng Tan, Zhangyang Gao, Yilun Xu, Guangyong Chen, Pheng-Ann Heng, and Stan Z Li. 2024. A survey on generative diffusion models. IEEE Transactions on Knowledge and Data Engineering (2024).
[111]
Erika Duriakova, Elias Z Tragos, Barry Smyth, Neil Hurley, Francisco J Peña, Panagiotis Symeonidis, James Geraci, and Aonghus Lawlor. 2019. PDMFRec: a decentralised matrix factorisation with tunable user-centric privacy. In Proceedings of the 13th ACM Conference on Recommender Systems. 457–461.
[112]
István Hegedűs, Gábor Danner, and Márk Jelasity. 2019. Gossip learning as a decentralized alternative to federated learning. In Distributed Applications and Interoperable Systems: 19th IFIP WG 6.1 International Conference, DAIS 2019, Held as Part of the 14th International Federated Conference on Distributed Computing Techniques, DisCoTec 2019, Kongens Lyngby, Denmark, June 17–21, 2019, Proceedings 19. Springer, 74–90.
[113]
Yacine Belal, Aurélien Bellet, Sonia Ben Mokhtar, and Vlad Nitu. 2022. Pepper: Empowering user-centric recommender systems over gossip learning. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1–27.
[114]
Chaochao Chen, Ziqi Liu, Peilin Zhao, Jun Zhou, and Xiaolong Li. 2018. Privacy preserving point-of-interest recommendation using decentralized matrix factorization. In Proceedings of the AAAI conference on artificial intelligence, Vol. 32.
[115]
Jing Long, Tong Chen, Quoc Viet Hung Nguyen, and Hongzhi Yin. 2023. Decentralized collaborative learning framework for next POI recommendation. ACM Transactions on Information Systems 41, 3 (2023), 1–25.
[116]
Ruiqi Zheng, Liang Qu, Tong Chen, Lizhen Cui, Yuhui Shi, and Hongzhi Yin. 2024. Decentralized Collaborative Learning with Adaptive Reference Data for On-Device POI Recommendation. In Proceedings of the ACM on Web Conference 2024. 3930–3939.
[117]
Jing Long, Tong Chen, Quoc Viet Hung Nguyen, Guandong Xu, Kai Zheng, and Hongzhi Yin. 2023. Model-Agnostic Decentralized Collaborative Learning for On-Device POI Recommendation. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. 423–432.
[118]
Zhitao Li, Zhaohao Lin, Feng Liang, Weike Pan, Qiang Yang, and Zhong Ming. 2024. Decentralized Federated Recommendation with Privacy-Aware Structured Client-Level Graph. ACM Transactions on Intelligent Systems and Technology (2024).
[119]
Yifang Qin, Hongjun Wu, Wei Ju, Xiao Luo, and Ming Zhang. 2023. A diffusion model for poi recommendation. ACM Transactions on Information Systems 42, 2 (2023), 1–27.
[120]
Mohsen Jamali and Martin Ester. 2009. Trustwalker: a random walk model for combining trust-based and item-based recommendation. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining. 397–406.
[121]
Junliang Yu, Hongzhi Yin, Jundong Li, Min Gao, Zi Huang, and Lizhen Cui. 2020. Enhancing social recommendation with adversarial graph convolutional networks. IEEE Transactions on knowledge and data engineering 34, 8 (2020), 3727–3739.
[122]
Tim Van Erven and Peter Harremos. 2014. Rényi divergence and Kullback-Leibler divergence. IEEE Transactions on Information Theory 60, 7 (2014), 3797–3820.
[123]
Xiaolin Zheng, Zhongyu Wang, Chaochao Chen, Jiashu Qian, and Yao Yang. 2023. Decentralized graph neural network for privacy-preserving recommendation. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 3494–3504.
[124]
Michael R Sprague, Amir Jalalirad, Marco Scavuzzo, Catalin Capota, Moritz Neun, Lyman Do, and Michael Kopp. 2018. Asynchronous federated learning for geospatial applications. In Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 21–28.
[125]
Ruiting Zhou and Jieling Yu. 2023. A Reinforcement Learning Approach for Minimizing Job Completion Time in Clustered Federated Learning. In Proceedings of the ACM Turing Award Celebration Conference-China 2023. 55–56.
[126]
Chenhao Xu, Youyang Qu, Yong Xiang, and Longxiang Gao. 2023. Asynchronous federated learning on heterogeneous devices: A survey. Computer Science Review 50 (2023), 100595.
[127]
Feng Yan, Shreyas Sundaram, SVN Vishwanathan, and Yuan Qi. 2012. Distributed autonomous online learning: Regrets and intrinsic privacy-preserving properties. IEEE Transactions on Knowledge and Data Engineering 25, 11 (2012), 2483–2493.
[128]
Andreas Pfitzmann and Marit Köhntopp. 2001. Anonymity, unobservability, and pseudonymity—a proposal for terminology. In Designing Privacy Enhancing Technologies: International Workshop on Design Issues in Anonymity and Unobservability Berkeley, CA, USA, July 25–26, 2000 Proceedings. Springer, 1–9.
[129]
Yaochen Hu, Di Niu, Jianming Yang, and Shengping Zhou. 2019. FDML: A collaborative machine learning framework for distributed features. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2232–2240.
[130]
Yangfan Li, Kenli Li, Wei Wei, Tianyi Zhou, and Cen Chen. 2022. CoRec: An Efficient Internet Behavior-based Recommendation Framework with Edge-cloud Collaboration on Deep Convolution Neural Networks. ACM Transactions on Sensor Networks 19, 2 (2022), 1–28.
[131]
Yunjia Xi, Weiwen Liu, Yang Wang, Ruiming Tang, Weinan Zhang, Yue Zhu, Rui Zhang, and Yong Yu. 2023. On-device Integrated Re-ranking with Heterogeneous Behavior Modeling. In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 5225–5236.
[132]
Zexi Li, Qunwei Li, Yi Zhou, Wenliang Zhong, Guannan Zhang, and Chao Wu. 2023. Edge-Cloud Collaborative Learning with Federated and Centralized Features. Association for Computing Machinery, New York, NY, USA.
[133]
Michael Zhu and Suyog Gupta. 2017. To prune, or not to prune: exploring the efficacy of pruning for model compression. arXiv preprint arXiv:1710.01878 (2017).
[134]
Chenping Hou, Feiping Nie, Xuelong Li, Dongyun Yi, and Yi Wu. 2013. Joint embedding learning and sparse regression: A framework for unsupervised feature selection. IEEE transactions on cybernetics 44, 6 (2013), 793–804.
[135]
Siyu Gu, Xiang-Rong Sheng, Ying Fan, Guorui Zhou, and Xiaoqiang Zhu. 2021. Real negatives matter: Continuous training with real negatives for delayed feedback modeling. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 2890–2898.
[136]
Zhengyu Chen and Donglin Wang. 2021. Multi-initialization meta-learning with domain adaptation. In ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 1390–1394.
[137]
Aviv Shamsian, Aviv Navon, Ethan Fetaya, and Gal Chechik. 2021. Personalized federated learning using hypernetworks. In International Conference on Machine Learning. PMLR, 9489–9502.
[138]
Samuel S Ogden and Tian Guo. 2020. Mdinference: Balancing inference accuracy and latency for mobile applications. In 2020 IEEE International Conference on Cloud Engineering (IC2E). IEEE, 28–39.
[139]
Yilin Shen and Hongxia Jin. 2016. Epicrec: Towards practical differentially private framework for personalized recommendation. In Proceedings of the 2016 ACM SIGSAC conference on computer and communications security. 180–191.
[140]
Chengxiang Chen, Caizhong Li, and Yucong Duan. 2022. Mobile healthcare data mining for sport item recommendation in edge-cloud collaboration. Wireless Networks (2022), 1–11.
[141]
Fatih Cakir, Kun He, Sarah Adel Bargal, and Stan Sclaroff. 2017. Mihash: Online hashing with mutual information. In Proceedings of the IEEE international conference on computer vision. 437–445.
[142]
Yaqing Wang, Quanming Yao, James T Kwok, and Lionel M Ni. 2020. Generalizing from a few examples: A survey on few-shot learning. ACM computing surveys (csur) 53, 3 (2020), 1–34.
[143]
Yikai Yan, Chaoyue Niu, Renjie Gu, Fan Wu, Shaojie Tang, Lifeng Hua, Chengfei Lyu, and Guihai Chen. 2022. On-Device Learning for Model Personalization with Large-Scale Cloud-Coordinated Domain Adaption. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 2180–2190.
[144]
Renjie Gu, Chaoyue Niu, Yikai Yan, Fan Wu, Shaojie Tang, Rongfeng Jia, Chengfei Lyu, and Guihai Chen. 2022. On-Device Learning with Cloud-Coordinated Data Augmentation for Extreme Model Personalization in Recommender Systems. arXiv preprint arXiv:2201.10382 (2022).
[145]
Kashvi Taunk, Sanjukta De, Srishti Verma, and Aleena Swetapadma. 2019. A brief review of nearest neighbor algorithm for learning and classification. In 2019 international conference on intelligent computing and control systems (ICCS). IEEE, 1255–1260.
[146]
Xin Xia, Hongzhi Yin, Junliang Yu, Qinyong Wang, Guandong Xu, and Quoc Viet Hung Nguyen. 2022. On-device next-item recommendation with self-supervised knowledge distillation. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 546–555.
[147]
Xin Xia, Junliang Yu, Qinyong Wang, Chaoqun Yang, Nguyen Quoc Viet Hung, and Hongzhi Yin. 2023. Efficient on-device session-based recommendation. ACM Transactions on Information Systems 41, 4 (2023), 1–24.
[148]
Ivan V Oseledets. 2011. Tensor-train decomposition. SIAM Journal on Scientific Computing 33, 5 (2011), 2295–2317.
[149]
Hengling Zhao, Yipeng Liu, Xiaolin Huang, and Ce Zhu. 2021. Semi-tensor product-based tensordecomposition for neural network compression. arXiv preprint arXiv:2109.15200 (2021).
[150]
Jiaxi Tang and Ke Wang. 2018. Ranking distillation: Learning compact ranking models with high performance for recommender system. In Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining. 2289–2298.
[151]
Wonbin Kweon, SeongKu Kang, and Hwanjo Yu. 2021. Bidirectional distillation for top-K recommender system. In Proceedings of the Web Conference 2021. 3861–3871.
[152]
Ruiqi Zheng, Liang Qu, Tong Chen, Kai Zheng, Yuhui Shi, and Hongzhi Yin. 2024. Personalized Elastic Embedding Learning for On-Device Recommendation. IEEE Transactions on Knowledge and Data Engineering (2024).
[153]
Zheqi Lv, Zhengyu Chen, Shengyu Zhang, Kun Kuang, Wenqiao Zhang, Mengze Li, Beng Chin Ooi, and Fei Wu. 2023. Ideal: Toward high-efficiency device-cloud collaborative and dynamic recommendation system. arXiv preprint arXiv:2302.07335 (2023).
[154]
Xufeng Qian, Yue Xu, Fuyu Lv, Shengyu Zhang, Ziwen Jiang, Qingwen Liu, Xiaoyi Zeng, Tat-Seng Chua, and Fei Wu. 2022. Intelligent request strategy design in recommender system. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 3772–3782.
[155]
Jiangchao Yao, Feng Wang, Xichen Ding, Shaohu Chen, Bo Han, Jingren Zhou, and Hongxia Yang. 2022. Device-cloud collaborative recommendation via meta controller. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 4353–4362.
[156]
Liuyi Yao, Zhixuan Chu, Sheng Li, Yaliang Li, Jing Gao, and Aidong Zhang. 2021. A survey on causal inference. ACM Transactions on Knowledge Discovery from Data (TKDD) 15, 5 (2021), 1–46.
[157]
Dayong Ye, Sheng Shen, Tianqing Zhu, Bo Liu, and Wanlei Zhou. 2022. One parameter defense—defending against data inference attacks via differential privacy. IEEE Transactions on Information Forensics and Security 17 (2022), 1466–1480.
[158]
Ruiqi Zheng, Liang Qu, Tong Chen, Kai Zheng, Yuhui Shi, and Hongzhi Yin. 2024. Poisoning Decentralized Collaborative Recommender System and Its Countermeasures. arXiv:2404.01177 [cs.CR]
[159]
Ben Tan, Bo Liu, Vincent Zheng, and Qiang Yang. 2020. A federated recommender system for online services. In Proceedings of the 14th ACM conference on recommender systems. 579–581.
[160]
Tien T Nguyen, Pik-Mai Hui, F Maxwell Harper, Loren Terveen, and Joseph A Konstan. 2014. Exploring the filter bubble: the effect of using recommender systems on content diversity. In Proceedings of the 23rd international conference on World wide web. 677–686.
[161]
Zhe Fu, Xi Niu, and Mary Lou Maher. 2023. Deep learning models for serendipity recommendations: a survey and new perspectives. Comput. Surveys 56, 1 (2023), 1–26.
[162]
Chandrima Roy and Siddharth Swarup Rautaray. 2021. Challenges and issues of recommender system for big data applications. Trends of Data Science and Applications: Theory and Practices (2021), 327–341.
[163]
Jiwei Li, Hui Xu, Sheng-Yang Sun, Nan Li, Qingjiang Li, Zhiwei Li, and Haijun Liu. 2021. In situ learning in hardware compatible multilayer memristive spiking neural network. IEEE Transactions on Cognitive and Developmental Systems 14, 2 (2021), 448–461.
[164]
Takaya Saeki, Yuichi Nishiwaki, Takahiro Shinagawa, and Shinichi Honiden. 2020. A robust and flexible operating system compatibility architecture. In Proceedings of the 16th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments. 129–142.
[165]
Il-Chul Yoon, Alan Sussman, Atif Memon, and Adam Porter. 2008. Effective and scalable software compatibility testing. In Proceedings of the 2008 international symposium on Software testing and analysis. 63–74.
[166]
Evangelos Karakolis, Panagiotis Foivos Oikonomidis, and Dimitrios Askounis. 2022. Identifying and Addressing Ethical Challenges in Recommender Systems. In 2022 13th International Conference on Information, Intelligence, Systems & Applications (IISA). IEEE, 1–6.
[167]
Maximilian Lam, Gu-Yeon Wei, David Brooks, Vijay Janapa Reddi, and Michael Mitzenmacher. 2021. Gradient disaggregation: Breaking privacy in federated learning by reconstructing the user participant matrix. In International Conference on Machine Learning. PMLR, 5959–5968.
[168]
Zhitao Zhu, Shijing Si, Jianzong Wang, and Jing Xiao. 2022. Cali3f: Calibrated fast fair federated recommendation system. In 2022 International Joint Conference on Neural Networks (IJCNN). IEEE, 1–8.
[169]
Alejandro Bellogín and Alan Said. 2021. Improving accountability in recommender systems research through reproducibility. User Modeling and User-Adapted Interaction 31, 5 (2021), 941–977.
[170]
Shaina Raza and Chen Ding. 2019. Progress in context-aware recommender systems—An overview. Computer Science Review 31 (2019), 84–97.
[171]
Alistair Moffat. 2019. Huffman coding. ACM Computing Surveys (CSUR) 52, 4 (2019), 1–35.
[172]
Majid Rabbani and Rajan Joshi. 2002. An overview of the JPEG 2000 still image compression standard. Signal processing: Image communication 17, 1 (2002), 3–48.
[173]
Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage, and Anil Anthony Bharath. 2017. Deep reinforcement learning: A brief survey. IEEE Signal Processing Magazine 34, 6 (2017), 26–38.
[174]
Gido M Van de Ven and Andreas S Tolias. 2019. Three scenarios for continual learning. arXiv preprint arXiv:1904.07734 (2019).
[175]
Carol A Twigg. 2003. Models for online learning. Educause review 38 (2003), 28–38.
[176]
Yue Wu, Yinpeng Chen, Lijuan Wang, Yuancheng Ye, Zicheng Liu, Yandong Guo, and Yun Fu. 2019. Large scale incremental learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 374–382.
[177]
Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xiaolei Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, et al. 2023. A survey of large language models. arXiv preprint arXiv:2303.18223 (2023).
[178]
Lei Li, Yongfeng Zhang, and Li Chen. 2023. Prompt Distillation for Efficient LLM-based Recommendation (CIKM ’23). Association for Computing Machinery, New York, NY, USA.
[179]
Wenqi Fan, Zihuai Zhao, Jiatong Li, Yunqing Liu, Xiaowei Mei, Yiqi Wang, Jiliang Tang, and Qing Li. 2023. Recommender systems in the era of large language models (llms). arXiv preprint arXiv:2307.02046 (2023).
[180]
Amy Winograd. 2023. Loose-lipped large language models spill your secrets: The privacy implications of large language models. Harvard Journal of Law & Technology 36, 2 (2023).
[181]
Chaochao Chen, Xiaohua Feng, Jun Zhou, Jianwei Yin, and Xiaolin Zheng. 2023. Federated large language model: A position paper. arXiv preprint arXiv:2307.08925 (2023).
[182]
Yang Chen, Xiaoyan Sun, and Yaochu Jin. 2019. Communication-efficient federated deep learning with layerwise asynchronous model update and temporally weighted aggregation. IEEE transactions on neural networks and learning systems 31, 10 (2019), 4229–4238.
[183]
Yang Chen, Xiaoyan Sun, and Yaochu Jin. 2019. Communication-efficient federated deep learning with layerwise asynchronous model update and temporally weighted aggregation. IEEE transactions on neural networks and learning systems 31, 10 (2019), 4229–4238.
[184]
Lisa Torrey and Jude Shavlik. 2010. Transfer learning. In Handbook of research on machine learning applications and trends: algorithms, methods, and techniques. IGI global, 242–264.

Index Terms

  1. Distributed Recommendation Systems: Survey and Research Directions

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Transactions on Information Systems
    ACM Transactions on Information Systems Just Accepted
    EISSN:1558-2868
    Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Online AM: 06 September 2024
    Accepted: 24 August 2024
    Revised: 28 June 2024
    Received: 07 February 2024

    Check for updates

    Author Tags

    1. Distributed Recommendation Systems
    2. Device-Cloud Collaboration
    3. Federated Learning
    4. Model Deployment
    5. Task Assignment

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 229
      Total Downloads
    • Downloads (Last 12 months)229
    • Downloads (Last 6 weeks)229
    Reflects downloads up to 17 Oct 2024

    Other Metrics

    Citations

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Full Access

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media