Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Decentralized Collaborative Learning Framework for Next POI Recommendation

Published: 07 February 2023 Publication History
  • Get Citation Alerts
  • Abstract

    Next Point-of-Interest (POI) recommendation has become an indispensable functionality in Location-based Social Networks (LBSNs) due to its effectiveness in helping people decide the next POI to visit. However, accurate recommendation requires a vast amount of historical check-in data, thus threatening user privacy as the location-sensitive data needs to be handled by cloud servers. Although there have been several on-device frameworks for privacy-preserving POI recommendations, they are still resource intensive when it comes to storage and computation, and show limited robustness to the high sparsity of user-POI interactions. On this basis, we propose a novel decentralized collaborative learning framework for POI recommendation (DCLR), which allows users to train their personalized models locally in a collaborative manner. DCLR significantly reduces the local models’ dependence on the cloud for training, and can be used to expand arbitrary centralized recommendation models. To counteract the sparsity of on-device user data when learning each local model, we design two self-supervision signals to pretrain the POI representations on the server with geographical and categorical correlations of POIs. To facilitate collaborative learning, we innovatively propose to incorporate knowledge from either geographically or semantically similar users into each local model with attentive aggregation and mutual information maximization. The collaborative learning process makes use of communications between devices while requiring only minor engagement from the central server for identifying user groups, and is compatible with common privacy preservation mechanisms like differential privacy. We evaluate DCLR with two real-world datasets, where the results show that DCLR outperforms state-of-the-art on-device frameworks and yields competitive results compared with centralized counterparts.

    References

    [1]
    Zdravko I. Botev, Joseph F. Grotowski, and Dirk P. Kroese. 2010. Kernel density estimation via diffusion. Annals of Statistics 38, 5 (2010), 2916–2957.
    [2]
    Buru Chang, Yonggyu Park, Donghyeon Park, Seongsoon Kim, and Jaewoo Kang. 2018. Content-aware hierarchical point-of-interest embedding model for successive POI recommendation. In International Joint Conferences on Artificial Intelligence (IJCAI’22). 3301–3307.
    [3]
    Chaochao Chen, Ziqi Liu, Peilin Zhao, Jun Zhou, and Xiaolong Li. 2018. Privacy preserving point-of-interest recommendation using decentralized matrix factorization. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32. No. 1.
    [4]
    Hongxu Chen, Hongzhi Yin, Xiangguo Sun, Tong Chen, Bogdan Gabrys, and Katarzyna Musial. 2020. Multi-level graph convolutional networks for cross-platform anchor link prediction. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1503–1511.
    [5]
    Chen Cheng, Haiqin Yang, Michael R. Lyu, and Irwin King. 2013. Where you like to go next: Successive point-of-interest recommendation. In Proceedings of the 23rd International Joint Conference on Artificial Intelligence (IJCAI’13). AAAI Press, 2605–2611.
    [6]
    Jack N. Davies, Graeme E. Hobson, and W. B. McGlasson. 1981. The constituents of tomato fruit—the influence of environment, nutrition, and genotype. Critical Reviews in Food Science & Nutrition 15, 3 (1981), 205–280.
    [7]
    Erika Duriakova, Elias Z. Tragos, Barry Smyth, Neil Hurley, Francisco J. Peña, Panagiotis Symeonidis, James Geraci, and Aonghus Lawlor. 2019. PDMFRec: A decentralised matrix factorisation with tunable user-centric privacy. In Proceedings of the 13th ACM Conference on Recommender Systems. 457–461.
    [8]
    Cynthia Dwork, Aaron Roth, et al. 2014. The algorithmic foundations of differential privacy. Foundations and Trends in Theoretical Computer Science 9, 3–4 (2014), 211–407.
    [9]
    Mingming Fan and Maryam Khademi. 2014. Predicting a business star in Yelp from its reviews text alone. CoRR abs/1401.0864 (2014). arXiv:1401.0864http://arxiv.org/abs/1401.0864.
    [10]
    Jie Feng, Yong Li, Chao Zhang, Funing Sun, Fanchao Meng, Ang Guo, and Depeng Jin. 2018. DeepMove: Predicting human mobility with attentional recurrent networks. In Proceedings of the 2018 World Wide Web Conference (WWW’18). 1459–1468.
    [11]
    Andrea Giantomassi, Francesco Ferracuti, Sabrina Iarlori, Gianluca Ippoliti, and Sauro Longhi. 2015. Electric motor fault detection and diagnosis by kernel density estimation and Kullback-Leibler divergence based on stator current measurements. IEEE Transactions on Industrial Electronics 62 (2015), 1770–1780.
    [12]
    Qing Guo, Zhu Sun, Jie Zhang, and Yin-Leng Theng. 2020. An attentional recurrent neural network for personalized next location recommendation. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 83–90.
    [13]
    Yeting Guo, Fang Liu, Zhiping Cai, Hui Zeng, Li Chen, Tongqing Zhou, and Nong Xiao. 2021. PREFER: Point-of-interest REcommendation with efficiency and privacy-preservation via federated edge learning. Proceedings of ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1 (2021), 1–25.
    [14]
    Peng Han, Zhongxiao Li, Yong Liu, Peilin Zhao, Jing Li, Hao Wang, and Shuo Shang. 2020. Contextualized point-of-interest recommendation. In International Joint Conferences on Artificial Intelligence, Article 344. 2484–2490.
    [15]
    Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation 9, 8 (1997), 1735–1780.
    [16]
    Gordon Hull, Heather Richter Lipford, and Celine Latulipe. 2010. Contextual gaps: Privacy issues on facebook. Ethics and Information Technology 13, 4 (2010), 289–302.
    [17]
    Dileep Kalathil, Naumaan Nayyar, and Rahul Jain. 2014. Decentralized learning for multiplayer multiarmed bandits. IEEE Transactions on Information Theory 60, 4 (2014), 2331–2345.
    [18]
    Wang-Cheng Kang and Julian McAuley. 2018. Self-attentive sequential recommendation. In 2018 IEEE International Conference on Data Mining (ICDM’18). IEEE, 197–206.
    [19]
    Lingpeng Kong, Cyprien de Masson d’Autume, Wang Ling, Lei Yu, Zihang Dai, and Dani Yogatama. 2019. A mutual information maximization perspective of language representation learning. arXiv preprint arXiv:1910.08350 (2019).
    [20]
    Walid Krichene and Steffen Rendle. 2020. On sampled metrics for item recommendation. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1748–1757.
    [21]
    Cong Leng, Jiaxiang Wu, Jian Cheng, Xi Zhang, and Hanqing Lu. 2015. Hashing for distributed data. In International Conference on Machine Learning. PMLR, 1642–1650.
    [22]
    Ranzhen Li, Yanyan Shen, and Yanmin Zhu. 2018. Next point-of-interest recommendation with temporal and multi-level context attention. In 2018 IEEE International Conference on Data Mining (ICDM’18). 1110–1115.
    [23]
    Yang Li, Tong Chen, Hongzhi Yin, and Zi Huang. 2021. Discovering collaborative signals for next POI recommendation with iterative seq2graph augmentation. arXiv: arXiv preprint arXiv:2106.15814.
    [24]
    Defu Lian, Yongji Wu, Yong Ge, Xing Xie, and Enhong Chen. 2020. Geography-Aware Sequential Location Recommendation. Association for Computing Machinery, New York, NY, 2009–2019.
    [25]
    Defu Lian, Cong Zhao, Xing Xie, Guangzhong Sun, Enhong Chen, and Yong Rui. 2014. GeoMF: Joint geographical modeling and matrix factorization for point-of-interest recommendation. In Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’14). Association for Computing Machinery, New York, NY, 831–840.
    [26]
    Yongjun Liao, Pierre Geurts, and Guy Leduc. 2010. Network distance prediction based on decentralized matrix factorization. In International Conference on Research in Networking. Springer, 15–26.
    [27]
    Qiang Liu, Shu Wu, Liang Wang, and Tieniu Tan. 2016. Predicting the next location: A recurrent model with spatial and temporal contexts. In Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI’16). AAAI Press, 194–200.
    [28]
    Xin Liu, Yong Liu, Karl Aberer, and Chunyan Miao. 2013. Personalized point-of-interest recommendation by mining users’ preference transition. In Proceedings of the 22nd ACM International Conference on Information & Knowledge Management. 733–738.
    [29]
    Yong Liu, Wei Wei, Aixin Sun, and Chunyan Miao. 2014. Exploiting geographical neighborhood characteristics for location recommendation. In Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management. 739–748.
    [30]
    Yan Long, Pengpeng Zhao, Victor S. Sheng, Guanfeng Liu, Jiajie Xu, Jian Wu, and Zhiming Cui. 2017. Social personalized ranking embedding for Next POI recommendation. In Web Information Systems Engineering (WISE’17). Lecture Notes in Computer Science, Vol. 10569. Springer International Publishing, Cham, 91–105.
    [31]
    Yingtao Luo, Qiang Liu, and Zhaocheng Liu. 2021. STAN: Spatio-temporal attention network for next location recommendation. In Proceedings of the 2021 World Wide Web Conference (WWW’21). 2177–2185.
    [32]
    James MacQueen et al. 1967. Some methods for classification and analysis of multivariate observations. In Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, Vol. 1. Oakland, CA, 281–297.
    [33]
    A. Narayanan and V. Shmatikov. 2008. Robust de-anonymization of large sparse datasets. In 2008 IEEE Symposium on Security and Privacy (SP’08). IEEE, 111–125.
    [34]
    Quoc Viet Hung Nguyen, Chi Thang Duong, Thanh Tam Nguyen, Matthias Weidlich, Karl Aberer, Hongzhi Yin, and Xiaofang Zhou. 2017. Argument discovery via crowdsourcing. VLDB Journal 26, 4 (2017), 511–535.
    [35]
    Quoc Viet Hung Nguyen, Huu Viet Huynh, Thanh Tam Nguyen, Matthias Weidlich, Hongzhi Yin, and Xiaofang Zhou. 2018. Computing crowd consensus with partial agreement. In 2018 IEEE 34th International Conference on Data Engineering (ICDE’18). 1749–1750.
    [36]
    Thanh Tam Nguyen, Chi Thang Duong, Matthias Weidlich, Hongzhi Yin, and Quoc Viet Hung Nguyen. 2017. Retaining data from streams of social platforms with minimal regret. In 26th International Joint Conference on Artificial Intelligence. 2850–2856.
    [37]
    Jinmeng Rao, Song Gao, Mingxiao Li, and Qunying Huang. 2021. A privacy-preserving framework for location recommendation using decentralized collaborative machine learning. Transactions in GIS 25, 3 (2021), 1153–1175.
    [38]
    Steffen Rendle. 2012. Factorization machines with libFM. ACM Transactions on Intelligent Systems and Technology 3, 3 (2012), 1–22.
    [39]
    C. Robusto. 1957. The cosine-haversine formula. American Mathematical Monthly 64 (1957), 38.
    [40]
    Qinyong Wang, Hongzhi Yin, Tong Chen, Zi Huang, Hao Wang, Yanchang Zhao, and Nguyen Quoc Viet Hung. 2020. Next point-of-interest recommendation on resource-constrained mobile devices. In Proceedings of the Web Conference 2020 (WWW’20). ACM, 906–916.
    [41]
    Qinyong Wang, Hongzhi Yin, Tong Chen, Junliang Yu, Alexander Zhou, and Xiangliang Zhang. 2021. Fast-adapting and privacy-preserving federated recommender system. The International Journal on Very Large Data Bases (2021), 1–20.
    [42]
    Qinyong Wang, Hongzhi Yin, Zhiting Hu, Defu Lian, Hao Wang, and Zi Huang. 2018. Neural memory streaming recommender networks with adversarial training. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2467–2475.
    [43]
    Qinyong Wang, Hongzhi Yin, Hao Wang, Quoc Viet Hung Nguyen, Zi Huang, and Lizhen Cui. 2019. Enhancing collaborative filtering with generative augmentation. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 548–556.
    [44]
    Xiwei Wang, Minh Nguyen, Jonathan Carr, Longyin Cui, and Kiho Lim. 2020. A group preference-based privacy-preserving POI recommender system. Information & Communications Technology Express 6, 3 (2020), 204–208.
    [45]
    Kang Wei, Jun Li, Ming Ding, Chuan Ma, Howard H. Yang, Farhad Farokhi, Shi Jin, Tony Q. S. Quek, and H. Vincent Poor. 2020. Federated learning with differential privacy: Algorithms and performance analysis. IEEE Transactions on Information Forensics and Security 15 (2020), 3454–3469.
    [46]
    Markus Weimer, Alexandros Karatzoglou, Quoc Le, and Alex Smola. 2007. Cofi rank-maximum margin matrix factorization for collaborative ranking. Advances in Neural Information Processing Systems 20 (2007), 1593–1600.
    [47]
    Di Yao, Chao Zhang, Jianhui Huang, and Jingping Bi. 2017. Serm: A recurrent model for next location prediction in semantic trajectories. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 2411–2414.
    [48]
    Guanhua Ye, Hongzhi Yin, Tong Chen, Miao Xu, Quoc Viet Hung Nguyen, and Jiangning Song. 2022. Personalized on-device e-health analytics with decentralized block coordinate descent. IEEE Journal of Biomedical and Health Informatics 26, 6 (2022), 2778–2786.
    [49]
    Junliang Yu, Min Gao, Hongzhi Yin, Jundong Li, Chongming Gao, and Qinyong Wang. 2019. Generating reliable friends via adversarial training to improve social recommendation. In 2019 IEEE International Conference on Data Mining (ICDM’19). IEEE, 768–777.
    [50]
    Junliang Yu, Hongzhi Yin, Jundong Li, Min Gao, Zi Huang, and Lizhen Cui. 2020. Enhance social recommendation with adversarial graph convolutional networks. IEEE Transactions on Knowledge and Data Engineering 34 (2020), 3727–3739.
    [51]
    Chen Zhang, Yu Xie, Hang Bai, Bin Yu, Weihong Li, and Yuan Gao. 2021. A survey on federated learning. Knowledge-Based Systems 216 (2021), 106775.
    [52]
    Kangzhi Zhao, Yong Zhang, Hongzhi Yin, Jin Wang, Kai Zheng, Xiaofang Zhou, and Chunxiao Xing. 2020. Discovering subsequence patterns for next POI recommendation. In IJCAI. 3216–3222.
    [53]
    Pengpeng Zhao, Anjing Luo, Yanchi Liu, Fuzhen Zhuang, Jiajie Xu, Zhixu Li, Victor S. Sheng, and Xiaofang Zhou. 2020. Where to go next: A spatio-temporal gated network for next POI recommendation. IEEE Transactions on Knowledge and Data Engineering 34, 5 (2020), 2512–2524.
    [54]
    Shenglin Zhao, Michael R. Lyu, and Irwin King. 2018. STELLAR: Spatial-temporal latent ranking model for successive POI recommendation. In Point-of-Interest Recommendation in Location-Based Social Networks. Springer Singapore, Singapore, 79–94.
    [55]
    Kun Zhou, Hui Wang, Wayne Xin Zhao, Yutao Zhu, Sirui Wang, Fuzheng Zhang, Zhongyuan Wang, and Ji-Rong Wen. 2020. S3-rec: Self-supervised learning for sequential recommendation with mutual information maximization. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 1893–1902.

    Cited By

    View all
    • (2024)Recency-based spatio-temporal similarity exploration for POI recommendation in location-based social networksFrontiers in Sustainable Cities10.3389/frsc.2024.13316426Online publication date: 24-Apr-2024
    • (2024)Privacy-Preserving Individual-Level COVID-19 Infection Prediction via Federated Graph LearningACM Transactions on Information Systems10.1145/363320242:3(1-29)Online publication date: 22-Jan-2024
    • (2024)On-Device Recommender Systems: A Tutorial on The New-Generation Recommendation ParadigmCompanion Proceedings of the ACM on Web Conference 202410.1145/3589335.3641250(1280-1283)Online publication date: 13-May-2024
    • Show More Cited By

    Index Terms

    1. Decentralized Collaborative Learning Framework for Next POI Recommendation

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Information Systems
      ACM Transactions on Information Systems  Volume 41, Issue 3
      July 2023
      890 pages
      ISSN:1046-8188
      EISSN:1558-2868
      DOI:10.1145/3582880
      Issue’s Table of Contents

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 07 February 2023
      Online AM: 08 August 2022
      Accepted: 29 July 2022
      Revised: 21 June 2022
      Received: 05 April 2022
      Published in TOIS Volume 41, Issue 3

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. Point-of-Interest recommendation
      2. decentralized collaborative learning
      3. user privacy

      Qualifiers

      • Research-article
      • Refereed

      Funding Sources

      • Australian Research Council Future Fellowship
      • Discovery Project
      • Discovery Early Career Research Award

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)762
      • Downloads (Last 6 weeks)45

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Recency-based spatio-temporal similarity exploration for POI recommendation in location-based social networksFrontiers in Sustainable Cities10.3389/frsc.2024.13316426Online publication date: 24-Apr-2024
      • (2024)Privacy-Preserving Individual-Level COVID-19 Infection Prediction via Federated Graph LearningACM Transactions on Information Systems10.1145/363320242:3(1-29)Online publication date: 22-Jan-2024
      • (2024)On-Device Recommender Systems: A Tutorial on The New-Generation Recommendation ParadigmCompanion Proceedings of the ACM on Web Conference 202410.1145/3589335.3641250(1280-1283)Online publication date: 13-May-2024
      • (2024)Personalized Elastic Embedding Learning for On-Device RecommendationIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.336156236:7(3363-3375)Online publication date: Jul-2024
      • (2024)FedDist-POIRec: Federated Distillation for Point-Of-Interest Recommendation in Human Mobility Prediction2024 IEEE 4th International Conference on Human-Machine Systems (ICHMS)10.1109/ICHMS59971.2024.10555827(1-6)Online publication date: 15-May-2024
      • (2024)Heterogeneous decentralised machine unlearning with seed model distillationCAAI Transactions on Intelligence Technology10.1049/cit2.122819:3(608-619)Online publication date: 17-Jan-2024
      • (2024)A Comprehensive Survey on Deep Graph Representation LearningNeural Networks10.1016/j.neunet.2024.106207173(106207)Online publication date: May-2024
      • (2024)Practical and privacy-preserving geo-social-based POI recommendationJournal of Information and Intelligence10.1016/j.jiixd.2024.01.0012:2(148-166)Online publication date: Mar-2024
      • (2024)Limits of predictability in top-N recommendationInformation Processing & Management10.1016/j.ipm.2024.10373161:4(103731)Online publication date: Jul-2024
      • (2024)Graph gating-mixer for sequential recommendationExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.122060238:PDOnline publication date: 27-Feb-2024
      • Show More Cited By

      View Options

      Get Access

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      HTML Format

      View this article in HTML Format.

      HTML Format

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media