Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3589334.3645469acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

COLA: Cross-city Mobility Transformer for Human Trajectory Simulation

Published: 13 May 2024 Publication History

Abstract

Human trajectory data produced by daily mobile devices has proven its usefulness in various substantial fields such as urban planning and epidemic prevention. In terms of the individual privacy concern, human trajectory simulation has attracted increasing attention from researchers, targeting at offering numerous realistic mobility data for downstream tasks. Nevertheless, the prevalent issue of data scarcity undoubtedly degrades the reliability of existing deep learning models. In this paper, we are motivated to explore the intriguing problem of mobility transfer across cities, grasping the universal patterns of human trajectories to augment the powerful Transformer with external mobility data. There are two crucial challenges arising in the knowledge transfer across cities: 1) how to transfer the Transformer to adapt for domain heterogeneity; 2) how to calibrate the Transformer to adapt for subtly different long-tail frequency distributions of locations. To address these challenges, we have tailored a Cross-city mObiLity trAnsformer (COLA) with a dedicated model-agnostic transfer framework by effectively transferring cross-city knowledge for human trajectory simulation. Firstly, COLA divides the Transformer into the private modules for city-specific characteristics and the shared modules for city-universal mobility patterns. Secondly, COLA leverages a lightweight yet effective post-hoc adjustment strategy for trajectory simulation, without disturbing the complex bi-level optimization of model-agnostic knowledge transfer. Extensive experiments of COLA compared to state-of-the-art single-city baselines and our implemented cross-city baselines have demonstrated its superiority and effectiveness. The code is available at https://github.com/Star607/Cross-city-Mobility-Transformer.

Supplemental Material

MP4 File
Supplemental video

References

[1]
Di Chai, Leye Wang, and Qiang Yang. 2018. Bike flow prediction with multi-graph convolutional networks. In ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems.
[2]
Di Chai, Leye Wang, Junxue Zhang, Liu Yang, Shuowei Cai, Kai Chen, and Qiang Yang. 2022. Practical Lossless Federated Singular Vector Decomposition over Billion-Scale Data. In ACM Knowledge Discovery and Data Mining.
[3]
Serina Chang, Emma Pierson, Pang Wei Koh, Jaline Gerardin, Beth Redbird, David Grusky, and Jure Leskovec. 2021. Mobility network models of COVID-19 explain inequities and inform reopening. Nature, Vol. 589, 7840 (2021), 82--87.
[4]
Nitesh V Chawla, Kevin W Bowyer, Lawrence O Hall, and W Philip Kegelmeyer. 2002. SMOTE: synthetic minority over-sampling technique. Journal of Artificial Intelligence Research, Vol. 16 (2002), 321--357.
[5]
Jiawei Chen, Hande Dong, Xiang Wang, Fuli Feng, Meng Wang, and Xiangnan He. 2023. Bias and debias in recommender system: A survey and future directions. ACM Transactions on Information Systems, Vol. 41, 3 (2023), 1--39.
[6]
Seongjin Choi, Jiwon Kim, and Hwasoo Yeo. 2021. TrajGAIL: Generating urban vehicle trajectories using generative adversarial imitation learning. Transportation Research Part C: Emerging Technologies, Vol. 128 (2021), 103091.
[7]
Charles Elkan. 2001. The foundations of cost-sensitive learning. In International Joint Conference on Artificial Intelligence.
[8]
Wei Fan, Shun Zheng, Xiaohan Yi, Wei Cao, Yanjie Fu, Jiang Bian, and Tie-Yan Liu. 2022. DEPTS: deep expansion learning for periodic time series forecasting. International Conference on Learning Representations (2022).
[9]
Jie Feng, Yong Li, Chao Zhang, Funing Sun, Fanchao Meng, Ang Guo, and Depeng Jin. 2018. Deepmove: Predicting human mobility with attentional recurrent networks. In International World Wide Web Conferences.
[10]
Jie Feng, Zeyu Yang, Fengli Xu, Haisu Yu, Mudan Wang, and Yong Li. 2020. Learning to simulate human mobility. In ACM Knowledge Discovery and Data Mining.
[11]
Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-agnostic meta-learning for fast adaptation of deep networks. In International Conference on Machine Learning.
[12]
Bent Fuglede and Flemming Topsoe. 2004. Jensen-Shannon divergence and Hilbert space embedding. In IEEE International Symposium on Information Theory.
[13]
Sebastien Gambs, Marc-Olivier Killijian, and Miguel Nunez del Prado Cortez. 2012. Next place prediction using mobility markov chains. In Proceedings of the First Workshop on Measurement, Privacy, and Mobility.
[14]
Qiang Gao, Fan Zhou, Ting Zhong, Goce Trajcevski, Xin Yang, and Tianrui Li. 2022. Contextual Spatio-Temporal Graph Representation Learning for Reinforced Human Mobility Mining. Information Sciences, Vol. 606 (2022), 230--249.
[15]
Xu Geng, Yilun Jin, Zhengfei Zheng, Yu Yang, Yexin Li, Han Tian, Peibo Duan, Leye Wang, Jiannong Cao, Hai Yang, et al. 2021. CityNet: A Multi-city Multi-modal Dataset for Smart City Applications. arXiv preprint arXiv:2106.15802 (2021).
[16]
Xu Geng, Yaguang Li, Leye Wang, Lingyu Zhang, Qiang Yang, Jieping Ye, and Yan Liu. 2019. Spatiotemporal Multi-Graph Convolution Network for Ride-Hailing Demand Forecasting. In AAAI Conference on Artificial Intelligence.
[17]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2020. Generative adversarial networks. Commun. ACM, Vol. 63, 11 (2020), 139--144.
[18]
Chuan Guo, Geoff Pleiss, Yu Sun, and Kilian Q Weinberger. 2017. On calibration of modern neural networks. In International Conference on Machine Learning.
[19]
Tianfu He, Jie Bao, Ruiyuan Li, Sijie Ruan, Yanhua Li, Li Song, Hui He, and Yu Zheng. 2020. What is the Human Mobility in a New City: Transfer Mobility Knowledge Across Cities. In International World Wide Web Conferences.
[20]
Sepp Hochreiter and Jurgen Schmidhuber. 1997. Long short-term memory. Neural computation, Vol. 9, 8 (1997), 1735--1780.
[21]
Youngkyu Hong, Seungju Han, Kwanghee Choi, Seokjun Seo, Beomsu Kim, and Buru Chang. 2021. Disentangling label distribution for long-tailed visual recognition. In IEEE Conference on Computer Vision and Pattern Recognition.
[22]
Renhe Jiang, Zhaonan Wang, Jiawei Yong, Puneet Jeph, Quanjun Chen, Yasumasa Kobayashi, Xuan Song, Shintaro Fukushima, and Toyotaro Suzumura. 2023. Spatio-temporal meta-graph learning for traffic forecasting. In AAAI Conference on Artificial Intelligence.
[23]
Xiaoyong Jin, Youngsuk Park, Danielle Maddix, Hao Wang, and Yuyang Wang. 2022b. Domain adaptation for time series forecasting via attention sharing. In International Conference on Machine Learning.
[24]
Yilun Jin, Kai Chen, and Qiang Yang. 2022a. Selective Cross-City Transfer Learning for Traffic Prediction via Source City Region Re-Weighting. In ACM Knowledge Discovery and Data Mining.
[25]
Xu-Ying Liu, Jianxin Wu, and Zhi-Hua Zhou. 2008. Exploratory undersampling for class-imbalance learning. IEEE Transactions on Systems, Man, and Cybernetics: Systems, Vol. 39, 2 (2008), 539--550.
[26]
Aditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat, Himanshu Jain, Andreas Veit, and Sanjiv Kumar. 2021. Long-tail learning via logit adjustment. In International Conference on Learning Representations.
[27]
Kun Ouyang, Reza Shokri, David S Rosenblum, and Wenzhuo Yang. 2018. A non-parametric generative model for human trajectories. In International Joint Conference on Artificial Intelligence.
[28]
George Panagopoulos, Giannis Nikolentzos, and Michalis Vazirgiannis. 2021. Transfer graph neural networks for pandemic forecasting. In AAAI Conference on Artificial Intelligence.
[29]
Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al. 2018. Improving language understanding by generative pre-training. (2018).
[30]
Zezhi Shao, Zhao Zhang, Wei Wei, Fei Wang, Yongjun Xu, Xin Cao, and Christian S Jensen. 2022. Decoupled Dynamic Spatial-Temporal Graph Neural Network for Traffic Forecasting. The VLDB Journal, Vol. 15, 11 (2022), 2733--2746.
[31]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Annual Conference on Neural Information Processing Systems.
[32]
Srinivasan Venkatramanan, Adam Sadilek, Arindam Fadikar, Christopher L Barrett, Matthew Biggerstaff, Jiangzhuo Chen, Xerxes Dotiwalla, Paul Eastham, Bryant Gipson, Dave Higdon, et al. 2021. Forecasting influenza activity using machine-learned mobility map. Nature communications, Vol. 12, 1 (2021), 1--12.
[33]
Dongjie Wang, Lingfei Wu, Denghui Zhang, Jingbo Zhou, Leilei Sun, and Yanjie Fu. 2023. Human-instructed Deep Hierarchical Generative Learning for Automated Urban Planning. In AAAI Conference on Artificial Intelligence.
[34]
Jingyuan Wang, Jiawei Jiang, Wenjun Jiang, Chao Li, and Wayne Xin Zhao. 2021. LibCity: An Open Library for Traffic Prediction. In ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems.
[35]
Leye Wang, Xu Geng, Xiaojuan Ma, Feng Liu, and Qiang Yang. 2019. Cross-city transfer learning for deep spatio-temporal prediction. In International Joint Conference on Artificial Intelligence.
[36]
Ying Wei, Yu Zheng, and Qiang Yang. 2016. Transfer knowledge between cities. In ACM Knowledge Discovery and Data Mining.
[37]
Junkang Wu, Jiawei Chen, Jiancan Wu, Wentao Shi, Xiang Wang, and Xiangnan He. 2023. Understanding Contrastive Learning via Distributionally Robust Optimization. In Annual Conference on Neural Information Processing Systems.
[38]
Tong Wu, Ziwei Liu, Qingqiu Huang, Yu Wang, and Dahua Lin. 2021. Adversarial robustness under long-tailed distribution. In IEEE Conference on Computer Vision and Pattern Recognition.
[39]
Takahiro Yabe, Kota Tsubouchi, Toru Shimizu, Yoshihide Sekimoto, Kaoru Sezaki, Esteban Moro, and Alex Pentland. 2023. Metropolitan Scale and Longitudinal Dataset of Anonymized Human Mobility Trajectories. arXiv preprint arXiv:2307.03401 (2023).
[40]
Dingqi Yang, Daqing Zhang, and Bingqing Qu. 2016. Participatory cultural mapping based on collective behavior data in location-based social networks. ACM Transactions on Intelligent Systems and Technology, Vol. 7, 3 (2016), 1--23.
[41]
Huaxiu Yao, Yiding Liu, Ying Wei, Xianfeng Tang, and Zhenhui Li. 2019. Learning from multiple cities: A meta-learning approach for spatial-temporal prediction. In International World Wide Web Conferences.
[42]
Mogeng Yin, Madeleine Sheehan, Sidney Feygin, Jean-Francc ois Paiement, and Alexei Pozdnoukhov. 2017. A generative model of urban activities from cellular data. IEEE Transactions on Intelligent Transportation Systems, Vol. 19, 6 (2017), 1682--1696.
[43]
Lantao Yu, Weinan Zhang, Jun Wang, and Yong Yu. 2017. Seqgan: Sequence generative adversarial nets with policy gradient. In AAAI Conference on Artificial Intelligence.
[44]
Yuan Yuan, Jingtao Ding, Huandong Wang, Depeng Jin, and Yong Li. 2022. Activity trajectory generation via modeling spatiotemporal dynamics. In ACM Knowledge Discovery and Data Mining.
[45]
Yuan Yuan, Huandong Wang, Jingtao Ding, Depeng Jin, and Yong Li. 2023. Learning to Simulate Daily Activities via Modeling Dynamic Human Needs. In International World Wide Web Conferences.
[46]
Liang Zhang, Cheng Long, and Gao Cong. 2023 b. Region Embedding With Intra and Inter-View Contrastive Learning. IEEE Transactions on Knowledge and Data Engineering, Vol. 35, 9 (2023), 9031--9036.
[47]
Pengfei Zhang, Haris N Koutsopoulos, and Zhenliang Ma. 2023 a. DeepTrip: A Deep Learning Model for the Individual Next Trip Prediction With Arbitrary Prediction Times. IEEE Transactions on Intelligent Transportation Systems, Vol. 24, 6 (2023), 5842--5855.
[48]
Yifan Zhang, Peilin Zhao, Shuaicheng Niu, Qingyao Wu, Jiezhang Cao, Junzhou Huang, and Mingkui Tan. 2019. Online adaptive asymmetric active learning with limited budgets. IEEE Transactions on Knowledge and Data Engineering, Vol. 33, 6 (2019), 2680--2692.
[49]
Zizhao Zhang and Tomas Pfister. 2021. Learning fast sample re-weighting without reward data. In IEEE Conference on Computer Vision and Pattern Recognition.
[50]
Peilin Zhao, Yifan Zhang, Min Wu, Steven CH Hoi, Mingkui Tan, and Junzhou Huang. 2018. Adaptive cost-sensitive online classification. IEEE Transactions on Knowledge and Data Engineering, Vol. 31, 2 (2018), 214--228.
[51]
Yu Zheng, Xing Xie, Wei-Ying Ma, et al. 2010. GeoLife: A collaborative social networking service among user, location and trajectory. IEEE Data Eng. Bull., Vol. 33, 2 (2010), 32--39.

Index Terms

  1. COLA: Cross-city Mobility Transformer for Human Trajectory Simulation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    WWW '24: Proceedings of the ACM Web Conference 2024
    May 2024
    4826 pages
    ISBN:9798400701719
    DOI:10.1145/3589334
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 13 May 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. human mobility
    2. simulation
    3. transfer learning
    4. transformer

    Qualifiers

    • Research-article

    Funding Sources

    • The advanced computing resources provided by the Supercomputing Center of Hangzhou City University
    • Ningbo Natural Science Foundation
    • Guangzhou-HKUST (GZ) Joint Funding Program
    • Zhejiang Province High-Level Talents Special Support Program Leading Talent of Technological Innovation of Ten-Thousands Talents Program
    • National Natural Science Foundation of China
    • Zhejiang Province Pioneering Soldier and Leading Goose R&D Project
    • The Starry Night Science Fund of Zhejiang University Shanghai Institute for Advanced Study

    Conference

    WWW '24
    Sponsor:
    WWW '24: The ACM Web Conference 2024
    May 13 - 17, 2024
    Singapore, Singapore

    Acceptance Rates

    Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 171
      Total Downloads
    • Downloads (Last 12 months)171
    • Downloads (Last 6 weeks)46
    Reflects downloads up to 13 Sep 2024

    Other Metrics

    Citations

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media