Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3308558.3313577acmotherconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article

Learning from Multiple Cities: A Meta-Learning Approach for Spatial-Temporal Prediction

Published: 13 May 2019 Publication History

Abstract

Spatial-temporal prediction is a fundamental problem for constructing smart city, which is useful for tasks such as traffic control, taxi dispatching, and environment policy making. Due to data collection mechanism, it is common to see data collection with unbalanced spatial distributions. For example, some cities may release taxi data for multiple years while others only release a few days of data; some regions may have constant water quality data monitored by sensors whereas some regions only have a small collection of water samples. In this paper, we tackle the problem of spatial-temporal prediction for the cities with only a short period of data collection. We aim to utilize the long-period data from other cities via transfer learning. Different from previous studies that transfer knowledge from one single source city to a target city, we are the first to leverage information from multiple cities to increase the stability of transfer. Specifically, our proposed model is designed as a spatial-temporal network with a meta-learning paradigm. The meta-learning paradigm learns a well-generalized initialization of the spatial-temporal network, which can be effectively adapted to target cities. In addition, a pattern-based spatial-temporal memory is designed to distill long-term temporal information (i.e., periodicity). We conduct extensive experiments on two tasks: traffic (taxi and bike) prediction and water quality prediction. The experiments demonstrate the effectiveness of our proposed model over several competitive baseline models.

References

[1]
Wenyuan Dai, Ou Jin, Gui-Rong Xue, Qiang Yang, and Yong Yu. 2009. Eigentransfer: a unified framework for transfer learning. In Proceedings of the 26th Annual International Conference on Machine Learning. ACM, 193-200.
[2]
Chelsea Finn, Pieter Abbeel, and Sergey Levine. 2017. Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks. In International Conference on Machine Learning. 1126-1135.
[3]
Boqing Gong, Yuan Shi, Fei Sha, and Kristen Grauman. 2012. Geodesic flow kernel for unsupervised domain adaptation. In CVPR. IEEE, 2066-2073.
[4]
Raghuraman Gopalan, Ruonan Li, and Rama Chellappa. 2011. Domain adaptation for object recognition: An unsupervised approach. In Computer Vision (ICCV), 2011 IEEE International Conference on. IEEE, 999-1006.
[5]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735-1780.
[6]
Tsuyoshi Ide´ and Masashi Sugiyama. 2011. Trajectory regression on road networks. In AAAI Conference on Artificial Intelligence. AAAI Press, 203-208.
[7]
Jintao Ke, Hongyu Zheng, Hai Yang, and Xiqun Michael Chen. 2017. Short-term forecasting of passenger demand under on-demand ride services: A spatio-temporal deep learning approach. Transportation Research Part C: Emerging Technologies 85 (2017), 591-608.
[8]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097-1105.
[9]
Yaguang Li, Rose Yu, Cyrus Shahabi, and Yan Liu. 2018. Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting. In Sixth International Conference on Learning Representations.
[10]
Marco Lippi, Matteo Bertini, and Paolo Frasconi. 2013. Short-term traffic flow forecasting: An experimental comparison of time-series analysis and supervised learning. IEEE TIST 14, 2 (2013), 871-882.
[11]
Yanbin Liu, Juho Lee, Minseop Park, Saehoon Kim, and Yi Yang. 2018. Transductive Propagation Network for Few-shot Learning. arXiv preprint arXiv:1805.10002(2018).
[12]
Yiding Liu, Tuan-Anh Nguyen Pham, Gao Cong, and Quan Yuan. 2017. An experimental evaluation of point-of-interest recommendation in location-based social networks. Proceedings of the VLDB Endowment 10, 10 (2017), 1010-1021.
[13]
Yiding Liu, Kaiqi Zhao, and Gao Cong. 2018. Efficient Similar Region Search with Deep Metric Learning. In SIGKDD. ACM, 1850-1859.
[14]
Minh-Thang Luong, Hieu Pham, and Christopher D Manning. 2015. Effective approaches to attention-based neural machine translation. arXiv preprint arXiv:1508.04025(2015).
[15]
Luis Moreira-Matias, Joao Gama, Michel Ferreira, Joao Mendes-Moreira, and Luis Damas. 2013. Predicting taxi-passenger demand using streaming data. IEEE Transactions on Intelligent Transportation Systems 14, 3(2013), 1393-1402.
[16]
Devang K Naik and RJ Mammone. 1992. Meta-neural networks that learn by learning. In Neural Networks, 1992. IJCNN., International Joint Conference on, Vol. 1. IEEE, 437-442.
[17]
Sinno Jialin Pan, Qiang Yang, 2010. A survey on transfer learning. IEEE Transactions on knowledge and data engineering 22, 10(2010), 1345-1359.
[18]
Sachin Ravi and Hugo Larochelle. 2016. Optimization as a Model for Few-Shot Learning. ICLR (2016).
[19]
Shashank Shekhar and Billy Williams. 2008. Adaptive seasonal time series models for forecasting short-term traffic flow. Transportation Research Record: Journal of the Transportation Research Board2024(2008), 116-125.
[20]
Jake Snell, Kevin Swersky, and Richard Zemel. 2017. Prototypical networks for few-shot learning. In Advances in Neural Information Processing Systems. 4077-4087.
[21]
Yongxin Tong, Yuqiang Chen, Zimu Zhou, Lei Chen, Jie Wang, Qiang Yang, and Jieping Ye. 2017. The Simpler The Better: A Unified Approach to Predicting Original Taxi Demands on Large-Scale Online Platforms. In KDD. ACM.
[22]
Eric Tzeng, Judy Hoffman, Kate Saenko, and Trevor Darrell. 2017. Adversarial discriminative domain adaptation. In CVPR.
[23]
Bao Wang, Duo Zhang, Duanhao Zhang, P Jeffery Brantingham, and Andrea L Bertozzi. 2017. Deep learning for real time crime forecasting. arXiv preprint arXiv:1707.03340(2017).
[24]
Dong Wang, Wei Cao, Jian Li, and Jieping Ye. 2017. DeepSD: Supply-Demand Prediction for Online Car-Hailing Services Using Deep Neural Networks. In Data Engineering (ICDE), 2017 IEEE 33rd International Conference on. IEEE, 243-254.
[25]
Hongjian Wang and Zhenhui Li. 2017. Region representation learning via mobility flow. In CIKM. ACM, 237-246.
[26]
Hongjian Wang, Huaxiu Yao, Daniel Kifer, Corina Graif, and Zhenhui Li. 2017. Non-Stationary Model for Crime Rate Inference Using Modern Urban Data. IEEE Transactions on Big Data(2017).
[27]
Leye Wang, Xu Geng, Xiaojuan Ma, Feng Liu, and Qiang Yang. 2018. Crowd Flow Prediction by Deep Spatio-Temporal Transfer Learning. arXiv preprint arXiv:1802.00386(2018).
[28]
Hua Wei, Guanjie Zheng, Huaxiu Yao, and Zhenhui Li. 2018. Intellilight: A reinforcement learning approach for intelligent traffic light control. In SIGKDD. ACM, 2496-2505.
[29]
Ying Wei, Yu Zheng, and Qiang Yang. 2016. Transfer knowledge between cities. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 1905-1914.
[30]
Fei Wu, Hongjian Wang, and Zhenhui Li. 2016. Interpreting traffic dynamics using ubiquitous urban data. In Proceedings of the 24th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. ACM, 69.
[31]
Jianpeng Xu, Pang-Ning Tan, Lifeng Luo, and Jiayu Zhou. 2016. Gspartan: a geospatio-temporal multi-task learning framework for multi-location prediction. In Proceedings of the 2016 SIAM International Conference on Data Mining. SIAM, 657-665.
[32]
Jun Yang, Rong Yan, and Alexander G Hauptmann. 2007. Adapting SVM classifiers to data with shifted distributions. In Data Mining Workshops, 2007. ICDM Workshops 2007. Seventh IEEE International Conference on. IEEE.
[33]
Huaxiu Yao, Xianfeng Tang, Hua Wei, Guanjie Zheng, Yanwei Yu, and Zhenhui Li. 2019. Revisiting Spatial-Temporal Similarity: A Deep Learning Framework for Traffic Prediction. AAAI Conference on Artificial Intelligence(2019).
[34]
Huaxiu Yao, Fei Wu, Jintao Ke, Xianfeng Tang, Yitian Jia, Siyu Lu, Pinghua Gong, Jieping Ye, and Zhenhui Li. 2018. Deep Multi-View Spatial-Temporal Network for Taxi Demand Prediction. AAAI Conference on Artificial Intelligence(2018).
[35]
Xiuwen Yi, Junbo Zhang, Zhaoyuan Wang, Tianrui Li, and Yu Zheng. 2018. Deep Distributed Fusion Network for Air Quality Prediction. In KDD.
[36]
Wei Ying, Yu Zhang, Junzhou Huang, and Qiang Yang. 2018. Transfer learning via learning to transfer. In International Conference on Machine Learning. 5072-5081.
[37]
Jason Yosinski, Jeff Clune, Yoshua Bengio, and Hod Lipson. 2014. How transferable are features in deep neural networks?. In Advances in neural information processing systems. 3320-3328.
[38]
Bing Yu, Haoteng Yin, and Zhanxing Zhu. 2017. Spatio-temporal Graph Convolutional Neural Network: A Deep Learning Framework for Traffic Forecasting. arXiv preprint arXiv:1709.04875(2017).
[39]
Rose Yu, Yaguang Li, Ugur Demiryurek, Cyrus Shahabi, and Yan Liu. 2017. Deep Learning: A Generic Approach for Extreme Condition Traffic Forecasting. In Proceedings of SIAM International Conference on Data Mining.
[40]
Jiani Zhang, Xingjian Shi, Junyuan Xie, Hao Ma, Irwin King, and Dit-Yan Yeung. 2018. GaAN: Gated Attention Networks for Learning on Large and Spatiotemporal Graphs. arXiv preprint arXiv:1803.07294(2018).
[41]
Junbo Zhang, Yu Zheng, and Dekang Qi. 2017. Deep Spatio-Temporal Residual Networks for Citywide Crowd Flows Prediction. AAAI (2017).
[42]
Xiangyu Zhao and Jiliang Tang. 2017. Modeling temporal-spatial correlations for crime prediction. In CIKM. ACM, 497-506.
[43]
Xiangyu Zhao, Tong Xu, Yanjie Fu, Enhong Chen, and Hao Guo. 2017. Incorporating Spatio-Temporal Smoothness for Air Quality Inference. In ICDM. IEEE, 1177-1182.
[44]
Jiangchuan Zheng and Lionel M Ni. 2013. Time-dependent trajectory regression on road networks via multi-task learning. In AAAI Conference on Artificial Intelligence. AAAI Press, 1048-1055.
[45]
Ali Zonoozi, Jung-jae Kim, Xiao-Li Li, and Gao Cong. 2018. Periodic-CRN: A Convolutional Recurrent Model for Crowd Density Prediction with Recurring Periodic Patterns. In IJCAI. 3732-3738.

Cited By

View all
  • (2024)Multi-Scale Spatio-Temporal Attention Networks for Network-Scale Traffic Learning and ForecastingSensors10.3390/s2417554324:17(5543)Online publication date: 27-Aug-2024
  • (2024)Urban Spatiotemporal Event Prediction Using Convolutional Neural Network and Road Feature Fusion NetworkISPRS International Journal of Geo-Information10.3390/ijgi1310034113:10(341)Online publication date: 25-Sep-2024
  • (2024)Transfer Learning for Cross-City Traffic Prediction to Solve Data ScarcityTransportation Research Record: Journal of the Transportation Research Board10.1177/03611981241283013Online publication date: 30-Sep-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
WWW '19: The World Wide Web Conference
May 2019
3620 pages
ISBN:9781450366748
DOI:10.1145/3308558
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • IW3C2: International World Wide Web Conference Committee

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Spatial-temporal prediction
  2. meta-learning
  3. periodicity

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

WWW '19
WWW '19: The Web Conference
May 13 - 17, 2019
CA, San Francisco, USA

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)219
  • Downloads (Last 6 weeks)22
Reflects downloads up to 17 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Multi-Scale Spatio-Temporal Attention Networks for Network-Scale Traffic Learning and ForecastingSensors10.3390/s2417554324:17(5543)Online publication date: 27-Aug-2024
  • (2024)Urban Spatiotemporal Event Prediction Using Convolutional Neural Network and Road Feature Fusion NetworkISPRS International Journal of Geo-Information10.3390/ijgi1310034113:10(341)Online publication date: 25-Sep-2024
  • (2024)Transfer Learning for Cross-City Traffic Prediction to Solve Data ScarcityTransportation Research Record: Journal of the Transportation Research Board10.1177/03611981241283013Online publication date: 30-Sep-2024
  • (2024)Logistics Trajectory Time Prediction Method Based on Convolutional Neural NetworkProceedings of the 5th International Conference on Computer Information and Big Data Applications10.1145/3671151.3671337(1068-1072)Online publication date: 26-Apr-2024
  • (2024)Towards Effective Fusion and Forecasting of Multimodal Spatio-temporal Data for Smart MobilityProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3680261(5483-5486)Online publication date: 21-Oct-2024
  • (2024)AdaTM: Fine-grained Urban Flow Inference with Adaptive Knowledge Transfer across Multiple CitiesProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679856(3424-3432)Online publication date: 21-Oct-2024
  • (2024)FGITrans: Cross-City Transformer for Fine-grained Urban Flow InferenceProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679855(3415-3423)Online publication date: 21-Oct-2024
  • (2024)COLA: Cross-city Mobility Transformer for Human Trajectory SimulationProceedings of the ACM Web Conference 202410.1145/3589334.3645469(3509-3520)Online publication date: 13-May-2024
  • (2024)Traffic prediction via clustering and deep transfer learning with limited dataComputer-Aided Civil and Infrastructure Engineering10.1111/mice.13207Online publication date: 14-Apr-2024
  • (2024)MetaSTNet: Multimodal Meta-Learning for Cellular Traffic Conformal PredictionIEEE Transactions on Network Science and Engineering10.1109/TNSE.2023.333562611:2(1999-2011)Online publication date: Mar-2024
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media