Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3589334.3645688acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article
Open access

Unveiling Delay Effects in Traffic Forecasting: A Perspective from Spatial-Temporal Delay Differential Equations

Published: 13 May 2024 Publication History

Abstract

Traffic flow forecasting is a fundamental research issue for transportation planning and management, which serves as a canonical and typical example of spatial-temporal predictions. In recent years, Graph Neural Networks (GNNs) and Recurrent Neural Networks (RNNs) have achieved great success in capturing spatial-temporal correlations for traffic flow forecasting. Yet, two non-ignorable issues haven't been well solved: 1) The message passing in GNNs is immediate, while in reality the spatial message interactions among neighboring nodes can be delayed. The change of traffic flow at one node will take several minutes, i.e., time delay, to influence its connected neighbors. 2) Traffic conditions undergo continuous changes. The prediction frequency for traffic flow forecasting may vary based on specific scenario requirements. Most existing discretized models require retraining for each prediction horizon, restricting their applicability. To tackle the above issues, we propose a neural Spatial-Temporal Delay Differential Equation model, namely STDDE. It includes both delay effects and continuity into a unified delay differential equation framework, which explicitly models the time delay in spatial information propagation. Furthermore, theoretical proofs are provided to show its stability. Then we design a learnable traffic-graph time-delay estimator, which utilizes the continuity of the hidden states to achieve the gradient backward process. Finally, we propose a continuous output module, allowing us to accurately predict traffic flow at various frequencies, which provides more flexibility and adaptability to different scenarios. Extensive experiments show the superiority of STDDE. Both quantitative and qualitative experiments are conducted to validate the concept of a delay-aware module. Also, the flexibility validation shows the effectiveness of the continuous output module.

Supplemental Material

MP4 File
video presentation
MP4 File
Supplemental video

References

[1]
Arsam Aryandoust, Oscar van Vliet, and Anthony Patt. 2019. City-scale car traffic and parking density maps from Uber Movement travel time data. Scientific data 6, 1 (2019), 158.
[2]
Mordechai Azaria and David Hertz. 1984. Time delay estimation by generalized cross correlation methods. IEEE Transactions on Acoustics, Speech, and Signal Processing 32, 2 (1984), 280--285.
[3]
Lei Bai, Lina Yao, Can Li, Xianzhi Wang, and Can Wang. 2020. Adaptive graph convolutional recurrent network for traffic forecasting. arXiv preprint arXiv:2007.02842 (2020).
[4]
Konstantinos Benidis, Syama Sundar Rangapuram, Valentin Flunkert, Yuyang Wang, Danielle Maddix, Caner Turkmen, Jan Gasthaus, Michael Bohlke-Schneider, David Salinas, Lorenzo Stella, et al. 2022. Deep learning for time series forecasting: Tutorial and literature survey. Comput. Surveys 55, 6 (2022), 1--36.
[5]
Suresh Chavhan and Pallapa Venkataram. 2020. Prediction based traffic management in a metropolitan area. Journal of traffic and transportation engineering (English edition) 7, 4 (2020), 447--466.
[6]
Chao Chen, Karl Petty, Alexander Skabardonis, Pravin Varaiya, and Zhanfeng Jia. 2001. Freeway performance measurement system: mining loop detector data. Transportation Research Record 1748, 1 (2001), 96--102.
[7]
Ricky TQ Chen, Yulia Rubanova, Jesse Bettencourt, and David Duvenaud. 2018. Neural ordinary differential equations. arXiv preprint arXiv:1806.07366 (2018).
[8]
Jeongwhan Choi, Hwangyong Choi, Jeehyun Hwang, and Noseong Park. 2021. Graph Neural Controlled Differential Equations for Traffic Forecasting. arXiv preprint arXiv:2112.03558 (2021).
[9]
Edward De Brouwer, Jaak Simm, Adam Arany, and Yves Moreau. 2019. Gru-odebayes: Continuous modeling of sporadically-observed time series. Advances in neural information processing systems 32 (2019).
[10]
Emilien Dupont, Arnaud Doucet, and Yee Whye Teh. 2019. Augmented neural odes. Advances in Neural Information Processing Systems 32 (2019).
[11]
Xiaomin Fang, Jizhou Huang, FanWang, Lingke Zeng, Haijin Liang, and Haifeng Wang. 2020. Constgat: Contextual spatial-temporal graph attention network for travel time estimation at baidu maps. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2697--2705.
[12]
Zheng Fang, Qingqing Long, Guojie Song, and Kunqing Xie. 2021. Spatialtemporal graph ode networks for traffic flow forecasting. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 364--373.
[13]
Zheng Fang, Lingjun Xu, Guojie Song, Qingqing Long, and Yingxue Zhang. 2022. Polarized graph neural networks. In Proceedings of the ACM Web Conference 2022. 1404--1413.
[14]
Rui Fu, Zuo Zhang, and Li Li. 2016. Using LSTM and GRU neural network methods for traffic flow prediction. In 2016 31st Youth academic annual conference of Chinese association of automation (YAC). IEEE, 324--328.
[15]
Shengnan Guo, Youfang Lin, Ning Feng, Chao Song, and Huaiyu Wan. 2019. Attention based spatial-temporal graph convolutional networks for traffic flow forecasting. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 922--929.
[16]
Jaminur Islam, Jose Paolo Talusan, Shameek Bhattacharjee, Francis Tiausas, Sayyed Mohsen Vazirizade, Abhishek Dubey, Keiichi Yasumoto, and Sajal K Das. 2022. Anomaly based Incident Detection in Large Scale Smart Transportation Systems. In 2022 ACM/IEEE 13th International Conference on Cyber-Physical Systems (ICCPS). IEEE, 215--224.
[17]
Jiawei Jiang, Chengkai Han, Wayne Xin Zhao, and Jingyuan Wang. 2023. PDFormer: Propagation Delay-aware Dynamic Long-range Transformer for Traffic Flow Prediction. arXiv preprint arXiv:2301.07945 (2023).
[18]
Wei Ju, Zheng Fang, Yiyang Gu, Zequn Liu, Qingqing Long, Ziyue Qiao, Yifang Qin, Jianhao Shen, Fang Sun, Zhiping Xiao, et al. 2023. A Comprehensive Survey on Deep Graph Representation Learning. arXiv preprint arXiv:2304.05055 (2023).
[19]
Wei Ju, Siyu Yi, Yifan Wang, Qingqing Long, Junyu Luo, Zhiping Xiao, and Ming Zhang. 2024. A survey of data-efficient graph learning. arXiv preprint arXiv:2402.00447 (2024).
[20]
Patrick Kidger, James Morrill, James Foster, and Terry Lyons. 2020. Neural controlled differential equations for irregular time series. Advances in Neural Information Processing Systems 33 (2020), 6696--6707.
[21]
Thomas N Kipf and MaxWelling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016).
[22]
Shiyong Lan, Yitong Ma, Weikang Huang, Wenwu Wang, Hongyu Yang, and Pyang Li. 2022. Dstagnn: Dynamic spatial-temporal aware graph neural network for traffic flow forecasting. In International conference on machine learning. PMLR, 11906--11917.
[23]
Mathias Lechner and Ramin Hasani. 2020. Learning long-term dependencies in irregularly-sampled time series. arXiv preprint arXiv:2006.04418 (2020).
[24]
Yaguang Li, Rose Yu, Cyrus Shahabi, and Yan Liu. 2017. Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. arXiv preprint arXiv:1707.01926 (2017).
[25]
Yaguang Li, Rose Yu, Cyrus Shahabi, and Yan Liu. 2018. Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting. In International Conference on Learning Representations.
[26]
Jielun Liu, Ghim Ping Ong, and Xiqun Chen. 2020. GraphSAGE-based traffic speed forecasting for segment network with sparse data. IEEE Transactions on Intelligent Transportation Systems 23, 3 (2020), 1755--1766.
[27]
Qingqing Long, Yilun Jin, Guojie Song, Yi Li, andWei Lin. 2020. Graph Structuraltopic Neural Network. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1065--1073.
[28]
Qingqing Long, Yilun Jin, YiWu, and Guojie Song. 2021. Theoretically improving graph neural networks via anonymous walk graph kernels. In Proceedings of the Web Conference 2021. 1204--1214.
[29]
Qingqing Long, Yiming Wang, Lun Du, Guojie Song, Yilun Jin, andWei Lin. 2019. Hierarchical community structure preserving network embedding: A subspace approach. In Proceedings of the 28th ACM international conference on information and knowledge management. 409--418.
[30]
Qingqing Long, Lingjun Xu, Zheng Fang, and Guojie Song. 2021. HGK-GNN: Heterogeneous Graph Kernel based Graph Neural Networks. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 1129--1138.
[31]
Bin Lu, Xiaoying Gan, Haiming Jin, Luoyi Fu, and Haisong Zhang. 2020. Spatiotemporal adaptive gated graph convolution network for urban traffic flow forecasting. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 1025--1034.
[32]
Dorota Mozyrska, Ewa Pawluszewicz, and Delfim FM Torres. 2009. The Riemann- Stieltjes integral on time scales. arXiv preprint arXiv:0903.1224 (2009).
[33]
Attila M Nagy and Vilmos Simon. 2018. Survey on traffic prediction in smart cities. Pervasive and Mobile Computing 50 (2018), 148--163.
[34]
Bin Ran and David Boyce. 2012. Modeling dynamic transportation networks: an intelligent transportation system oriented approach. Springer Science & Business Media.
[35]
Xuan Rao, Hao Wang, Liang Zhang, Jing Li, Shuo Shang, and Peng Han. 2022. FOGS: First-order gradient supervision with learning-based graph for traffic flow forecasting. In Proceedings of International Joint Conference on Artificial Intelligence, IJCAI. ijcai. org.
[36]
Yulia Rubanova, Ricky TQ Chen, and David K Duvenaud. 2019. Latent ordinary differential equations for irregularly-sampled time series. Advances in neural information processing systems 32 (2019).
[37]
Mike Schuster and Kuldip K Paliwal. 1997. Bidirectional recurrent neural networks. IEEE transactions on Signal Processing 45, 11 (1997), 2673--2681.
[38]
Gustaf Söderlind. 2006. The logarithmic norm. History and modern theory. BIT Numerical Mathematics 46, 3 (2006), 631--652.
[39]
Chao Song, Youfang Lin, Shengnan Guo, and Huaiyu Wan. 2020. Spatialtemporal synchronous graph convolutional networks: A new framework for spatial-temporal network data forecasting. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 914--921.
[40]
Guojie Song, Qingqing Long, Yi Luo, Yiming Wang, and Yilun Jin. 2020. Deep convolutional neural network based medical concept normalization. IEEE Transactions on Big Data 8, 5 (2020), 1195--1208.
[41]
Torsten Ström. 1975. On logarithmic norms. SIAM J. Numer. Anal. 12, 5 (1975), 741--753.
[42]
Leping Sun. 2006. Stability analysis for delay differential equations with multidelays and numerical examples. Mathematics of computation 75, 253 (2006), 151--165.
[43]
Minjie Wang, Lingfan Yu, Da Zheng, Quan Gan, Yu Gai, Zihao Ye, Mufei Li, Jinjing Zhou, Qi Huang, Chao Ma, et al. 2019. Deep Graph Library: Towards Efficient and Scalable Deep Learning on Graphs. (2019).
[44]
Zifeng Wu, Chunhua Shen, and Anton Van Den Hengel. 2019. Wider or deeper: Revisiting the resnet model for visual recognition. Pattern Recognition 90 (2019), 119--133.
[45]
James A Yorke. 1970. Asymptotic stability for one dimensional differential-delay equations. Journal of Differential equations 7, 1 (1970), 189--202.
[46]
Bing Yu, Haoteng Yin, and Zhanxing Zhu. 2018. Spatio-temporal graph convolutional networks: a deep learning framework for traffic forecasting. In Proceedings of the 27th International Joint Conference on Artificial Intelligence. 3634--3640.
[47]
Haitao Yuan, Guoliang Li, Zhifeng Bao, and Ling Feng. 2021. An effective joint prediction model for travel demands and traffic flows. In 2021 IEEE 37th International Conference on Data Engineering (ICDE). IEEE, 348--359.
[48]
Weibin Zhang, Yinghao Yu, Yong Qi, Feng Shu, and Yinhai Wang. 2019. Shortterm traffic flow prediction based on spatio-temporal analysis and CNN deep learning. Transportmetrica A: Transport Science 15, 2 (2019), 1688--1711.
[49]
Zhengyang Zhou, Yang Wang, Xike Xie, Lianliang Chen, and Chaochao Zhu. 2020. Foresee urban sparse traffic accidents: A spatiotemporal multi-granularity perspective. IEEE Transactions on Knowledge and Data Engineering 34, 8 (2020), 3786--3799.
[50]
Qunxi Zhu, Yao Guo, and Wei Lin. 2021. Neural delay differential equations. arXiv preprint arXiv:2102.10801 (2021).

Cited By

View all
  • (2024)Addressing Prediction Delays in Time Series Forecasting: A Continuous GRU Approach with Derivative RegularizationProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671969(1234-1245)Online publication date: 24-Aug-2024
  • (2024)MOAT: Graph Prompting for 3D Molecular GraphsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679628(1586-1596)Online publication date: 21-Oct-2024
  • (2024)GUME: Graphs and User Modalities Enhancement for Long-Tail Multimodal RecommendationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679620(1400-1409)Online publication date: 21-Oct-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WWW '24: Proceedings of the ACM Web Conference 2024
May 2024
4826 pages
ISBN:9798400701719
DOI:10.1145/3589334
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2024

Check for updates

Author Tags

  1. continuous systems
  2. deep graph learning
  3. differential equation
  4. traffic flow prediction
  5. traffic network

Qualifiers

  • Research-article

Funding Sources

  • Natural Science Foundation of China
  • Strategic Priority Research Program of the Chinese Academy of Sciences

Conference

WWW '24
Sponsor:
WWW '24: The ACM Web Conference 2024
May 13 - 17, 2024
Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)468
  • Downloads (Last 6 weeks)104
Reflects downloads up to 23 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Addressing Prediction Delays in Time Series Forecasting: A Continuous GRU Approach with Derivative RegularizationProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3671969(1234-1245)Online publication date: 24-Aug-2024
  • (2024)MOAT: Graph Prompting for 3D Molecular GraphsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679628(1586-1596)Online publication date: 21-Oct-2024
  • (2024)GUME: Graphs and User Modalities Enhancement for Long-Tail Multimodal RecommendationProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679620(1400-1409)Online publication date: 21-Oct-2024
  • (2024)Refining computational inference of gene regulatory networks: integrating knockout data within a multi-task frameworkBriefings in Bioinformatics10.1093/bib/bbae36125:5Online publication date: 31-Jul-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media