research-article

Traffic Flow Prediction via Spatial Temporal Graph Neural Network

Authors:

Jian YuAuthors Info & Claims

WWW '20: Proceedings of The Web Conference 2020

Pages 1082 - 1092

https://doi.org/10.1145/3366423.3380186

Published: 20 April 2020 Publication History

Abstract

Traffic flow analysis, prediction and management are keystones for building smart cities in the new era. With the help of deep neural networks and big traffic data, we can better understand the latent patterns hidden in the complex transportation networks. The dynamic of the traffic flow on one road not only depends on the sequential patterns in the temporal dimension but also relies on other roads in the spatial dimension. Although there are existing works on predicting the future traffic flow, the majority of them have certain limitations on modeling spatial and temporal dependencies. In this paper, we propose a novel spatial temporal graph neural network for traffic flow prediction, which can comprehensively capture spatial and temporal patterns. In particular, the framework offers a learnable positional attention mechanism to effectively aggregate information from adjacent roads. Meanwhile, it provides a sequential component to model the traffic flow dynamics which can exploit both local and global temporal dependencies. Experimental results on various real traffic datasets demonstrate the effectiveness of the proposed framework.

References

[1]

James Atwood and Don Towsley. 2016. Diffusion-convolutional neural networks. In Advances in Neural Information Processing Systems. 1993–2001.

[2]

Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E Hinton. 2016. Layer normalization. arXiv preprint arXiv:1607.06450(2016).

[3]

Albert-Laszlo Barabasi. 2003. Linked: How everything is connected to everything else and what it means. Plume.

[4]

Joan Bruna, Wojciech Zaremba, Arthur Szlam, and Yann LeCun. 2013. Spectral networks and locally connected networks on graphs. arXiv preprint arXiv:1312.6203(2013).

[5]

Shaosheng Cao, Wei Lu, and Qiongkai Xu. 2016. Deep neural networks for learning graph representations. In Thirtieth AAAI Conference on Artificial Intelligence.

Digital Library

[6]

Ennio Cascetta. 2013. Transportation systems engineering: theory and methods. Vol. 49. Springer Science & Business Media.

[7]

Chao Chen, Karl Petty, Alexander Skabardonis, Pravin Varaiya, and Zhanfeng Jia. 2001. Freeway performance measurement system: mining loop detector data. Transportation Research Record 1748, 1 (2001), 96–102.

[8]

Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078(2014).

[9]

Jerome T Connor, R Douglas Martin, and Les E Atlas. 1994. Recurrent neural networks and robust time series prediction. IEEE transactions on neural networks 5, 2 (1994), 240–254.

Digital Library

[10]

Ergin Elmacioglu and Dongwon Lee. 2005. On six degrees of separation in DBLP-DB and more. ACM SIGMOD Record 34, 2 (2005), 33–40.

Digital Library

[11]

Rui Fu, Zuo Zhang, and Li Li. 2016. Using LSTM and GRU neural network methods for traffic flow prediction. In 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC). IEEE, 324–328.

[12]

Adrien Guille, Hakim Hacid, Cecile Favre, and Djamel A Zighed. 2013. Information diffusion in online social networks: A survey. ACM Sigmod Record 42, 2 (2013), 17–28.

Digital Library

[13]

William L Hamilton, Rex Ying, and Jure Leskovec. 2017. Representation learning on graphs: Methods and applications. arXiv preprint arXiv:1709.05584(2017).

[14]

Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770–778.

[15]

Sepp Hochreiter, Yoshua Bengio, Paolo Frasconi, Jürgen Schmidhuber, 2001. Gradient flow in recurrent nets: the difficulty of learning long-term dependencies.

[16]

Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735–1780.

Digital Library

[17]

HV Jagadish, Johannes Gehrke, Alexandros Labrinidis, Yannis Papakonstantinou, Jignesh M Patel, Raghu Ramakrishnan, and Cyrus Shahabi. 2014. Big data and its technical challenges. Commun. ACM 57, 7 (2014), 86–94.

Digital Library

[18]

Meng Jiang, Peng Cui, Fei Wang, Qiang Yang, Wenwu Zhu, and Shiqiang Yang. 2012. Social recommendation across multiple relational domains. In Proceedings of the 21st ACM international conference on Information and knowledge management. ACM, 1422–1431.

Digital Library

[19]

Thomas N Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907(2016).

[20]

Selvaraj Vasantha Kumar. 2017. Traffic flow prediction using Kalman filtering technique. Procedia Engineering 187(2017), 582–587.

[21]

S Vasantha Kumar and Lelitha Vanajakshi. 2015. Short-term traffic flow prediction using seasonal ARIMA model with limited input data. European Transport Research Review 7, 3 (2015), 21.

[22]

Yann LeCun, Yoshua Bengio, 1995. Convolutional networks for images, speech, and time series. The handbook of brain theory and neural networks 3361, 10(1995), 1995.

Digital Library

[23]

Ye Li, Chaofeng Sha, Xin Huang, and Yanchun Zhang. 2018. Community detection in attributed graphs: an embedding approach. In Thirty-Second AAAI Conference on Artificial Intelligence.

[24]

Yaguang Li, Rose Yu, Cyrus Shahabi, and Yan Liu. 2017. Diffusion convolutional recurrent neural network: Data-driven traffic forecasting. arXiv preprint arXiv:1707.01926(2017).

[25]

Marco Lippi, Matteo Bertini, and Paolo Frasconi. 2013. Short-term traffic flow forecasting: An experimental comparison of time-series analysis and supervised learning. IEEE Transactions on Intelligent Transportation Systems 14, 2(2013), 871–882.

Digital Library

[26]

Hui Liu, Hong-qi Tian, and Yan-fei Li. 2012. Comparison of two new ARIMA-ANN and ARIMA-Kalman hybrid methods for wind speed prediction. Applied Energy 98(2012), 415–424.

[27]

Peter J Liu, Mohammad Saleh, Etienne Pot, Ben Goodrich, Ryan Sepassi, Lukasz Kaiser, and Noam Shazeer. 2018. Generating wikipedia by summarizing long sequences. arXiv preprint arXiv:1801.10198(2018).

[28]

Helmut Lütkepohl. 2005. New introduction to multiple time series analysis. Springer Science & Business Media.

Digital Library

[29]

Yisheng Lv, Yanjie Duan, Wenwen Kang, Zhengxi Li, and Fei-Yue Wang. 2014. Traffic flow prediction with big data: a deep learning approach. IEEE Transactions on Intelligent Transportation Systems 16, 2(2014), 865–873.

[30]

Attila M Nagy and Vilmos Simon. 2018. Survey on traffic prediction in smart cities. Pervasive and Mobile Computing 50 (2018), 148–163.

[31]

Mark Ed Newman, Albert-László Ed Barabási, and Duncan J Watts. 2006. The structure and dynamics of networks.Princeton university press.

[32]

Niki Parmar, Ashish Vaswani, Jakob Uszkoreit, Łukasz Kaiser, Noam Shazeer, Alexander Ku, and Dustin Tran. 2018. Image transformer. arXiv preprint arXiv:1802.05751(2018).

[33]

Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. Deepwalk: Online learning of social representations. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 701–710.

Digital Library

[34]

Franco Scarselli, Marco Gori, Ah Chung Tsoi, Markus Hagenbuchner, and Gabriele Monfardini. 2008. The graph neural network model. IEEE Transactions on Neural Networks 20, 1 (2008), 61–80.

Digital Library

[35]

Alex J Smola and Bernhard Schölkopf. 2004. A tutorial on support vector regression. Statistics and computing 14, 3 (2004), 199–222.

[36]

Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014. Sequence to sequence learning with neural networks. In Advances in neural information processing systems. 3104–3112.

[37]

Théo Trouillon, Johannes Welbl, Sebastian Riedel, Éric Gaussier, and Guillaume Bouchard. 2016. Complex embeddings for simple link prediction. In International Conference on Machine Learning. 2071–2080.

Digital Library

[38]

Claudia Ulbricht. 1994. Multi-recurrent networks for traffic forecasting. In AAAI. 883–888.

[39]

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998–6008.

[40]

Wan Kamarul Ariffin Wan Ahmad and Sabri Ahmad. 2013. Arima model and exponential smoothing method: A comparison. In AIP Conference Proceedings, Vol. 1522. AIP, 1312–1321.

[41]

Quan Wang, Zhendong Mao, Bin Wang, and Li Guo. 2017. Knowledge graph embedding: A survey of approaches and applications. IEEE Transactions on Knowledge and Data Engineering 29, 12(2017), 2724–2743.

[42]

Yibing Wang and Markos Papageorgiou. 2005. Real-time freeway traffic state estimation based on extended Kalman filter: a general approach. Transportation Research Part B: Methodological 39, 2(2005), 141–167.

[43]

Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and Philip S Yu. 2019. A comprehensive survey on graph neural networks. arXiv preprint arXiv:1901.00596(2019).

[44]

Sijie Yan, Yuanjun Xiong, and Dahua Lin. 2018. Spatial temporal graph convolutional networks for skeleton-based action recognition. In Thirty-Second AAAI Conference on Artificial Intelligence.

[45]

Rose Yu, Yaguang Li, Cyrus Shahabi, Ugur Demiryurek, and Yan Liu. 2017. Deep learning: A generic approach for extreme condition traffic forecasting. In Proceedings of the 2017 SIAM International Conference on Data Mining. SIAM, 777–785.

[46]

Daokun Zhang, Jie Yin, Xingquan Zhu, and Chengqi Zhang. 2018. Network representation learning: A survey. IEEE transactions on Big Data(2018).

[47]

G Peter Zhang. 2003. Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 50(2003), 159–175.

[48]

Jiani Zhang, Xingjian Shi, Junyuan Xie, Hao Ma, Irwin King, and Dit-Yan Yeung. 2018. Gaan: Gated attention networks for learning on large and spatiotemporal graphs. arXiv preprint arXiv:1803.07294(2018).

[49]

Ling Zhao, Yujiao Song, Chao Zhang, Yu Liu, Pu Wang, Tao Lin, Min Deng, and Haifeng Li. 2019. T-GCN: A Temporal Graph Convolutional Network for Traffic Prediction. IEEE Transactions on Intelligent Transportation Systems (2019).

[50]

Luowei Zhou, Yingbo Zhou, Jason J Corso, Richard Socher, and Caiming Xiong. 2018. End-to-end dense video captioning with masked transformer. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8739–8748.

Cited By

Wan FLi P(2024)A Novel Money Laundering Prediction Model Based on a Dynamic Graph Convolutional Neural Network and Long Short-Term MemorySymmetry10.3390/sym1603037816:3(378)Online publication date: 21-Mar-2024
https://doi.org/10.3390/sym16030378
Chai WLuo QLin ZYan JZhou JZhou T(2024)Spatiotemporal Dynamic Multi-Hop Network for Traffic Flow ForecastingSustainability10.3390/su1614586016:14(5860)Online publication date: 9-Jul-2024
https://doi.org/10.3390/su16145860
Zhang CWu YShen YWang SZhu XShen W(2024)Adaptive Graph Convolutional Recurrent Network with Transformer and Whale Optimization Algorithm for Traffic Flow PredictionMathematics10.3390/math1210149312:10(1493)Online publication date: 10-May-2024
https://doi.org/10.3390/math12101493
Show More Cited By

Recommendations

ST-GWANN: A Novel Spatial-Temporal Graph Wavelet Attention Neural Network for Traffic Prediction
Spatial Data and Intelligence
Abstract
In a modern Intelligent Transportation System (ITS), traffic prediction exerts an enormous function in alleviating traffic congestion and path planning. Due to the complex dynamic spatial-temporal dependence of traffic data, the traditional ...
A novel BP neural network model for traffic prediction of next generation network
ICNC'09: Proceedings of the 5th international conference on Natural computation

Network traffic prediction is an important research aspect of network behavior. Conventionally, ARMA time sequence model is usually adopted in network traffic prediction. However, the parameters used in normal time sequence models are difficult to be ...
Spatial–temporal multi-feature fusion network for long short-term traffic prediction
Abstract
Exploiting deep spatial–temporal features for traffic prediction has become growing widespread. Accurate traffic prediction is still challenging due to the complex spatial dependencies and time varying temporal dependencies, especially ...
Highlights
- Capturing complex spatial–temporal correlations for short and long term prediction.

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WWW '20: Proceedings of The Web Conference 2020

April 2020

3143 pages

ISBN:9781450370233

DOI:10.1145/3366423

Editors:
Yennun Huang
Acadmica sinica, Taiwan
,
Irwin King
The Chinese University of Hong Kong, Hong Kong
,
Tie-Yan Liu
Microsoft Research Asia, China
,
Maarten van Steen
University of Twente, Netherlands

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 April 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

WWW '20

Sponsor:

SIGWEB

WWW '20: The Web Conference 2020

April 20 - 24, 2020

Taipei, Taiwan

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

319
Total Citations
View Citations
7,508
Total Downloads

Downloads (Last 12 months)1,502
Downloads (Last 6 weeks)78

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wan FLi P(2024)A Novel Money Laundering Prediction Model Based on a Dynamic Graph Convolutional Neural Network and Long Short-Term MemorySymmetry10.3390/sym1603037816:3(378)Online publication date: 21-Mar-2024
https://doi.org/10.3390/sym16030378
Chai WLuo QLin ZYan JZhou JZhou T(2024)Spatiotemporal Dynamic Multi-Hop Network for Traffic Flow ForecastingSustainability10.3390/su1614586016:14(5860)Online publication date: 9-Jul-2024
https://doi.org/10.3390/su16145860
Zhang CWu YShen YWang SZhu XShen W(2024)Adaptive Graph Convolutional Recurrent Network with Transformer and Whale Optimization Algorithm for Traffic Flow PredictionMathematics10.3390/math1210149312:10(1493)Online publication date: 10-May-2024
https://doi.org/10.3390/math12101493
Zhan XQian XLiu WLiu XChen YZhang LHong HShen YXiao K(2024)Predicting Industrial Electricity Consumption Using Industry–Geography Relationships: A Graph-Based Machine Learning ApproachEnergies10.3390/en1717429617:17(4296)Online publication date: 28-Aug-2024
https://doi.org/10.3390/en17174296
Kim J(2024)Improving Data Utility in Privacy-Preserving Location Data Collection via Adaptive Grid PartitioningElectronics10.3390/electronics1315307313:15(3073)Online publication date: 3-Aug-2024
https://doi.org/10.3390/electronics13153073
Zong XChen ZYu FWei S(2024)Local-Global Spatial-Temporal Graph Convolutional Network for Traffic Flow ForecastingElectronics10.3390/electronics1303063613:3(636)Online publication date: 2-Feb-2024
https://doi.org/10.3390/electronics13030636
Li ZWei SWang HWang C(2024)ADDGCN: A Novel Approach with Down-Sampling Dynamic Graph Convolution and Multi-Head Attention for Traffic Flow ForecastingApplied Sciences10.3390/app1410413014:10(4130)Online publication date: 13-May-2024
https://doi.org/10.3390/app14104130
Chen SLiu JShen L(2024)A Survey on Graph Neural Network Acceleration: A Hardware PerspectiveChinese Journal of Electronics10.23919/cje.2023.00.13533:3(601-622)Online publication date: May-2024
https://doi.org/10.23919/cje.2023.00.135
Zhang XRen QZhang YQuan CGuo SLi F(2024)Expressway traffic flow prediction based on MF-TAN and STSAPLOS ONE10.1371/journal.pone.029729619:2(e0297296)Online publication date: 22-Feb-2024
https://doi.org/10.1371/journal.pone.0297296
Bhatti MSong ZBhatti UM. S S(2024)AIoT-driven multi-source sensor emission monitoring and forecasting using multi-source sensor integration with reduced noise series decompositionJournal of Cloud Computing10.1186/s13677-024-00598-913:1Online publication date: 21-Mar-2024
https://doi.org/10.1186/s13677-024-00598-9
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents