Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

One-step vs horizon-step training strategies for multi-step traffic flow forecasting with direct particle swarm optimization grid search support vector regression and long short-term memory

Published: 24 July 2024 Publication History

Abstract

In the increasingly complex urban transportation landscape, the necessity for accurate, multi-step forecasting has never been more apparent to help plan for long-term, strategic transportation initiatives like Intelligent Transportation Systems. This work focuses on resolving uncertainties around the proper training step size for machine learning models performing multi-step traffic flow forecasting. Two strategies are considered: one-step and horizon-step training sizes, which extend from the single-step forecasting method. This paper compares and evaluates two machine learning models: the Support Vector Regression and Long Short-Term Memory (LSTM). Data from two country road locations, including urban roads in Kuala Lumpur and the I5-North freeway in California, are employed to forecast traffic flow in 1-hour increments, projecting from 2 h up to 24 h ahead. The results reveal a significant difference in performance between the two training step sizes, with the one-step training size emerging as the more consistent and optimal strategy for both Direct and Multi-Input Multi-Output forecasting strategies. The proposed model, the Direct Particle Swarm Optimization Grid Search Support Vector Regression (Direct-PSOGS-SVR) model, exhibited comparable or slightly better performance than the LSTM model in both environments. In the I5-North freeway dataset, the Direct-PSOGS-SVR achieved similar Root Mean Squared Error values across most forecasting tasks compared to the LSTM, indicating its effectiveness in stable traffic flow patterns. Notably, in the more dynamic urban environment of Kuala Lumpur, the Direct-PSOGS-SVR model also demonstrated stability and resilience in forecasting accuracy, effectively handling the inherent noise and fluctuations in traffic patterns. These findings serve as a valuable guide for practitioners in selecting the most efficacious combination of training strategies for specific time series forecasting tasks utilizing machine learning models, particularly in traffic flow forecasting. Introducing the Direct-PSOGS-SVR model enriches the landscape of machine learning solutions for traffic forecasting, underscoring the paper’s contributions to the broader understanding of time series forecasting dynamics.

References

[1]
M. Açıkkar, Y. Altunkol, A novel hybrid PSO- and GS-based hyperparameter optimization algorithm for Support Vector Regression, Neural Computing and Applications 35 (27) (2023) 19961–19977.
[2]
F.R. Aderyani, S.J. Mousavi, F. Jafari, Short-term rainfall forecasting using machine learning-based approaches of PSO-SVR, LSTM and CNN, Journal of Hydrology 614 (2022) 1–15.
[3]
T. Afrin, N. Yodo, A Long Short-Term Memory-based correlated traffic data prediction framework, Knowledge-Based Systems 237 (2022) 1–11.
[4]
Y. Bao, T. Xiong, Z. Hu, Multi-step-ahead time series prediction using multiple-output Support Vector Regression, Neurocomputing 129 (2014) 482–493.
[5]
R. Chandra, S. Goyal, A.R. Gupta, Evaluation of deep learning models for multi-step aheadtime series Prediction, IEEE Access 9 (2021) 83105–83123.
[6]
Y. Chen, W. Wang, X.M. Chen, Bibliometric methods in traffic flow prediction based on artificial intelligence, Expert Systems with Applications 228 (2023) 1–17.
[7]
L.C. Chang, P.A. Chen, F.J. Chang, Reinforced two-step-ahead weight adjustment Technique for online training of recurrent neural networks, IEEE Transactions on Neural Networks and Learning Systems 23 (8) (2012) 1269–1278.
[8]
E. Doğan, Performance analysis of LSTM model with multi-step ahead strategies for a short-term traffic flow prediction, Scientific Journal of Silesian University of Technology Series Transport 111 (2021) 15–31.
[9]
Fadil, I., Helmiawan, M. A., & Sofiyan, Y. (2021). Optimization parameters Support Vector Regression using Grid Search method. In Proceedings of 2021 9th International Conference on Cyber and IT Service Management, (CITSM 2021), Bengkulu, Indonesia.
[10]
S. Hochreiter, J. Schmidhuber, Long short-term memory, Neural Computation 9 (8) (1997) 1735–1780.
[11]
W.C. Hong, Y. Dong, F. Zheng, S.Y. Wei, Hybrid evolutionary algorithms in a SVR traffic flow forecasting model, Applied Mathematics and Computation 217 (15) (2011) 6733–6747.
[12]
H. Huang, J. Chen, B. Shi, H. He, Multi-step forecasting of short-term traffic flow based on Intrinsic Pattern Transform, Physica A 621 (2023) 1–16.
[13]
B. Hussain, M.K. Afzal, S. Ahmad, A.M. Mostafa, Intelligent traffic flow prediction using optimized GRU model, IEEE Access 9 (2021) 100736–100746.
[14]
F. Hutter, L. Kotthoff, J. Vanschoren, Automated Machine Learning: Methods, Systems, Springer International Publishing, Challenges, 2019.
[15]
L.S. Iyer, AI enabled applications towards intelligent transportation, Transportation Engineering 5 (2021) 1–11.
[16]
Jiao, L., & Zheng, W. (2020). Multi-step traffic flow prediction method based on the Conv1D + LSTM. In Proceedings of 2020 8th International Conference on Advanced Cloud and Big Data, (CBD 2020), Taiyuan, China.
[17]
Kennedy, J., & Eberhart, R. (1995). Particle swarm optimization. In Proceedings of 1995 IEEE International Conference on Neural Networks, (ICNN 95), Perth, Australia.
[18]
J. Li, J. Qin, Applying and dissecting LSTM neural networks and regularized learning for dynamic inferential modeling, Computers and Chemical Engineering 175 (2023) 1–13.
[19]
L. Li, L. Qin, X. Qu, J. Zhang, Y. Wang, B. Ran, Day-ahead traffic flow forecasting based on a deep belief network optimized by the multi-objective particle swarm algorithm, Knowledge-Based Systems 172 (2019) 1–14.
[20]
M. Lippi, M. Bertini, P. Frasconi, Short-term traffic flow forecasting: An experimental comparison of time-series analysis and supervised learning, IEEE Transactions on Intelligent Transportation Systems 14 (2) (2013) 871–882.
[21]
M. Méndez, M.G. Merayo, M. Núñez, Long-term traffic flow forecasting using a hybrid CNN-BiLSTM model, Engineering Applications of Artificial Intelligence 121 (2023) 1–15.
[22]
T.T. Ngoc, L.V. Dai, C.M. Thuyen, Support vector regression based on grid search method of hyperparameters for load forecasting, Acta Polytechnica Hungarica 18 (2) (2021) 143–158.
[23]
Peixeiro, M. (2022). Time Series Forecasting in Python. Manning Publications Co.
[24]
Rahim, M. S. A., Yakub, F., Omar, M., Ghani, R. A., Salim, S. A. Z. S., Masuda, S., & Dhamanti, I. (2023). Prediction of Indoor Air Quality using Long Short-Term Memory with Adaptive Gated Recurrent Unit. In Proceedings of 11th International Conference on Indoor Air Quality, Ventilation and Energy Conservation in Buildings, (IAQVE C2023), Tokyo, Japan.
[25]
L.O. Seman, S.F. Stefenon, V.C. Mariani, L.S. Coelho, Ensemble learning methods using the Hodrick-Prescott filter for fault forecasting in insulators of the electrical power grids, International Journal of Electrical Power and Energy Systems 152 (2023) 1–12.
[26]
R.G. Silva, S.R. Moreno, M.H.D.M. Ribeiro, J.H.K. Larcher, V.C. Mariani, L.S. Coelho, Multi-step short-term wind speed forecasting based on multi-stage decomposition coupled with stacking-ensemble learning approach, International Journal of Electrical Power and Energy Systems 143 (2022) 1–17.
[27]
A. Sorjamaa, J. Hao, N. Reyhani, Y. Ji, A. Lendasse, Methodology for long-term prediction of time series, Neurocomputing 70 (16–18) (2007) 2861–2869.
[28]
S.F. Stefenon, M.H.D.M. Ribeiro, A. Nied, K.C. Yow, V.C. Mariani, L.S. Coelho, L.O. Seman, Time series forecasting using ensemble learning methods for emergency prevention in hydroelectric power plants with dam, Electric Power Systems Research 202 (2022) 1–12.
[29]
S.B. Taieb, A.F. Atiya, A bias and variance analysis for multistep-ahead time series forecasting, IEEE Transactions on Neural Networks and Learning Systems 27 (1) (2016) 62–76.
[30]
S.B. Taieb, G. Bontempi, A.F. Atiya, A. Sorjamaa, A review and comparison of strategies for multi-step ahead time series forecasting based on the NN5 forecasting competition, Expert Systems with Applications 39 (8) (2012) 7067–7083.
[31]
S.B. Taieb, A. Sorjamaa, G. Bontempi, Multiple-output modeling for multi-step-ahead time series forecasting, Neurocomputing 73 (10–12) (2010) 1950–1957.
[32]
V.N. Vapnik, Statistical Learning Theory, Wiley, 1998.
[33]
D. Wei, H. Liu, An adaptive-margin support vector regression for short-term traffic flow forecast, Journal of Intelligent Transportation Systems: Technology, Planning, and Operations 17 (4) (2013) 317–327.
[34]
Y. Wei, H. Liu, Convolutional long-short term memory network with multi-head attention mechanism for traffic flow prediction, Sensors 22 (20) (2022) 1–15.
[35]
P. Xie, T. Li, J. Liu, S. Du, X. Yang, J. Zhang, Urban flow prediction from spatiotemporal data using machine learning: A survey, Information Fusion 59 (2020) 1–12.
[36]
H. Yan, L. Fu, Y. Qi, D.J. Yu, Q. Ye, Robust ensemble method for short-term traffic flow prediction, Future Generation Computer Systems 133 (2022) 395–410.
[37]
Y. Yang, L. Xu, H. Han, Z. Ren, K. Wu, F. Liu, Soft measurement and prediction of refrigerant leakage based on SVR-LSTM, International Journal of Refrigeration 152 (2023) 303–314.
[38]
A. Zhan, F. Du, Z. Chen, G. Yin, M. Wang, Y. Zhang, A traffic flow forecasting method based on the GA-SVR, Journal of High Speed Networks 28 (2) (2022) 97–106.
[39]
Zuhairi, A. H., Yakub, F., Zaki, S. A, & Ali, M. S. M. (2021). Review of flood prediction hybrid machine learning models using datasets. In Proceedings of 9th AUN/SEED-Net Regional Conference on Natural Disaster, (RCND 2021), Kuala Lumpur, Malaysia.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Expert Systems with Applications: An International Journal
Expert Systems with Applications: An International Journal  Volume 252, Issue PA
Oct 2024
1591 pages

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 24 July 2024

Author Tags

  1. Machine learning
  2. Long short-term memory
  3. Support vector regression
  4. Traffic flow forecasting
  5. Multi-step forecasting
  6. Training step size

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 01 Sep 2024

Other Metrics

Citations

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media