Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3453800.3453812acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicmlscConference Proceedingsconference-collections
research-article

Periodic Time Series Forecasting with Bidirectional Long Short-Term Memory: Periodic Time Series Forecasting with Bidirectional LSTM

Published: 18 June 2021 Publication History

Abstract

Deep learning methods such as recurrent neural network and long short-term memory have recently drawn a lot of attentions in many fields such as computer vision, natural language processing and finance. Long short-term memory is a type of recurrent neural network capable of predicting future values of sequential data by learning observed data over time. Many real-world time series in business, finance, weather forecasting and engineering science have periodic property like daily, monthly, quarterly or yearly period and need efficient tools to forecast their future events and values. The forecasting study and tools in these fields are therefore essential and important. In this paper, we present a deep learning technique, called bidirectional long short-term memory, in forecasting time series data. The bidirectional long short-term memory model is evaluated based on the benchmark periodic time series dataset. The model performs well on the macro and industry categories and achieves average mean absolute percentage errors less than 9%. It is shown that the bidirectional architecture obtains the better results than the baseline models. We also test the model by tuning the time step parameter to evaluate how the time step length impacts on forecasting performance of the model.

References

[1]
Rumelhart, D., Hinton, G., and Williams, R. 1986. Learning representations by back-propagating errors. Nature 323, 533-536. https://doi.org/10.1038/323533a0
[2]
Karpathy, A., Johnson, J., and Li, F.-F. 2015. Visualizing and understanding recurrent networks. arXiv preprint. https://arxiv.org/abs/1506.02078
[3]
Sutskever, I., Vinyals, O., and Le, Q.V. 2014. Sequence to Sequence Learning with Neural Networks. Advances in Neural Information Processing Systems 27, 3104-3112.
[4]
Li, X., and Wu, X. 2015. Constructing long short-term memory based deep recurrent neural networks for large vocabulary speech recognition. In: 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brisbane, QLD, 4520-4524.
[5]
Vinyals, O., Toshev, A., Bengio, S., and Erhan, D. 2015. Show and Tell: A Neural Image Caption Generator. In: The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 3156-3164.
[6]
Ullah, A., Ahmad, J., Muhammad, K., Sajjad, M., and Baik, S.W. 2017. Action Recognition in Video Sequences using Deep Bi-Directional LSTM with CNN Features. IEEE Access 6, 1155-1166.
[7]
Kim, T.-Y., and Cho, S.-B. 2018. Web traffic anomaly detection using C-LSTM neural networks. Expert Systems with Applications 106, 66-76. https://doi.org/10.1016/j.eswa.2018.04.004
[8]
Malhotra, P., Vig, L., Shroff, G., and Agarwal, P. 2015. Long short-term memory networks for anomaly detection in time series. In: ESANN 2015 proceedings, European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning, Bruges, Belgium, 89-94.
[9]
Chauhan, S., and Vig, L. 2015. Anomaly detection in ECG time signals via deep long short-term memory networks. In: 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA), Paris, 1-7. https://doi.org/10.1109/DSAA.2015.7344872
[10]
Wu, Y., Yuan, M., Dong, S., Lin, L., and Liu, Y. 2018. Remaining useful life estimation of engineered systems using vanilla LSTM neural networks. Neurocomputing 275, 167-179. https://doi.org/10.1016/j.neucom.2017.05.063
[11]
Zhao, R., Wang, J., Yan, R., and Mao, K. 2016. Machine health monitoring with LSTM networks. In: 2016 10th International Conference on Sensing Technology (ICST), Nanjing, 1-6. https://doi.org/10.1109/ICSensT.2016.7796266
[12]
Le, D., Thi, D., Lee, J., Rabczuk, T., and Nguyen-Xuan, H. 2019. Forecasting Damage Mechanics by Deep Learning. CMC-Computers, Materials & Continua 61, 3, 951-977. https://doi.org/10.32604/cmc.2019.08001
[13]
Nguyen, D.Q., Phan, M.N., and Zelinka, I. 2020. Forecasting Time Series with Long Short-Term Memory Networks. Can Tho University Journal of Science 12, 2, 53-59. https://doi.org/10.22144/ctu.jen.2020.016
[14]
Hochreiter, S., and Schmidhuber, J. 1997. Long shortterm memory. Neural Computation 9, 8, 1735-1780. https://doi.org/10.1162/neco.1997.9.8.1735
[15]
Gers, F.A., Schmidhuber, J., and Cummins, F. 1999. Learning to forget: continual prediction with LSTM. In: 9th International Conference on Artificial Neural Networks: ICANN '99, Edinburgh, UK, 850-855. https://doi.org/10.1049/cp:19991218
[16]
Gers, F.A., Schmidhuber, J., and Cummins, F. 2000. Learning to Forget: Continual Prediction with LSTM. Neural Computation 12, 10, 2451-2471. https://doi.org/10.1162/089976600300015015
[17]
Cho, K., Merrienboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. 2014. Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar, 1724-1734. https://doi.org/10.3115/v1/D14-1179
[18]
Makridakis, S., and Hibon, M. 2000. The M3-Competition: results, conclusions and implications. International Journal of Forecasting 16, 4, 451-476. https://doi.org/10.1016/S0169-2070(00)00057-1
[19]
Makridakis, S., Spiliotis, E., and Assimakopoulos, V. 2018. The M4 Competition: Results, findings, conclusion and way forward. International Journal of Forecasting 34, 4, 802-808. https://doi.org/10.1016/j.ijforecast.2018.06.001
[20]
The M3-Competition Database. The 3003 Time Series of The M3-Competition, accessed on 01 August 2020. Available from https://forecasters.org/resources/time-series-data/m3-competition/
[21]
Kingma, D.P., and Ba, J. 2015. Adam: A Method for Stochastic Optimization. In: Proceedings of the 3rd International Conference on Learning Representations (ICLR), San Diego, CA, USA.

Cited By

View all
  • (2024)A robust kernel-based fuzzy clustering algorithm for time series forecastingInternational Journal of Information Technology10.1007/s41870-024-02294-yOnline publication date: 14-Dec-2024
  • (2021)Forecasting Covid-19 Infections in Ho Chi Minh City Using Recurrent Neural NetworksFuture Data and Security Engineering. Big Data, Security and Privacy, Smart City and Industry 4.0 Applications10.1007/978-981-16-8062-5_26(387-398)Online publication date: 14-Nov-2021

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICMLSC '21: Proceedings of the 2021 5th International Conference on Machine Learning and Soft Computing
January 2021
178 pages
ISBN:9781450387613
DOI:10.1145/3453800
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 June 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Long short-term memory
  2. recurrent neural network
  3. sequence prediction
  4. time series

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICMLSC '21

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)16
  • Downloads (Last 6 weeks)2
Reflects downloads up to 25 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)A robust kernel-based fuzzy clustering algorithm for time series forecastingInternational Journal of Information Technology10.1007/s41870-024-02294-yOnline publication date: 14-Dec-2024
  • (2021)Forecasting Covid-19 Infections in Ho Chi Minh City Using Recurrent Neural NetworksFuture Data and Security Engineering. Big Data, Security and Privacy, Smart City and Industry 4.0 Applications10.1007/978-981-16-8062-5_26(387-398)Online publication date: 14-Nov-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media