Abstract
Exchange rate movements can significantly impact not only foreign trade, capital flows, and asset portfolio management, but also real economic activity. Therefore, the forecast of exchange rates has always been of great interest among academics, economic agents, and institutions. However, exchange rate series are essentially dynamic and nonlinear in nature and thus, forecasting exchange rates is a difficult task. On the other hand, deep learning models in solving time series forecasting tasks have been proposed in the last half-decade. But the number of formal comparative study in terms of exchange rate forecasting with deep learning models is quite limited. For this purpose, this study applies ten different models (Random Walk, Autoregressive Moving Average, Threshold Autoregression, Autoregressive Fractionally Integrated Moving Average, Support Vector Regression, Multilayer Perceptron, Recurrent Neural Network, Long Short Term Memory, Gated Recurrent Unit and Autoregressive Moving Average-Long Short Term Memory Hybrid Models) and two forecasting modes (recursive and rolling window) to predict three major exchange rate returnsnamely, the Canadian dollar, Australian dollar and British pound against the US Dollar in monthly terms. To evaluate the forecasting performances of the models, we used Model Confidence Set procedure as an advanced test. According to our results, the proposed hybrid model produced the best out-of-sample forecast performance in all samples, without exception.
Similar content being viewed by others
Notes
Critics of structural models and DSGE models highlight the fact that they are not appropriate for forecasting exchange rates; rather, these models chiefly look to explain the factors underlying the equilibrium setting of all endogenous variables within an interaction.
Indeed, there is an esteemed literature about modelling exchange rates by focusing nonlinearities in volatility, but this debate is out of scope of this paper.
References
Adolfson, M., Lindé, J., & Villani, M. (2007). Forecasting performance of an open economy DSGE model. Econometric Reviews, 26(2–4), 289–328.
Alvarez-Diaz, M. (2008). Exchange rates forecasting: Local or global methods? Applied Economics, 40(15), 1969–1984.
Baharumshah, A. Z., & Liew, V. K. S. (2006). Forecasting performance of exponential smooth transition autoregressive exchange rate models. Open Economies Review, 17(2), 235–251.
Bandara, K., & Bergmeir, C. (2020). Forecasting across time series databases using recurrent neural networks on groups of similar series: A clustering approach. Expert Systems with Applications, 140, 112896.
Bellgard, C., & Goldschmidt, P. (1999). Forecasting across frequencies: Linearity and non-linearity. In International conference on advanced technology (pp. 41–48). School of Information Technology: Bond University.
Bengio, Y., Simard, P., & Frasconi, P. (1994). Learning long-term dependencies with gradient descent is difficult. IEEE Transactions on Neural Networks, 5(2), 157–166.
Bielecki, A., Hajto, P., & Schaefer, R. (2008). Hybrid neural systems in exchange rate prediction. Studies in Computational Intelligence, 100, 211–230.
Boero, G., & Marrocu, E. (2004). The performance of SETAR models: A regime conditional evaluation of point, interval and density forecasts. International Journal of Forecasting, 20(2), 305–320.
Box, G. E. P., & Jenkins, G. (1976). Time series analysis: Forecasting and control. San Francisco: Holden-Day.
Byrne, J. P., Korobilis, D., & Ribeiro, P. J. (2018). On the sources of uncertainty in exchange rate predictability. International Economic Review, 59(1), 329–357.
Ca’ Zorzi, M., Kolasa, M., & Rubaszek, M. (2017). Exchange rate forecasting with DSGE models. Journal of International Economics, 107, 127–146.
Cai, Z., Chen, L., & Fang, Y. (2012). A new forecasting model for USD/CNY exchange rate. Studies in Nonlinear Dynamics and Econometrics, 16(3).
Caporale, G. M., & Spagnolo, N. (2004). Modelling East Asian exchange rates: A Markov-switching approach. Applied Financial Economics, 14(4), 233–242.
Carney, J. G., & Cunningham, P. (1996). Neural networks and currency exchange rate prediction. Trinity College: Tech. rep.
Chan, K. S. (1993). Consistency and limiting distribution of the least squares estimator of a threshold autoregressive model. The Annals of Statistics, 21(1), 520–533.
Chappell, D., Padmore, J., Mistry, P., & Ellis, C. (1996). A threshold model for the French franc/deutschmark exchange rate. Journal of Forecasting, 15(3), 155–164.
Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014). Learning phrase representations using RNN encoder–decoder for statistical machine translation. In EMNLP 2014—2014 conference on empirical methods in natural language processing, proceedings of the conference, Association for Computational Linguistics (ACL) (pp. 1724–1734), 1406.1078.
Christoffel, K., Coenen, G., & Warne, A. (2012). Forecasting with DSGE models. Working paper series, European Central Bank.
Chung, J., Gülçehre, Ç., Cho, K., & Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. CoRR abs/1412.3555.
Clements, M. P., & Smith, J. (2001). Evaluating forecasts from SETAR models of exchange rates. Journal of International Money and Finance, 20(1), 133–148.
Cortes, C., & Vapnik, V. (1995). Support-vector networks. Machine Learning, 20(3), 273–297.
Cushman, D. O. (2007). A portfolio balance approach to the Canadian-U.S. exchange rate. Review of Financial Economics, 16(3 SPEC. ISS.), 305–320.
Cybenko, G. (1989). Approximation by superpositions of a sigmoidal function. Mathematics of Control, Signals, and Systems, 2(4), 303–314.
de Grauwe, P., Dewachter, H., & Embrechts, M. (1993). Exchange rate theory: Chaotic models of foreign exchange markets. Blackwell, Oxford UK; Cambridge Mass.
Dhamija, A. K., & Bhalla, V. K. (2010). Financial time series forecasting: Comparison of neural networks and ARCH models. International Research Journal of Finance and Economics, 49, 194–212.
Diebold, F. X., & Mariano, R. S. (1995). Comparing predictive accuracy. Journal of Business and Economic Statistics, 13(3), 253–263.
Diebold, F. X., & Nason, J. A. (1990). Nonparametric exchange rate prediction? Journal of International Economics, 28(3–4), 315–332.
Dodevski, A., Koceska, N., & Koceski, S. (2018). Forecasting exchange rate between macedonian denar and euro using deep learning. Journal of Applied Economics and Business, 6(2), 50–61.
El Shazly, M. R., & El Shazly, H. E. (1997). Comparing the forecasting performance of neural networks and forward exchange rates. Journal of Multinational Financial Management, 7(4), 345–356.
Enders, W., & Pascalau, R. (2015). Pretesting for multi-step-ahead exchange rate forecasts with STAR models. International Journal of Forecasting, 31(2), 473–487.
Engel, C. (1994). Can the Markov switching model forecast exchange rates? Journal of International Economics, 36(1–2), 151–165.
Engel, C., & Hamilton, J. (1990). Long swings in the dollar: Are they in the data and do markets know it? American Economic Review, 80(4), 689–713.
Fang, H., Lai, K. S., & Lai, M. (1994). Fractal structure in currency futures price dynamics. Journal of Futures Markets, 14(2), 169–181.
Fernández-Rodríguez, F., Sosvilla-Rivero, S., & Andrada-Félix, J. (2004). Nearest-neighbour predictions in foreign exchange markets (pp. 297–325). Berlin: Springer.
Galeshchuk, S., & Mukherjee, S. (2017). Deep networks for predicting direction of change in foreign exchange rates. Intelligent Systems in Accounting, Finance and Management, 24(4), 100–110.
Gençay, R. (1999). Linear, non-linear and essential foreign exchange rate prediction with simple technical trading rules. Journal of International Economics, 47(1), 91–107.
Ghatak, A. (2017). Machine Learning with R. Berlin: Springer.
Giles, C. L., Lawrence, S., & Tsoi, A. C. (2001). Noisy time series prediction using recurrent neural networks and grammatical inference. Machine Learning, 44(1–2), 161–183.
Gradojevic, N., & Yang, J. (2006). Non-linear, non-parametric, non-fundamental exchange rate forecasting. Journal of Forecasting, 25(4), 227–245.
Hann, T. H., & Steurer, E. (1996). Much ado about nothing? Exchange rate forecasting: Neural networks vs. linear models using monthly and weekly data. Neurocomputing, 10(4), 323–339.
Hansen, P. R. (2005). A test for superior predictive ability. Journal of Business and Economic Statistics, 23(4), 365–380.
Hansen, P. R., Lunde, A., & Nason, J. M. (2011). The model confidence set. Econometrica, 79(2), 453–497.
Hochreiter, S. (1991). Untersuchungen zu dynamischen neuronalen Netzen. Diploma thesis, TU Münich, 1606, 01865.
Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735–1780.
Hong, Y., & Lee, T. H. (2003). Inference on predictability of foreign exchange rates via generalized spectrum and nonlinear time series models. The Review of Economics and Statistics, 85(4), 1048–1062.
Hornik, K. (1991). Approximation capabilities of multilayer feedforward networks. Neural Networks, 4(2), 251–257.
Hornik, K., Stinchcombe, M., & White, H. (1989). Multilayer feedforward networks are universal approximators. Neural Networks, 2(5), 359–366.
Hsieh, D. A. (1989). Testing for nonlinear dependence in daily foreign exchange rates. The Journal of Business, 62(3), 339.
Jamal, A. M. M., & Sundar, C. (2011). Modeling exchange rates with neural networks. Journal of Applied Business Research (JABR), 14(1), 1.
Kaastra, I., & Boyd, M. (1996). Designing a neural network for forecasting financial and economic time series. Neurocomputing, 10(3), 215–236.
Khashei, M., Reza Hejazi, S., & Bijari, M. (2008). A new hybrid artificial neural networks and fuzzy regression model for time series forecasting. Fuzzy Sets and Systems, 159(7), 769–786.
Kiani, K. M., & Kastens, T. L. (2008). Testing forecast accuracy of foreign exchange rates: Predictions from feed forward and various recurrent neural network architectures. Computational Economics, 32(4), 383–406.
Kilian, L., & Taylor, M. P. (2003). Why is it difficult to beat the random walk forecast of exchange rates? Journal of International Economics, 60(1), 85–107.
Kirikos, D. G. (2000). Forecasting exchange rates out of sample: Random walk vs Markov switching regimes. Applied Economics Letters, 7(2), 133–136.
Kuan, C., & Liu, T. (1995). Forecasting exchange rates using feedforward and recurrent neural networks. Journal of Applied Econometrics, 10(4), 347–364.
Lai, K. K., Yu, L., Wang, S., & Huang, W. (2006). Hybridizing exponential smoothing and neural network for financial time series predication. In Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics), Springer Verlag, vol 3994 LNCS, (pp. 493–500).
Lee, H. Y., & Chen, S. L. (2006). Why use Markov-switching models in exchange rate prediction? Economic Modelling, 23(4), 662–668.
Lisi, F., & Schiavo, R. A. (1999). A comparison between neural networks and chaotic models for exchange rate prediction. Computational Statistics and Data Analysis, 30(1), 87–102.
López-Suárez, C. F., & Rodríguez-López, J. A. (2011). Nonlinear exchange rate predictability. Journal of International Money and Finance, 30(5), 877–895.
Marsh, I. W. (2000). High-frequency Markov switching models in the foreign exchange market. Journal of Forecasting, 19(2), 123–134.
Meese, R. (1982). The out-of-sample failure of empirical exchange rate models: Sampling error or misspecification? International Finance Discussion Paper, 204, 1–54.
Meese, R., & Rogoff, K. S. (1988). Was it real? The exchange rate-interest differential relation over the modern floating-rate period. The Journal of Finance, 43(4), 933–948.
Meese, R. A., & Rogoff, K. (1983). Empirical exchange rate models of the seventies: Do they fit out of sample? Journal of International Economics, 14(1–2), 3–24.
Meese, R. A., & Rose, A. K. (1991). An empirical assessment of non-linearities in models of exchange rate determination. The Review of Economic Studies, 58(3), 603.
Michael, P., Nobay, A. R., & Peel, D. A. (1997). Transactions costs and nonlinear adjustment in real exchange rates: An empirical investigation. Journal of Political Economy, 105(4), 862–879.
Mizrach, B. (1992). Multivariate nearest-neighbour forecasts of ems exchange rates. Journal of Applied Econometrics, 7(1 S), S151–S163.
Moosa, I., & Burns, K. (2014). The unbeatable random walk in exchange rate forecasting: Reality or myth? Journal of Macroeconomics, 40, 69–81.
Nag, A. K., & Mitra, A. (2002). Forecasting daily foreign exchange rates using genetically optimized neural networks. Journal of Forecasting, 21(7), 501–511.
Ni, H., & Yin, H. (2009). Exchange rate prediction using hybrid neural networks and trading indicators. Neurocomputing, 72(13–15), 2815–2823.
Nikolsko-Rzhevskyy, A., & Prodan, R. (2012). Markov switching and exchange rate predictability. International Journal of Forecasting, 28(2), 353–365.
Obstfeld, M., & Rogoff, K. (1995). Exchange rate dynamics redux. Journal of Political Economy, 103(3), 624–660.
Park, C., & Park, S. (2013). Exchange rate predictability and a monetary model with time-varying cointegration coefficients. Journal of International Money and Finance, 37, 394–410.
Parot, A., Michell, K., & Kristjanpoller, W. D. (2019). Using artificial neural networks to forecast exchange rate, including VAR-VECM residual analysis and prediction linear combination. Intelligent Systems in Accounting, Finance and Management, 26(1), 3–15.
Pascanu, R., Mikolov, T., & Bengio, Y. (2013). On the difficulty of training recurrent neural networks. In 30th international conference on machine learning, ICML 2013, PART 3 (pp. 2347–2355).
Pesaran, M. H., & Timmermann, A. (1992). A simple nonparametric test of predictive performance. Journal of Business & Economic Statistics, 10(4), 461.
Pippenger, M. K., & Goering, G. E. (1998). Exchange rate forecasting: Results from a threshold autoregressive model. Open Economies Review, 9(2), 157–170.
Qi, M., & Wu, Y. (2003). Nonlinear prediction of exchange rates with monetary fundamentals. Journal of Empirical Finance, 10(5), 623–640.
Qu, Y., & Zhao, X. (2019). Application of LSTM neural network in forecasting foreign exchange price. Journal of Physics: Conference Series, 1237, 042036.
Ranjit, S., Shrestha, S., Subedi, S., & Shakya, S. (2018). Comparison of algorithms in foreign exchange rate prediction. In Proceedings on 2018 IEEE 3rd international conference on computing, communication and security, ICCCS 2018 (pp. 9–13), Institute of Electrical and Electronics Engineers Inc.
Robinson, A., & Fallside, F. (1987). The utility driven dynamic error propagation network. In IEEE
Romano, J. P., & Wolf, M. (2005). Stepwise multiple testing as formalized data snooping. Econometrica, 73(4), 1237–1282.
Rossi, B. (2013). Exchange rate predictability. Journal of Economic Literature, 51(4), 1063–1119.
Saini, S. S., Parkhe, O., & Khadtare, P. T. D. (2016). Analysis of Feedforward and recurrent neural network in forecasting foreign exchange rate. Imperial Journal of Interdisciplinary Research, 2(6), 822–6.
Sezer, O. B., Gudelek, M. U., & Ozbayoglu, A. M. (2019). Financial time series forecasting with deep learning: A systematic literature review: 2005–2019. Applied Soft Computing, 90, 106181.
Shen, F., Chao, J., & Zhao, J. (2015). Forecasting exchange rate using deep belief networks and conjugate gradient method. Neurocomputing, 167, 243–253.
Smola, A. J., & Schölkopf, B. (2004). A tutorial on support vector regression
Sun, S., Wei, Y., & Wang, S. (2018). AdaBoost-LSTM ensemble learning for financial time series forecasting. In Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) (vol. 10862 LNCS, pp. 590–597).
Takens, F. (1981). Detecting strange attractors in turbulence (pp. 366–381). Berlin: Springer.
Tenti, P. (1996). Forecasting foreign exchange rates using recurrent neural networks. Applied Artificial Intelligence, 10(6), 567–582.
Teräsvirta, T. (2006). Forecasting economic variables with nonlinear models. In G. Elliott, C. Granger, & A. Timmermann (Eds.), Handbook of economic forecasting, handbook of economic forecasting (Vol. 1, pp. 413–457). Amsterdam: Elsevier. chap 8.
Tong, H. M. (1983). Threshold models in non-linear time series analysis. In Lecture notes in statistics, No.21
Tyree, E. W., & Long, J. A. (1995). Forecasting currency exchange rates: Neural networks and the random walk model. In Proceedings of the third international conference on artificial intelligence applications.
Vitek, F. (2005). The exchange rate forecasting puzzle. International finance: University Library of Munich, Germany.
Wang, J. Z., Wang, J. J., Zhang, Z. G., & Guo, S. P. (2011). Forecasting stock indices with back propagation neural network. Expert Systems with Applications, 38(11), 14346–14355.
Weigend, A. S., Huberman, B. A., & Rumelhart, D. E. (1992). Predicting sunspots and exchange rates with connectionist networks. Nonlinear Modeling and Forecasting, 12, 395–432.
West, K. D. (1996). Asymptotic inference about predictive ability. Econometrica, 64(5), 1067–1084.
White, H. (2000). A reality check for data snooping. Econometrica, 68(5), 1097–1126.
Wu, Y., & Gao, J. (2018). AdaBoost-based long short-term memory ensemble learning approach for financial time series forecasting. Current Science, 115(1), 152–159.
Yang, J., Lee, D., & Kim, J. (2019). Accident diagnosis and autonomous control of safety functions during the startup operation of nuclear power plants using LSTM. Advances in Intelligent Systems and Computing, Springer Verlag, 787, 488–499.
Yao, J., & Tan, C. L. (2000). A case study on using neural networks to perform technical forecasting of forex. Neurocomputing, 34, 79–98.
Yu, L., Wang, S., & Lai, K. K. (2007a). Are foreign exchange rates predictable? (pp. 3–23)., A literature review from artificial neural networks perspective Boston: Springer.
Yu, L., Wang, S., & Lai, K. K. (2007b). Foreign-exchange-rate forecasting with artificial neural networks, international series in operations research & management science (Vol. 107). Boston: Springer.
Zhang, B. (2018). Foreign exchange rates forecasting with an EMD-LSTM neural networks model. Journal of Physics: Conference Series, 1053, 12005.
Zhang, G., & Hu, M. Y. (1998). Neural network forecasting of the British pound/US dollar exchange rate. Omega, 26(4), 495–506.
Zhang, G. P., & Berardi, V. L. (2001). Time series forecasting with neural network ensembles: An application for exchange rate prediction. Journal of the Operational Research Society, 52(6), 652–664.
Zhang, P. G. (2003). Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing, 50, 159–175.
Zheng, J., Fu, X., & Zhang, G. (2019). Research on exchange rate forecasting based on deep belief network. Neural Computing and Applications, 31(1), 573–582.
Zipser, D., & Williams, R. J. (1995). Gradient-based learning algorithms for recurrent networks and their computational complexity (pp. 433–486). Back-propagation: Theory, Architectures and Applications.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Yilmaz, F.M., Arabaci, O. Should Deep Learning Models be in High Demand, or Should They Simply be a Very Hot Topic? A Comprehensive Study for Exchange Rate Forecasting. Comput Econ 57, 217–245 (2021). https://doi.org/10.1007/s10614-020-10047-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10614-020-10047-9