Abstract
Time series forecasting is one of the most important issues in numerous applications in real life. The objective of this study was to propose a hybrid neural network model based on wavelet transform (WT) and feature extraction for time series forecasting. The motivation of the proposed model, which is called PCA-WCCNN, is to establish a single simplified model with shorter training time and satisfactory forecasting performance. This model combines the principal component analysis (PCA) and WT with artificial neural networks (ANNs). Given a forecasting sequence, order of the original forecasting model is determined firstly. Secondly, the original time series is decomposed into approximation and detail components by employing WT technique. Then, instead of using all the components as inputs, feature inputs are extracted from all the sub-series obtained from the above step. Finally, based on the extracted features and all the sub-series, a famous neural network construction method called cascade-correlation algorithm is applied to train neural network model to learn the dynamics. As an illustration, the proposed model is compared with two classical models and two hybrid models, respectively. They are the traditional cascade-correlation neural network, back-propagation neural network, wavelet-based cascade-correlation network using all the wavelet components as inputs to establish one model (WCCNN) and wavelet-based cascade-correlation network with combination of each sub-series model (WCCNN multi-models). Results obtained from this study indicate that the proposed method improves the accuracy of ANN and can yield better efficiency than other four neural network models.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Kumar Jain VK (1999) Autoregressive integrated moving averages (ARIMA) modeling of a traffic noise time series. Appl Acoust 58(3):283–294
Ediger VS, Akar S (2007) ARIMA forecasting of primary energy demand by fuel in Turkey. Energy Policy 35(3):1701–1708
Zhang GP (2003) Time series forecasting using a hybrid ARIMA and neural network model. Neurocomputing 50:159–175
Khashei M, Bijari M (2011) A novel hybridization of artificial neural networks and ARIMA models for time series forecasting. Appl Soft Comput 11:2664–2675
Gan M, Cheng Y, Liu K, Zhang G (2014) Seasonal and trend time series forecasting based on a quasi-linear autoregressive model. Appl Soft Comput 24:13–18
Chen R, Tsay RS (1993) Functional-coefficient autoregressive models. J Am Stat Assoc 88(421):298–308
Gan M, Peng H, Dong X (2012) A hybrid algorithm to optimize RBF network architecture and parameters for nonlinear time series modeling. Appl Math Model 36(7):2911–2919
Silva CGD (2008) Time series forecasting with a non-linear model and the scatter search meta-heuristic. Inf Sci 178:3288–3299
Zhang GP, Kline DM (2007) Quarterly time-series forecasting with neural networks. IEEE Trans Neural Netw 18(6):1800–1814
Gerald C, Dimitri S (2007) Knowledge-based modularization and global optimization of artificial neural network models in hydrological forecasting. Neural Netw 20(4):528–536
Hippert HS, Taylor JW (2010) An evaluation of Bayesian techniques for controlling model complexity and selecting inputs in a neural network for short-term load forecasting. Neural Netw 23(3):386–395
Talaee PH (2014) Multilayer perceptron with different training algorithms for streamflow forecasting. Neural Comput Appl 24:695–703
Adhikari R (2015) A neural network based linear ensemble framework for time series forecasting. Neurocomputing 157:231–242
Donate JP, Cortez P, Sánchez GG, Miguel AS (2013) Time series forecasting using a weighted cross-validation evolutionary artificial neural network ensemble. Neurocomputing 109:27–32
Firmino PRA, Neto PSGDM, Ferreira TAE (2014) Correcting and combining time series forecasters. Neural Netw 50:1–11
Joo TW, Kim SB (2015) Time series forecasting based on wavelet filtering. Expert Syst Appl 42:3868–3874
Seo Y, Kim S, Kisi O, Singh VP (2015) Daily water level forecasting using wavelet decomposition and artificial intelligence techniques. J Hydrol 520:224–243
Liu H, Tian H, Pan D, Li Y (2013) Forecasting models for wind speed using wavelet, wavelet packet, time series and artificial neural networks. Appl Energy 107:191–208
Karthikeyan L, Nagesh Kumar D (2013) Predictability of nonstationary time series using wavelet and EMD based ARMA models. J Hydrol 502:103–119
Ouyang Y (2005) Evaluation of river water quality monitoring stations by principal component analysis. Water Res 39:2621–2635
Wang J, Wang J (2015) Forecasting stock market indexes using principle component analysis an stochastic time effective neural networks. Neurocomputing 156:68–78
Heil CE, Walnut DF (1989) Continuous and discrete wavelet transforms. SIAM Rev 31(4):628–666
Gencay R, Selcuk F, Whitcher B (2001) an introduction to wavelets and other filtering methods in finance and economics. Academic Press, Elsevier
Mallat SG (1989) A theory for multiresolution signal decomposition: the wavelet representation. IEEE Trans Pattern Anal 11(7):674–693
Walker JS (2008) A primer on wavelets and their scientific applications. CRC Press
Amiady N, Keynia F (2009) Short-term load forecasting of power systems by combination of wavelet transform and neuro-evolutionary algorithm. Energy 34(1):46–57
Fahlman SE, Lebiere C (1990) The cascade-correlation learning architecture, in advances in neural information processing systems 2. Morgan Kaufmann, San Mateo, pp 524–532
Box GE, Jenkins GM, Reinsel GC, Ljung GM (2015) Time series analysis: forecasting and control. Wiley
Mackey MC, Glass L (1977) Oscillation and Chaos in physiological control systems. Science 197:287
Crowder RS (1991) Predicting the mackey-glass time series with cascade-correlation learning, connectionist models. In: Proceedings of the 1990 summer school, pp 117–123
Zhao JS, Yu XJ (2015) Adaptive natural gradient learning algorithms for Mackey-Glass chaotic time prediciton. Neurocomputing 157:41–45
Mohammadi R, Fatemi Ghomi SMT, Zeinali F (2014) A new hybrid evolutionary based RBF networks method for forecasting time series: a case study of forecasting emergency supply demand time series. Eng Appl Artif Intell 36:204–214
Nourani V, Alami MT, Aminfar MH (2009) A combined neural-wavelet model for prediction of Ligvanchai watershed precipitation. Eng Appl Artif Intell 22(3):466–472
Adamowski J, Chan HF (2011) A wavelet neural network conjunction model for groundwater level forecasting. J Hydrol 407(1):28–40
Chester DL (1990) Why two hidden layers are better than one? In: Proceedings of the international joint conference on neural networks, pp 1265–1268
Zhang X (1994) Time series analysis and prediction by neural networks. Optim Method Softw 4:151–170
Hornik K, Stinchcombe M, White H (1989) Multilayer feedforward networks are universal approximators. Neural Netw 2(5):359–366
Acknowledgments
The authors gratefully acknowledge the financial support of this research by the National Natural Science Foundation of China (Grant No. 61374006), the Major Program of National Natural Science Foundation of China (Grant No. 11190015) and the Natural Science Foundation of Jiangsu (Grant No. BK20131300).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Liu, T., Wei, H., Zhang, C. et al. Time series forecasting based on wavelet decomposition and feature extraction. Neural Comput & Applic 28 (Suppl 1), 183–195 (2017). https://doi.org/10.1007/s00521-016-2306-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-016-2306-8