Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

A stock series prediction model based on variational mode decomposition and dual-channel attention network

Published: 27 February 2024 Publication History
  • Get Citation Alerts
  • Abstract

    Due to the comprehensive impact of external factors (politics, economy, market, etc.) and internal factors (organizational structure, management ability, innovation capability, etc.), stock series exhibit strong volatility. Coupled with their inherent high liquidity, it poses great challenges for stock series prediction. However, the previous stock series forecasting methods often only pay attention to the long-term dependencies, and lack attention to the local features and short-term dependencies. In this regard a stock series prediction model based on variational mode decomposition and dual-channel attention network is proposed, which is called VMD-LSTMA+TCNA. To prevent information leakage, the stock series is divided into equal-length sub-windows by sliding window. To reduce the series volatility, each sub-window is decomposed into different frequency mode sub-windows through variational mode decomposition (VMD). To improve the prediction accuracy and robustness in different stock markets, we construct a dual-channel attention model called LSTMA+TCNA. The LSTMA channel is used to extract long-term dependencies and temporally correlated features, while the TCNA channel is used to extract local patterns and short-term dependencies, and self-attention is added to both channels to increase the weight of features at important times. Predict each frequency mode sub-window separately through the specific LSTMA and TCNA channels, and then obtain the predicted values by fusing the results of dual-channel. The final predicted stock series is obtained by superimposing the predicted values of each frequency mode sub-window. Through extensive experiments on the US and Hong Kong stock markets, it has been shown that the VMD-LSTMA+TCNA model exhibits better robustness and generalization compared to other state-of-the-art methods and has higher prediction accuracy.

    Highlights

    Series is decomposed into some approximately stationary series by the VMD method.
    We combined LSTM and TCN to form a dual-channel network.
    The self-attention mechanism is introduced into the dual-channel network.
    The proposed model outperforms other latest models in terms of prediction accuracy.

    References

    [1]
    Adebiyi A.A., Adewumi A.O., Ayo C.K., Comparison of ARIMA and artificial neural networks models for stock price prediction, Journal of Applied Mathematics 2014 (2014).
    [2]
    Ariyo A.A., Adewumi A.O., Ayo C.K., Stock price prediction using the ARIMA model, in: 2014 UKSim-AMSS 16th international conference on computer modelling and simulation, IEEE, 2014, pp. 106–112.
    [3]
    Bai S., Kolter J.Z., Koltun V., An empirical evaluation of generic convolutional and recurrent networks for sequence modeling, 2018, arXiv preprint arXiv:1803.01271.
    [4]
    Chen X., Ma X., Wang H., Li X., Zhang C., A hierarchical attention network for stock prediction based on attentive multi-view news learning, Neurocomputing 504 (2022) 1–15.
    [5]
    Cheng L.-C., Huang Y.-H., Wu M.-E., Applied attention-based LSTM neural networks in stock prediction, in: 2018 IEEE international conference on big data (Big Data), IEEE, 2018, pp. 4716–4718.
    [6]
    De Fortuny E.J., De Smedt T., Martens D., Daelemans W., Evaluating and understanding text-based stock price prediction models, Information Processing & Management 50 (2) (2014) 426–441.
    [7]
    Dragomiretskiy K., Zosso D., Variational mode decomposition, IEEE Transactions on Signal Processing 62 (3) (2013) 531–544.
    [8]
    Gan Z., Li C., Zhou J., Tang G., Temporal convolutional networks interval prediction model for wind speed forecasting, Electric Power Systems Research 191 (2021).
    [9]
    Hochreiter S., Schmidhuber J., Long short-term memory, Neural Computation 9 (8) (1997) 1735–1780.
    [10]
    Hu Z., Zhao Y., Khushi M., A survey of forex and stock price prediction using deep learning, Applied System Innovation 4 (1) (2021) 9.
    [11]
    Huang N.E., Shen Z., Long S.R., Wu M.C., Shih H.H., Zheng Q., Yen N.-C., Tung C.C., Liu H.H., The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences 454 (1971) (1998) 903–995.
    [12]
    Ince H., Trafalis T.B., Short term forecasting with support vector machines and application to stock price prediction, International Journal of General Systems 37 (6) (2008) 677–687.
    [13]
    Klambauer G., Unterthiner T., Mayr A., Hochreiter S., Self-normalizing neural networks, Advances in Neural Information Processing Systems 30 (2017).
    [14]
    Kok C., Jahmunah V., Oh S.L., Zhou X., Gururajan R., Tao X., Cheong K.H., Gururajan R., Molinari F., Acharya U.R., Automated prediction of sepsis using temporal convolutional network, Computers in Biology and Medicine 127 (2020).
    [15]
    Lahmiri S., Intraday stock price forecasting based on variational mode decomposition, Journal of Computer Science 12 (2016) 23–27.
    [16]
    Li C., Zhang X., Qaosar M., Ahmed S., Alam K.M.R., Morimoto Y., Multi-factor based stock price prediction using hybrid neural networks with attention mechanism, in: 2019 IEEE intl conf on dependable, autonomic and secure computing, intl conf on pervasive intelligence and computing, intl conf on cloud and big data computing, intl conf on cyber science and technology congress (DASC/PiCom/CBDCom/CyberSciTech), IEEE, 2019, pp. 961–966.
    [17]
    Lin Y., Lin Z., Liao Y., Li Y., Xu J., Yan Y., Forecasting the realized volatility of stock price index: A hybrid model integrating CEEMDAN and LSTM, Expert Systems with Applications 206 (2022).
    [18]
    Liu T., Ma X., Li S., Li X., Zhang C., A stock price prediction method based on meta-learning and variational mode decomposition, Knowledge-Based Systems 252 (2022).
    [19]
    Liu H., Zhao T., Wang S., Li X., A stock rank prediction method combining industry attributes and price data of stocks, Information Processing & Management 60 (4) (2023).
    [20]
    Lu W., Li J., Li Y., Sun A., Wang J., A CNN-LSTM-based model to forecast stock prices, Complexity 2020 (2020).
    [21]
    Lu W., Li J., Wang J., Qin L., A CNN-BiLSTM-AM method for stock price prediction, Neural Computing and Applications 33 (10) (2021) 4741–4753.
    [22]
    Lv Y., Duan Y., Kang W., Li Z., Wang F.-Y., Traffic flow prediction with big data: a deep learning approach, IEEE Transactions on Intelligent Transportation Systems 16 (2) (2014) 865–873.
    [23]
    Lv P., Shu Y., Xu J., Wu Q., Modal decomposition-based hybrid model for stock index prediction, Expert Systems with Applications 202 (2022).
    [24]
    Ma, X., Karkus, P., Hsu, D., & Lee, W. S. (2020). Particle filter recurrent neural networks. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34 (pp. 5101–5108).
    [25]
    Ma X., Zhao T., Guo Q., Li X., Zhang C., Fuzzy hypergraph network for recommending top-k profitable stocks, Information Sciences 613 (2022) 239–255.
    [26]
    Mintarya L.N., Halim J.N., Angie C., Achmad S., Kurniawan A., Machine learning approaches in stock market prediction: A systematic literature review, Procedia Computer Science 216 (2023) 96–102.
    [27]
    Niu H., Xu K., Wang W., A hybrid stock price index forecasting model based on variational mode decomposition and LSTM network, Applied Intelligence 50 (12) (2020) 4296–4309.
    [28]
    Oreshkin, B. N., Carpov, D., Chapados, N., & Bengio, Y. (2019). N-BEATS: Neural basis expansion analysis for interpretable time series forecasting. In International conference on learning representations.
    [29]
    Rezaei H., Faaljou H., Mansourfar G., Stock price prediction using deep learning and frequency decomposition, Expert Systems with Applications 169 (2021).
    [30]
    Roondiwala M., Patel H., Varma S., Predicting stock prices using LSTM, International Journal of Science and Research (IJSR) 6 (4) (2017) 1754–1756.
    [31]
    Schierholt K., Dagli C.H., Stock market prediction using different neural network classification architectures, in: IEEE/IAFE 1996 conference on computational intelligence for financial engineering (CIFEr), IEEE, 1996, pp. 72–78.
    [32]
    Selvin S., Vinayakumar R., Gopalakrishnan E., Menon V.K., Soman K., Stock price prediction using LSTM, RNN and CNN-sliding window model, in: 2017 international conference on advances in computing, communications and informatics (Icacci), IEEE, 2017, pp. 1643–1647.
    [33]
    Song G., Zhao T., Wang S., Wang H., Li X., Stock ranking prediction using a graph aggregation network based on stock price and stock relationship information, Information Sciences (2023).
    [34]
    Sunny M.A.I., Maswood M.M.S., Alharbi A.G., Deep learning-based stock price prediction using LSTM and bi-directional LSTM model, in: 2020 2nd novel intelligent and leading emerging sciences conference (NILES), IEEE, 2020, pp. 87–92.
    [35]
    Torres M.E., Colominas M.A., Schlotthauer G., Flandrin P., A complete ensemble empirical mode decomposition with adaptive noise, in: 2011 IEEE international conference on acoustics, speech and signal processing (ICASSP), IEEE, 2011, pp. 4144–4147.
    [36]
    Vaswani A., Shazeer N., Parmar N., Uszkoreit J., Jones L., Gomez A.N., Kaiser Ł., Polosukhin I., Attention is all you need, Advances in Neural Information Processing Systems 30 (2017).
    [37]
    Wang R., Li C., Fu W., Tang G., Deep learning method based on gated recurrent unit and variational mode decomposition for short-term wind power interval prediction, IEEE Transactions on Neural Networks and Learning Systems 31 (10) (2019) 3814–3827.
    [38]
    Wei L.-Y., A hybrid ANFIS model based on empirical mode decomposition for stock time series forecasting, Applied Soft Computing 42 (2016) 368–376.
    [39]
    Wu Z., Huang N.E., Ensemble empirical mode decomposition: a noise-assisted data analysis method, Advances in Adaptive Data Analysis 1 (01) (2009) 1–41.
    [40]
    Yan X., Liu Y., Xu Y., Jia M., Multistep forecasting for diurnal wind speed based on hybrid deep learning model with improved singular spectrum decomposition, Energy Conversion and Management 225 (2020).
    [41]
    Yang Y., Wang J., Forecasting wavelet neural hybrid network with financial ensemble empirical mode decomposition and MCID evaluation, Expert Systems with Applications 166 (2021).
    [42]
    Yang L., Zhang Z., Xiong S., Wei L., Ng J., Xu L., Dong R., Explainable text-driven neural network for stock prediction, in: 2018 5th IEEE international conference on cloud computing and intelligence systems (CCIS), IEEE, 2018, pp. 441–445.
    [43]
    Yuan C., Ma X., Wang H., Zhang C., Li X., COVID19-MLSF: A multi-task learning-based stock market forecasting framework during the COVID-19 pandemic, Expert Systems with Applications 217 (2023).
    [44]
    Yujun Y., Yimei Y., Jianhua X., A hybrid prediction method for stock price using LSTM and ensemble EMD, Complexity 2020 (2020).
    [45]
    Zhao F., Gao Y., Li X., An Z., Ge S., Zhang C., A similarity measurement for time series and its application to the stock market, Expert Systems with Applications 182 (2021).
    [46]
    Zhao F., Li X., Gao Y., Li Y., Feng Z., Zhang C., Multi-layer features ablation of BERT model and its application in stock trend prediction, Expert Systems with Applications 207 (2022).
    [47]
    Zhao T., Ma X., Li X., Zhang C., Asset correlation based deep reinforcement learning for the portfolio selection, Expert Systems with Applications 221 (2023).
    [48]
    Zhou F., Zhou H.-m., Yang Z., Yang L., EMD2FNN: A strategy combining empirical mode decomposition and factorization machine based neural network for stock market trend prediction, Expert Systems with Applications 115 (2019) 136–151.
    [49]
    Zhu R., Liao W., Wang Y., Short-term prediction for wind power based on temporal convolutional network, Energy Reports 6 (2020) 424–429.

    Cited By

    View all
    • (2024)A novel hierarchical feature selection with local shuffling and models reweighting for stock price forecastingExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123482249:PAOnline publication date: 1-Sep-2024

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Expert Systems with Applications: An International Journal
    Expert Systems with Applications: An International Journal  Volume 238, Issue PA
    Mar 2024
    1584 pages

    Publisher

    Pergamon Press, Inc.

    United States

    Publication History

    Published: 27 February 2024

    Author Tags

    1. Stock series prediction
    2. Variational mode decomposition
    3. Dual-channel attention network

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 27 Jul 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)A novel hierarchical feature selection with local shuffling and models reweighting for stock price forecastingExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123482249:PAOnline publication date: 1-Sep-2024

    View Options

    View options

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media