Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Missing Data Imputation via Neighbor Data Feature-Enriched Neural Ordinary Differential Equations

  • Conference paper
  • First Online:
Artificial Neural Networks and Machine Learning – ICANN 2024 (ICANN 2024)

Abstract

Missing values, a frequently encountered problem in time series due to network failures, device malfunctions. Such incomplete time series pose significant challenges to subsequent analysis of temporal data and hinder further investigations. Nevertheless, several counter measures are taken to impute missing values based on the historical data, ignoring spatial similarity or similar rate of change among variables of neighboring devices. To comprehensively consider both temporal and neighboring information, a Neighbor Incorporating Ordinary Differential Equation (NIODE) model is proposed for imputing missing data at arbitrary time points. Specifically, the encoder adopts a graph learning model to adaptively extract a graph adjacency matrix. Utilizing a K-nearest neighbor approach, the encoder identifies and incorporates the top-K nearest neighbors into a unified graph. A graph convolution network is then employed to learn adjacent information of neighboring variables. The temporal information is captured by applying a gate recurrent unit module, thereby obtaining a spatiotemporal prior. The decoder introduces an ordinary differential equation module to generate a series of continuous time latent states. These latent states are decoded by a linear network to fill in missing values. Extensive experiments on real-world datasets demonstrate the superior performance of NIODE against state-of-the-art methods.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 64.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Gas sensor array temperature modulation Data Set. Available on: https://archive.ics.uci.edu/ml/datasets/Gas+sensor+array+temperature+modulation.

  2. 2.

    GAMS Indoor Air Quality Dataset. GitHub. Available: https://github.com/twairball/gams-dataset.

References

  1. Tian, W., Haoxiong, K., Alireza, J., Sheng, W., Mohammad, H.S., Shuqiang, H.: Missing value filling based on the collaboration of cloud and edge in artificial intelligence of things. IEEE Trans. Industr. Inf. 18(8), 5394–5402 (2021)

    Google Scholar 

  2. Gianluigi, F., Francesco Sergio, P.: Evolving meta-ensemble of classifiers for handling incomplete and unbalanced datasets in the cyber security domain. Appl. Soft Comput. 47, 179–190 (2016)

    Article  Google Scholar 

  3. Mehran, A., Jensen, J.: Missing data imputation using fuzzy-rough methods. Neurocomputing 205, 152–164 (2016)

    Article  Google Scholar 

  4. Steven Cheng-Xian, L., Bo, J., Benjamin, B.: MisGAN: Learning from incomplete data with generative adversarial networks (2019). arXiv preprint arXiv:1902.09599

  5. Zhengping, C., Sanjay, P., Kyunghyun, C., David, D., Yan, L.: Recurrent neural networks for multivariate time series with missing values. Sci. Rep. 8(1), 1–12 (2018)

    Google Scholar 

  6. Inci. M.B., Cao, X., Xi, Z., Fei, W., Anil, K., J.,Jiayu, Z.: Patient subtyping via time-aware LSTM networks. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 65–74 (2017)

    Google Scholar 

  7. Jinsung, Y., James, J., Mihaela, S.: GAIN: missing data imputation using generative adversarial nets. In: 35th International Conference on Machine Learning (ICML), pp. 5689–5698 (2018)

    Google Scholar 

  8. Yonghong, L., Ying, Z., Xiangrui, C., Xiaojie, Y.: E2GAN: end-to-end generative adversarial network for multivariate time series imputation. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI), pp. 3094–3100 (2019)

    Google Scholar 

  9. Ricky, T.C., Yulia, R., Jesse, B., David, K.B.: Neural ordinary differential equations. In: 32th Conference on Neural Information Processing Systems (NeurIPS), vol. 31 (2018)

    Google Scholar 

  10. Yulia, R., Ricky, T.C., David, K.D.: Latent ordinary differential equations for irregularly-sampled time series. In: 33th Conference on Neural Information Processing Systems (NeurIPS), vol. 32 (2019)

    Google Scholar 

  11. Zhuoqing, C., Shubo, L., Run, Q., Song, S., Zhaohui, C., Guoqing, T.: Time-aware neural ordinary differential equations for incomplete time series modeling. J. Supercomputing 79(16), 1–29 (2023)

    Google Scholar 

  12. Qianli, M., Sen, L., Run, Q., Cottrell, G.W.: Adversarial joint-learning recurrent neural network for incomplete time series classification. IEEE Trans. Pattern Anal. Mach. Intell. 44(4), 1765–1776 (2022)

    Article  Google Scholar 

  13. Emilien, D., Arnaud, D., Yee, W.T.: Augmented neural odes. In: 33th Conference on Neural Information Processing Systems (NeurIPS), vol. 32 (2019)

    Google Scholar 

  14. Yaguang, L., Rose, Y., Shahabi, C., Yan, L.: Diffusion convolutional recurrent neural network: Data-driven traffic forecasting (2017). arXiv preprint arXiv:1707.01926

  15. Zonghan, W., Shirui, P., Guodong, L., Jing, J., Xiaojun, C., Chengqi, Z.: Connecting the dots: multivariate time series forecasting with graph neural networks. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 753–763 (2020)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Zhuoqing Chang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chang, Z., Liu, S., Cai, Z., Tu, G. (2024). Missing Data Imputation via Neighbor Data Feature-Enriched Neural Ordinary Differential Equations. In: Wand, M., Malinovská, K., Schmidhuber, J., Tetko, I.V. (eds) Artificial Neural Networks and Machine Learning – ICANN 2024. ICANN 2024. Lecture Notes in Computer Science, vol 15020. Springer, Cham. https://doi.org/10.1007/978-3-031-72344-5_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-72344-5_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-72343-8

  • Online ISBN: 978-3-031-72344-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics