Abstract
Missing values, a frequently encountered problem in time series due to network failures, device malfunctions. Such incomplete time series pose significant challenges to subsequent analysis of temporal data and hinder further investigations. Nevertheless, several counter measures are taken to impute missing values based on the historical data, ignoring spatial similarity or similar rate of change among variables of neighboring devices. To comprehensively consider both temporal and neighboring information, a Neighbor Incorporating Ordinary Differential Equation (NIODE) model is proposed for imputing missing data at arbitrary time points. Specifically, the encoder adopts a graph learning model to adaptively extract a graph adjacency matrix. Utilizing a K-nearest neighbor approach, the encoder identifies and incorporates the top-K nearest neighbors into a unified graph. A graph convolution network is then employed to learn adjacent information of neighboring variables. The temporal information is captured by applying a gate recurrent unit module, thereby obtaining a spatiotemporal prior. The decoder introduces an ordinary differential equation module to generate a series of continuous time latent states. These latent states are decoded by a linear network to fill in missing values. Extensive experiments on real-world datasets demonstrate the superior performance of NIODE against state-of-the-art methods.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Gas sensor array temperature modulation Data Set. Available on: https://archive.ics.uci.edu/ml/datasets/Gas+sensor+array+temperature+modulation.
- 2.
GAMS Indoor Air Quality Dataset. GitHub. Available: https://github.com/twairball/gams-dataset.
References
Tian, W., Haoxiong, K., Alireza, J., Sheng, W., Mohammad, H.S., Shuqiang, H.: Missing value filling based on the collaboration of cloud and edge in artificial intelligence of things. IEEE Trans. Industr. Inf. 18(8), 5394–5402 (2021)
Gianluigi, F., Francesco Sergio, P.: Evolving meta-ensemble of classifiers for handling incomplete and unbalanced datasets in the cyber security domain. Appl. Soft Comput. 47, 179–190 (2016)
Mehran, A., Jensen, J.: Missing data imputation using fuzzy-rough methods. Neurocomputing 205, 152–164 (2016)
Steven Cheng-Xian, L., Bo, J., Benjamin, B.: MisGAN: Learning from incomplete data with generative adversarial networks (2019). arXiv preprint arXiv:1902.09599
Zhengping, C., Sanjay, P., Kyunghyun, C., David, D., Yan, L.: Recurrent neural networks for multivariate time series with missing values. Sci. Rep. 8(1), 1–12 (2018)
Inci. M.B., Cao, X., Xi, Z., Fei, W., Anil, K., J.,Jiayu, Z.: Patient subtyping via time-aware LSTM networks. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 65–74 (2017)
Jinsung, Y., James, J., Mihaela, S.: GAIN: missing data imputation using generative adversarial nets. In: 35th International Conference on Machine Learning (ICML), pp. 5689–5698 (2018)
Yonghong, L., Ying, Z., Xiangrui, C., Xiaojie, Y.: E2GAN: end-to-end generative adversarial network for multivariate time series imputation. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI), pp. 3094–3100 (2019)
Ricky, T.C., Yulia, R., Jesse, B., David, K.B.: Neural ordinary differential equations. In: 32th Conference on Neural Information Processing Systems (NeurIPS), vol. 31 (2018)
Yulia, R., Ricky, T.C., David, K.D.: Latent ordinary differential equations for irregularly-sampled time series. In: 33th Conference on Neural Information Processing Systems (NeurIPS), vol. 32 (2019)
Zhuoqing, C., Shubo, L., Run, Q., Song, S., Zhaohui, C., Guoqing, T.: Time-aware neural ordinary differential equations for incomplete time series modeling. J. Supercomputing 79(16), 1–29 (2023)
Qianli, M., Sen, L., Run, Q., Cottrell, G.W.: Adversarial joint-learning recurrent neural network for incomplete time series classification. IEEE Trans. Pattern Anal. Mach. Intell. 44(4), 1765–1776 (2022)
Emilien, D., Arnaud, D., Yee, W.T.: Augmented neural odes. In: 33th Conference on Neural Information Processing Systems (NeurIPS), vol. 32 (2019)
Yaguang, L., Rose, Y., Shahabi, C., Yan, L.: Diffusion convolutional recurrent neural network: Data-driven traffic forecasting (2017). arXiv preprint arXiv:1707.01926
Zonghan, W., Shirui, P., Guodong, L., Jing, J., Xiaojun, C., Chengqi, Z.: Connecting the dots: multivariate time series forecasting with graph neural networks. Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 753–763 (2020)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Chang, Z., Liu, S., Cai, Z., Tu, G. (2024). Missing Data Imputation via Neighbor Data Feature-Enriched Neural Ordinary Differential Equations. In: Wand, M., Malinovská, K., Schmidhuber, J., Tetko, I.V. (eds) Artificial Neural Networks and Machine Learning – ICANN 2024. ICANN 2024. Lecture Notes in Computer Science, vol 15020. Springer, Cham. https://doi.org/10.1007/978-3-031-72344-5_12
Download citation
DOI: https://doi.org/10.1007/978-3-031-72344-5_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-72343-8
Online ISBN: 978-3-031-72344-5
eBook Packages: Computer ScienceComputer Science (R0)