Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3437963.3441827acmconferencesArticle/Chapter ViewAbstractPublication PageswsdmConference Proceedingsconference-collections
research-article

Time-Series Event Prediction with Evolutionary State Graph

Published: 08 March 2021 Publication History

Abstract

The accurate and interpretable prediction of future events in time-series data often requires the capturing of representative patterns (or referred to as states) underpinning the observed data. To this end, most existing studies focus on the representation and recognition of states, but ignore the changing transitional relations among them. In this paper, we present evolutionary state graph, a dynamic graph structure designed to systematically represent the evolving relations (edges) among states (nodes) along time. We conduct analysis on the dynamic graphs constructed from the time-series data and show that changes on the graph structures (e.g., edges connecting certain state nodes) can inform the occurrences of events (i.e., time-series fluctuation). Inspired by this, we propose a novel graph neural network model, Evolutionary State Graph Network (EvoNet), to encode the evolutionary state graph for accurate and interpretable time-series event prediction. Specifically, EvoNet models both the node-level (state-to-state) and graph-level (segment-to-segment) propagation, and captures the node-graph (state-to-segment) interactions over time. Experimental results based on five real-world datasets show that our approach not only achieves clear improvements compared with 11 baselines, but also provides more insights towards explaining the results of event predictions.

References

[1]
Pierre Ailliot and Valerie Monbet. 2012. Markov-switching autoregressive models for wind time series. Environmental Modelling and Software, Vol. 30 (2012), 92--101.
[2]
Anthony J Bagnall, Jason Lines, Aaron Bostrom, James Large, and Eamonn J Keogh. 2017. The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances. DMKD, Vol. 31, 3 (2017), 606--660.
[3]
Peter Battaglia, Jessica B Hamrick, Victor Bapst, Alvaro Sanchezgonzalez, Vinicius Flores Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, Adam Santoro, Ryan Faulkner, et al. 2018. Relational inductive biases, deep learning, and graph networks. arXiv: Learning (2018).
[4]
Peter Battaglia, Razvan Pascanu, Matthew Lai, Danilo Jimenez Rezende, and Koray Kavukcuoglu. 2016. Interaction networks for learning about objects, relations and physics. NeurIPS (2016), 4509--4517.
[5]
Yoshua Bengio, Patrice Y Simard, and Paolo Frasconi. 1994. Learning long-term dependencies with gradient descent is difficult. TNNLS, Vol. 5, 2 (1994), 157--166.
[6]
Philippe Loic Marie Bouttefroy, Abdesselam Bouzerdoum, Son Lam Phung, and Azeddine Beghdadi. 2010. On the analysis of background subtraction techniques using Gaussian Mixture Models. ICASSP (2010), 4042--4045.
[7]
Ulrik Brandes. 2001. A Faster Algorithm for Betweenness Centrality. Mathematical Sociology, Vol. 25, 2 (2001), 163--177.
[8]
Tianqi Chen and Carlos Guestrin. 2016. XGBoost: A Scalable Tree Boosting System. SIGKDD (2016), 785--794.
[9]
Ziqiang Cheng, Yang Yang, Wei Wang, Wenjie Hu, Yueting Zhuang, and Guojie Song. 2020. Time2Graph: Revisiting Time Series Modeling with Dynamic Shapelets. AAAI (2020), 3617--3624.
[10]
Junyoung Chung, Sungjin Ahn, and Yoshua Bengio. 2017. Hierarchical Multiscale Recurrent Neural Networks. ICLR (2017).
[11]
Junyoung Chung, Caglar Gulcehre, Kyunghyun Cho, and Yoshua Bengio. 2015. Gated Feedback Recurrent Neural Networks. ICML (2015), 2067--2075.
[12]
Nan Du, Hanjun Dai, Rakshit Trivedi, Utkarsh Upadhyay, Manuel Gomezrodriguez, and Le Song. 2016. Recurrent Marked Temporal Point Processes: Embedding Event History to Vector. SIGKDD (2016), 1555--1564.
[13]
David K Duvenaud, Dougal Maclaurin, Jorge Iparraguirre, Rafael Bombarell, Timothy Hirzel, Alán Aspuru-Guzik, and Ryan P Adams. 2015. Convolutional networks on graphs for learning molecular fingerprints. In NeurIPS. 2224--2232.
[14]
Rui Feng, Yang Yang, Wenjie Hu, Fei Wu, and Yueting Zhuang. 2018. Representation Learning for Scale-free Networks. AAAI (2018), 282--289.
[15]
Xu Geng, Yaguang Li, Leye Wang, Lingyu Zhang, Jieping Ye, Yan Liu, and Qiang Yang. 2019. Spatiotemporal Multi-Graph Convolution Network for Ride-hailing Demand Forecasting. AAAI, Vol. 33 (2019), 3656--3663.
[16]
Justin Gilmer, Samuel S Schoenholz, Patrick F Riley, Oriol Vinyals, and George E Dahl. 2017. Neural Message Passing for Quantum Chemistry. ICML (2017), 1263--1272.
[17]
David Hallac, Sagar Vare, Stephen P Boyd, and Jure Leskovec. 2017. Toeplitz Inverse Covariance-Based Clustering of Multivariate Time Series Data. SIGKDD (2017), 215--223.
[18]
William L Hamilton, Rex Ying, and Jure Leskovec. 2017. Inductive Representation Learning on Large Graphs. NeurIPS (2017).
[19]
Sepp Hochreiter and Jurgen Schmidhuber. 1997. Long Short-Term Memory. Neural Computation (1997), 1735--1780.
[20]
Wenjie Hu, Yang Yang, Jianbo Wang, Xuanwen Huang, and Ziqiang Cheng. 2020. Understanding Electricity-Theft Behavior via Multi-Source Data. WWW (2020), 2264--2274.
[21]
Tapas Kanungo, David M Mount, Nathan S Netanyahu, Christine D Piatko, Ruth Silverman, and Angela Y Wu. 2002. An efficient k-means clustering algorithm: analysis and implementation. TPAMI, Vol. 24, 7 (2002), 881--892.
[22]
Diederik P Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. ICLR (2015).
[23]
Yujia Li, Daniel Tarlow, Marc Brockschmidt, and Richard S Zemel. 2016. Gated Graph Sequence Neural Networks. ICLR (2016).
[24]
Jessica Lin, Eamonn J Keogh, Li Wei, and Stefano Lonardi. 2007. Experiencing SAX: a novel symbolic representation of time series. DMKD, Vol. 15, 2 (2007), 107--144.
[25]
Jessica Lin, Rohan Khade, and Yuan Li. 2012. Rotation-invariant similarity in time series using bag-of-patterns representation. IJIIS (2012), 287--315.
[26]
Jason Lines, Luke M Davis, Jon Hills, and Anthony Bagnall. 2012. A shapelet transform for time series classification. In SIGKDD. ACM, 289--297.
[27]
Yozen Liu, Xiaolin Shi, Lucas Pierce, and Xiang Ren. 2019. Characterizing and Forecasting User Engagement with In-app Action Graph: A Case Study of Snapchat. SIGKDD (2019), 2023--2031.
[28]
Yue Ning, Sathappan Muthiah, Huzefa Rangwala, and Naren Ramakrishnan. 2016. Modeling Precursors for Event Forecasting via Nested Multi-Instance Learning. SIGKDD (2016), 1095--1104.
[29]
Tore Opsahl, Filip Agneessens, and John Skvoretz. 2010. Node centrality in weighted networks: Generalizing degree and shortest paths. Social Networks, Vol. 32, 3 (2010), 245--251.
[30]
Lawrence Page, Sergey Brin, Rajeev Motwani, and Terry Winograd. 1999. The PageRank Citation Ranking: Bringing Order to the Web. WWW (1999), 161--172.
[31]
Aldo Pareja, Giacomo Domeniconi, Jie Chen, Tengfei Ma, Toyotaro Suzumura, Hiroki Kanezashi, Tim Kaler, and Charles E Leisersen. 2020. EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphs. AAAI (2020).
[32]
Razvan Pascanu, Tomas Mikolov, and Yoshua Bengio. 2013. On the difficulty of training recurrent neural networks. ICML (2013), 1310--1318.
[33]
Bryan Perozzi, Rami Alrfou, and Steven Skiena. 2014. DeepWalk: online learning of social representations. SIGKDD (2014), 701--710.
[34]
L R Rabiner and Biinghwang Juang. 1986. An introduction to hidden Markov models. IEEE Assp Magazine, Vol. 3, 1 (1986), 4--16.
[35]
Thanawin Rakthanmanon and Eamonn Keogh. 2013. Fast shapelets: A scalable algorithm for discovering time series shapelets. ICDM (2013), 668--676.
[36]
Alvaro Sanchez, Nicolas Heess, Jost Tobias Springenberg, Josh Merel, Raia Hadsell, Martin A Riedmiller, and Peter Battaglia. 2018. Graph Networks as Learnable Physics Engines for Inference and Control. ICML (2018), 4467--4476.
[37]
Pavel Senin and Sergey Malinchik. 2013. SAX-VSM: Interpretable Time Series Classification Using SAX and Vector Space Model. ICDM (2013), 1175--1180.
[38]
Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2018. Graph Attention Networks. ICLR (2018).
[39]
Yun Yang and Jianmin Jiang. 2014. HMM-based hybrid meta-clustering ensemble for temporal data. KBS (2014), 299--310.
[40]
Lekui Zhou, Yang Yang, Xiang Ren, Fei Wu, and Yueting Zhuang. 2018. Dynamic Network Embedding by Modeling Triadic Closure Process. AAAI (2018), 571--578.

Cited By

View all
  • (2025)Enhanced graph diffusion learning with dynamic transformer for anomaly detection in multivariate time seriesNeurocomputing10.1016/j.neucom.2024.129168619(129168)Online publication date: Feb-2025
  • (2024)Predicting wildfire events with calibrated probabilitiesProceedings of the 2024 16th International Conference on Machine Learning and Computing10.1145/3651671.3651708(168-175)Online publication date: 2-Feb-2024
  • (2024)EvoGWP: Predicting Long-Term Changes in Cloud Workloads Using Deep Graph-Evolution LearningIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.335771535:3(499-516)Online publication date: Mar-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WSDM '21: Proceedings of the 14th ACM International Conference on Web Search and Data Mining
March 2021
1192 pages
ISBN:9781450382977
DOI:10.1145/3437963
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 March 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. evolutionary state graph
  2. graph networks
  3. time series prediction

Qualifiers

  • Research-article

Funding Sources

  • the National Key Research and Development Project of China
  • NSF SMA
  • NSFC
  • DARPA MCS program

Conference

WSDM '21

Acceptance Rates

Overall Acceptance Rate 498 of 2,863 submissions, 17%

Upcoming Conference

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1,429
  • Downloads (Last 6 weeks)223
Reflects downloads up to 31 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2025)Enhanced graph diffusion learning with dynamic transformer for anomaly detection in multivariate time seriesNeurocomputing10.1016/j.neucom.2024.129168619(129168)Online publication date: Feb-2025
  • (2024)Predicting wildfire events with calibrated probabilitiesProceedings of the 2024 16th International Conference on Machine Learning and Computing10.1145/3651671.3651708(168-175)Online publication date: 2-Feb-2024
  • (2024)EvoGWP: Predicting Long-Term Changes in Cloud Workloads Using Deep Graph-Evolution LearningIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2024.335771535:3(499-516)Online publication date: Mar-2024
  • (2024)A Survey on Graph Neural Networks for Time Series: Forecasting, Classification, Imputation, and Anomaly DetectionIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2024.344314146:12(10466-10485)Online publication date: Dec-2024
  • (2024)Asymptotic Consistent Graph Structure Learning for Multivariate Time-Series Anomaly DetectionIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.336915973(1-10)Online publication date: 2024
  • (2024)Bridge successive states for a complex system with evolutionary matrixPhysica A: Statistical Mechanics and its Applications10.1016/j.physa.2024.129534637(129534)Online publication date: Mar-2024
  • (2024)Forecasting resource usage pattern changes in clouds via contrast graph-evolution learningFuture Generation Computer Systems10.1016/j.future.2024.01.013154(373-383)Online publication date: May-2024
  • (2024)Knowledge interaction graph guided prompting for event causality identificationApplied Intelligence10.1007/s10489-024-06095-555:2Online publication date: 13-Dec-2024
  • (2024)DGNN-MN: Dynamic Graph Neural Network via memory regenerate and neighbor propagationApplied Intelligence10.1007/s10489-024-05500-354:19(9253-9268)Online publication date: 12-Jul-2024
  • (2024)Generating Time Series by Using Latent SpaceAdvanced Intelligent Computing Technology and Applications10.1007/978-981-97-5666-7_22(258-268)Online publication date: 1-Aug-2024
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media