Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3292500.3332298acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
tutorial

Modeling and Applications for Temporal Point Processes

Published: 25 July 2019 Publication History
  • Get Citation Alerts
  • Abstract

    Real-world entities' behaviors, associated with their side information, are often recorded over time as asynchronous event sequences. Such event sequences are the basis of many practical applications, neural spiking train study, earth quack prediction, crime analysis, infectious disease diffusion forecasting, condition-based preventative maintenance, information retrieval and behavior-based network analysis and services, etc. Temporal point process (TPP) is a principled mathematical tool for the modeling and learning of asynchronous event sequences, which captures the instantaneous happening rate of the events and the temporal dependency between historical and current events. TPP provides us with an interpretable model to describe the generative mechanism of event sequences, which is beneficial for event prediction and causality analysis. Recently, it has been shown that TPP has potentials to many machine learning and data science applications and can be combined with other cutting-edge machine learning techniques like deep learning, reinforcement learning, adversarial learning, and so on.
    We will start with an elementary introduction of TPP model, including the basic concepts of the model, the simulation method of event sequences; in the second part of the tutorial, we will introduce typical TPP models and their traditional learning methods; in the third part of the tutorial, we will discuss the recent progress on the modeling and learning of TPP, including neural network-based TPP models, generative adversarial networks (GANs) for TPP, and deep reinforcement learning of TPP. We will further talk about the practical application of TPP, including useful data augmentation methods for learning from imperfect observations, typical applications and examples like healthcare and industry maintenance, and existing open source toolboxes.

    Supplementary Material

    Part 1 of 3 (p3227-yan_part1.mp4)
    Part 2 of 3 (p3227-yan_part2.mp4)
    Part 3 of 3 (p3227-yan_part3.mp4)

    References

    [1]
    E. Bacry, K. Dayri, and J. Muzy. 2012. Non-parametric kernel estimation for symmetric Hawkes processes. Application to high frequency financial data. The European Physical Journal B 85, 5 (2012), 157.
    [2]
    E. Bacry, I. Mastromatteo, and J. Muzy. 2015. Hawkes processes in finance. Market Microstructure and Liquidity 1, 01 (2015), 1550005.
    [3]
    A. G Hawkes. 1971. Point spectra of some mutually exciting point processes. Journal of the Royal Statistical Society. Series B (Methodological) (1971).
    [4]
    V. Isham and M. Westcott. 1979. A self-correcting point process. Stochastic processes and their applications 8, 3 (1979), 335--347.
    [5]
    S. Kanti K. Santu, L. Li, Y. Chang, and C. Zhai. 2018. JIM: Joint Influence Modeling for Collective Search Behavior. In CIKM.
    [6]
    E. Lewis and E. Mohler. 2011. A nonparametric EM algorithm for multiscale Hawkes processes. Journal of Nonparametric Statistics (2011).
    [7]
    L. Li, H. Deng, J. Chen, and Y. Chang. 2017. Learning Parametric Models for Context-Aware Query Auto-Completion via Hawkes Processes. In WSDM.
    [8]
    L. Li, H. Deng, A. Dong, Y. Chang, and H. Zha. 2014. Identifying and Labeling Search Tasks via Query-based Hawkes Processes. In KDD.
    [9]
    L. Li and H. Zha. 2018. Energy Usage Behavior Modeling in Energy Disaggregation via Hawkes Processes. ACM Trans. Intell. Syst. Technol. (2018).
    [10]
    S. Li, S. Xiao, S. Zhu, N. Du, Y. Xie, and L. Song. 2018. Learning temporal point processes via reinforcement learning. In NIPS.
    [11]
    T. Liniger. 2009. Multivariate hawkes processes. Ph.D. Dissertation. ETH Zurich.
    [12]
    X. Liu, J. Yan, S. Xiao, X. Wang, H. Zha, and S. Chu. 2017. On Predictive Patent Valuation: Forecasting Patent Citations and Their Types. In AAAI.
    [13]
    D. Luo, H. Xu, Y. Zhen, X. Ning, H. Zha, X. Yang, and W. Zhang. 2015. Multi-Task Multi-Dimensional Hawkes Processes for Modeling Event Sequences. In IJCAI. 3685--3691.
    [14]
    D. Marsan and O. Lengline. 2008. Extending earthquakes' reach through cascading. Science 319, 5866 (2008), 1076--1079.
    [15]
    J. Møller and J. G Rasmussen. 2006. Approximate simulation of Hawkes processes. Methodology and Computing in Applied Probability 8, 1 (2006), 53--64.
    [16]
    Y. Ogata. 1978. The asymptotic behaviour of maximum likelihood estimators for stationary point processes. Annals of the Institute of Statistical Mathematics 30, 1 (1978), 243--261.
    [17]
    Y. Ogata. 1988. Statistical models for earthquake occurrences and residual analysis for point processes. J. Amer. Statist. Assoc. (1988).
    [18]
    T. Ozaki. 1979. Maximum likelihood estimation of Hawkes' selfexciting point processes. Annals of the Institute of Statistical Mathematics 31, 1 (1979), 145--155.
    [19]
    U. Upadhyay, A. De, and M. G. Rodriguez. 2018. Deep reinforcement learning of marked temporal point processes. In NIPS.
    [20]
    W. Wu, J. Yan, X. Yang, and H. Zha. 2018. Decoupled learning for factorial marked temporal point processes. In KDD.
    [21]
    S. Xiao, M. Farajtabar, X. Ye, J. Yan, L. Song, and H. Zha. 2017. Wasserstein Learning of Deep Generative Point Process Models. In NIPS.
    [22]
    S. Xiao, H. Xu, J. Yan, M. Farajtabar, X. Yang, L. Song, and H. Zha. 2018. Learning conditional generative models for temporal point processes. In AAAI.
    [23]
    S. Xiao, J. Yan, M. Farajtabar, L. Song, X. Yang, and H. Zha. 2019. Learning Time Series Associated Event Sequences With Recurrent Point Process Networks. IEEE TNNLS (2019).
    [24]
    S. Xiao, J. Yan, C. Li, B. Jin, X. Wang, X. Yang, S. M Chu, and H. Zha. 2016. On Modeling and Predicting Individual Paper Citation Count over Time. In IJCAI.
    [25]
    S. Xiao, J. Yan, X. Yang, H. Zha, and S. Chu. 2017. Modeling the intensity function of point process via recurrent neural networks. In AAAI.
    [26]
    H. Xu, M. Farajtabar, and H. Zha. 2016. Learning granger causality for hawkes processes. In ICML. 1717--1726.
    [27]
    H. Xu, D. Luo, and H. Zha. 2017. Learning Hawkes Processes from Short Doubly-Censored Event Sequences. In ICML. 3831--3840.
    [28]
    L. Xu, J. A Duan, and A. Whinston. 2014. Path to purchase: A mutually exciting point process model for online advertising and conversion. Management Science 60, 6 (2014), 1392--1412.
    [29]
    J. Yan, X. Liu, L. Shi, C. Li, and H. Zha. 2018. Improving maximum likelihood estimation of temporal point process via discriminative and adversarial learning. In IJCAI.
    [30]
    J. Yan, Y. Wang, K. Zhou, J. Huang, C. Tian, H. Zha, and W. Dong. 2013. Towards Effective Prioritizing Water Pipe Replacement and Rehabilitation. In IJCAI.
    [31]
    J. Yan, S. Xiao, C. Li, B. Jin, X. Wang, B. Ke, X. Yang, and H. Zha. 2016. Modeling Contagious Merger and Acquisition via Point Processes with a Profile Regression Prior. In IJCAI.
    [32]
    S. Yang and H. Zha. 2013. Mixture of mutually exciting processes for viral diffusion. In ICML.

    Cited By

    View all
    • (2023)Toward Better Structure and Constraint to Mine Negative Sequential PatternsIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2020.304173234:2(571-585)Online publication date: Mar-2023
    • (2023)Reinforcement Learning for Stock Prediction and High-Frequency Trading With T+1 RulesIEEE Access10.1109/ACCESS.2022.319716511(14115-14127)Online publication date: 2023
    • (2022)Counterfactual temporal point processesProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3602069(24810-24823)Online publication date: 28-Nov-2022
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    KDD '19: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
    July 2019
    3305 pages
    ISBN:9781450362016
    DOI:10.1145/3292500
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 25 July 2019

    Check for updates

    Qualifiers

    • Tutorial

    Funding Sources

    • NSFC
    • STCSM
    • National Key Research and Development Program of China

    Conference

    KDD '19
    Sponsor:

    Acceptance Rates

    KDD '19 Paper Acceptance Rate 110 of 1,200 submissions, 9%;
    Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

    Upcoming Conference

    KDD '24

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)91
    • Downloads (Last 6 weeks)7
    Reflects downloads up to

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)Toward Better Structure and Constraint to Mine Negative Sequential PatternsIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2020.304173234:2(571-585)Online publication date: Mar-2023
    • (2023)Reinforcement Learning for Stock Prediction and High-Frequency Trading With T+1 RulesIEEE Access10.1109/ACCESS.2022.319716511(14115-14127)Online publication date: 2023
    • (2022)Counterfactual temporal point processesProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3602069(24810-24823)Online publication date: 28-Nov-2022
    • (2022)Resource Mapping Allocation Scheme in 6G Satellite Twin NetworkSensors10.3390/s2215581622:15(5816)Online publication date: 4-Aug-2022
    • (2022)Weld Defect Segmentation in X-ray Image with Boundary Label SmoothingApplied Sciences10.3390/app12241281812:24(12818)Online publication date: 14-Dec-2022
    • (2022)Neural Network based Temporal Point Processes for Attack Detection in Industrial Control Systems2022 IEEE International Conference on Cyber Security and Resilience (CSR)10.1109/CSR54599.2022.9850333(221-226)Online publication date: 27-Jul-2022
    • (2022)Identification and prediction of attacks to industrial control systems using temporal point processesJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-022-04416-514:5(4771-4783)Online publication date: 23-Sep-2022
    • (2021)A Survey on Embedding Dynamic GraphsACM Computing Surveys10.1145/348359555:1(1-37)Online publication date: 23-Nov-2021
    • (2021)Predicting activities of daily living via temporal point processesComputers and Electrical Engineering10.1016/j.compeleceng.2021.10756796:PBOnline publication date: 1-Dec-2021
    • (2021)Deep Structural Point Process for Learning Temporal Interaction NetworksMachine Learning and Knowledge Discovery in Databases. Research Track10.1007/978-3-030-86486-6_19(305-320)Online publication date: 10-Sep-2021
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media