Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2588555.2612184acmconferencesArticle/Chapter ViewAbstractPublication PagesmodConference Proceedingsconference-collections
research-article

Localizing anomalous changes in time-evolving graphs

Published: 18 June 2014 Publication History

Abstract

Given a time-evolving sequence of undirected, weighted graphs, we address the problem of localizing anomalous changes in graph structure over time. In this paper, we use the term `localization' to refer to the problem of identifying abnormal changes in node relationships (edges) that cause anomalous changes in graph structure. While there already exist several methods that can detect whether a graph transition is anomalous or not, these methods are not well suited for localizing the edges which are responsible for a transition being marked as an anomaly. This is a limitation in applications such as insider threat detection, where identifying the anomalous graph transitions is not sufficient, but rather, identifying the anomalous node relationships and associated nodes is key. To this end, we propose a novel, fast method based on commute time distance called CAD (Commute-time based Anomaly detection in Dynamic graphs) that detects node relationships responsible for abnormal changes in graph structure. In particular, CAD localizes anomalous edges by tracking a measure that combines information regarding changes in graph structure (in terms of commute time distance) as well as changes in edge weights. For large, sparse graphs, CAD returns a list of these anomalous edges and associated nodes in O(n\log n) time per graph instance in the sequence, where $n$ is the number of nodes. We analyze the performance of CAD on several synthetic and real-world data sets such as the Enron email network, the DBLP co-authorship network and a worldwide precipitation network data. Based on experiments conducted, we conclude that CAD consistently and efficiently identifies anomalous changes in relationships between nodes over time.

References

[1]
L. Akoglu and C. Faloutsos. Event detection in time series of mobile communication graphs. In Army Science Conference, 2010.
[2]
L. Akoglu, M. McGlohon, and C. Faloutsos. Oddball: Spotting anomalies in weighted graphs. Advances in Knowledge Discovery and Data Mining, pages 410--421, 2010.
[3]
J. Batson, D. Spielman, N. Srivastava, and S. Teng. Spectral sparsification of graphs: theory and algorithms. Comm. of the ACM, 56(8):87--94, 2013.
[4]
M. Belkin and P. Niyogi. Laplacian eigenmaps and spectral techniques for embedding and clustering. Advances in NIPS, 14:585--591, 2001.
[5]
S. P. Borgatti. Centrality and network flow. Social Networks, 27(1):55--71, 2005.
[6]
H. Bunke, P. Dickinson, A. Humm, C. Irniger, and M. Kraetzl. Computer network monitoring and abnormal event detection using graph matching and multidimensional scaling. In Advances in Data Mining Applications in Medicine, Web Mining, Marketing, Image and Signal Mining, pages 576--590. 2006.
[7]
V. Chandola, A. Banerjee, and V. Kumar. Anomaly detection: A survey. ACM Computing Surveys, 41(3):1--58, 2009.
[8]
P. Chebotarev and E. Shamis. On proximity measures for graph vertices. arXiv preprint math/0602073, 2006.
[9]
J. Chen and I. Safro. A measure of the local connectivity between graph vertices. In Proc. of Int. Conf. on Computational Science, pages 196--205, 2011.
[10]
W. Eberle and L. Holder. Discovering structural anomalies in graph-based data. In ICDM Workshops, pages 393--398, 2007.
[11]
X. Gao, B. Xiao, D. Tao, and X. Li. A survey of graph edit distance. Pattern Analysis and Applications., 13(1):113--129, 2010.
[12]
T. Ide and H. Kashima. Eigenspace-based anomaly detection in computer systems. In ACM SIGKDD, pages 440--449, 2004.
[13]
I. Jovanović and Z. Stanić. Spectral distances of graphs. Linear Algebra and its Applications, 436(5):1425--1435, 2012.
[14]
N. Khoa and S. Chawla. Robust outlier detection using commute time and eigenspace embedding. In Advances in Knowledge Discovery and Data Mining, pages 422--434. 2010.
[15]
N. Khoa and S. Chawla. Large scale spectral clustering using resistance distance and spielman-teng solvers. In Discovery Science, pages 7--21, 2012.
[16]
M. Maybury, P. Chase, B. Cheikes, D. Brackney, S. Matzner, B. Wood, T. Longstaff, T. Hetherington, C. Sibley, J. Marin, L. Spitzner, J. Copeland, S. Lewandowski, and J. Haile. Analysis and detection of malicious insiders. In Conference on Intelligent Analysis., 2005.
[17]
C. Noble and D. Cook. Graph-based anomaly detection. In ACM SIGKDD, pages 631--636, 2003.
[18]
B. Pincombe. Anomaly detection in time series of graphs using arma processes. ASOR Bulletin, 24, 2005.
[19]
P. Shoubridge, M. Kraetzl, W. Wallis, and H. Bunke. Detection of abnormal change in a time series of graphs. Journal of Interconnection Networks, 3:85--101, 2002.
[20]
J. Sun, C. Faloutsos, S. Papadimitriou, and P. Yu. Graphscope: parameter-free mining of large time-evolving graphs. In ACM SIGKDD, pages 687--696, 2007.
[21]
J. Sun, Y. Xie, H. Zhang, and C. Faloutsos. Less is more: Compact matrix decomposition for large sparse graphs. Technical report, CS Dept., Carnegie Mellon University, 2007.
[22]
B. Thompson and T. Eliassi-rad. Dapa-v10: Discovery and analysis of patterns and anomalies in volatile time-evolving networks. In Workshop on Information in Networks, 2009.
[23]
L. Yen, D. Vanvyve, F. Wouters, F. Fouss, M. Verleysen, and M. Saerens. Clustering using a random walk based distance measure. In Proceedings of ESANN, pages 317--324, 2005.

Cited By

View all
  • (2025)Temporal multivariate-factors independence convolution network for anomaly detection in dynamic networksNeurocomputing10.1016/j.neucom.2025.129439(129439)Online publication date: Jan-2025
  • (2024)Online Detection of Anomalies in Temporal Knowledge Graphs with InterpretabilityProceedings of the ACM on Management of Data10.1145/36988232:6(1-26)Online publication date: 20-Dec-2024
  • (2024)Efficient Approximation of Kemeny's Constant for Large GraphsProceedings of the ACM on Management of Data10.1145/36549372:3(1-26)Online publication date: 30-May-2024
  • Show More Cited By

Index Terms

  1. Localizing anomalous changes in time-evolving graphs

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGMOD '14: Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data
    June 2014
    1645 pages
    ISBN:9781450323765
    DOI:10.1145/2588555
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 June 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. anomaly detection
    2. anomaly localization
    3. commute time distance
    4. dynamic graph analysis
    5. random walks
    6. temporal graphs

    Qualifiers

    • Research-article

    Conference

    SIGMOD/PODS'14
    Sponsor:

    Acceptance Rates

    SIGMOD '14 Paper Acceptance Rate 107 of 421 submissions, 25%;
    Overall Acceptance Rate 785 of 4,003 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)28
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 08 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Temporal multivariate-factors independence convolution network for anomaly detection in dynamic networksNeurocomputing10.1016/j.neucom.2025.129439(129439)Online publication date: Jan-2025
    • (2024)Online Detection of Anomalies in Temporal Knowledge Graphs with InterpretabilityProceedings of the ACM on Management of Data10.1145/36988232:6(1-26)Online publication date: 20-Dec-2024
    • (2024)Efficient Approximation of Kemeny's Constant for Large GraphsProceedings of the ACM on Management of Data10.1145/36549372:3(1-26)Online publication date: 30-May-2024
    • (2024)Efficient and Provable Effective Resistance Computation on Large Graphs: An Index-based ApproachProceedings of the ACM on Management of Data10.1145/36549362:3(1-27)Online publication date: 30-May-2024
    • (2024)Resistance Eccentricity in Graphs: Distribution, Computation and Optimization2024 IEEE 40th International Conference on Data Engineering (ICDE)10.1109/ICDE60146.2024.00315(4113-4126)Online publication date: 13-May-2024
    • (2024)Transformer-based anomaly detection in P-LEO constellations: A dynamic graph approachActa Astronautica10.1016/j.actaastro.2024.02.019218(177-194)Online publication date: May-2024
    • (2024)Statistical methods utilizing structural properties of time-evolving networks for event detectionData Mining and Knowledge Discovery10.1007/s10618-024-01060-938:6(3831-3867)Online publication date: 1-Nov-2024
    • (2023)Rare Category Analysis for Complex Data: A ReviewACM Computing Surveys10.1145/362652056:5(1-35)Online publication date: 27-Nov-2023
    • (2023)Efficient Estimation of Pairwise Effective ResistanceProceedings of the ACM on Management of Data10.1145/35886961:1(1-27)Online publication date: 30-May-2023
    • (2023)Anomaly Detection in Dynamic Graphs via TransformerIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2021.312406135:12(12081-12094)Online publication date: 1-Dec-2023
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media