Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.5555/3298483.3298589guideproceedingsArticle/Chapter ViewAbstractPublication PagesConference Proceedingsacm-pubtype
Article

Matching node embeddings for graph similarity

Published: 04 February 2017 Publication History

Abstract

Graph kernels have emerged as a powerful tool for graph comparison. Most existing graph kernels focus on local properties of graphs and ignore global structure. In this paper, we compare graphs based on their global properties as these are captured by the eigenvectors of their adjacency matrices. We present two algorithms for both labeled and unlabeled graph comparison. These algorithms represent each graph as a set of vectors corresponding to the embeddings of its vertices. The similarity between two graphs is then determined using the Earth Mover's Distance metric. These similarities do not yield a positive semidefinite matrix. To address for this, we employ an algorithm for SVM classification using indefinite kernels. We also present a graph kernel based on the Pyramid Match kernel that finds an approximate correspondence between the sets of vectors of the two graphs. We further improve the proposed kernel using the Weisfeiler-Lehman framework. We evaluate the proposed methods on several benchmark datasets for graph classification and compare their performance to state-of-the-art graph kernels. In most cases, the proposed algorithms outperform the competing methods, while their time complexity remains very attractive.

References

[1]
Borgwardt, K. M., and Kriegel, H. 2005. Shortest-path kernels on graphs. In Proceedings of the 5th International Conference on Data Mining, 74-81.
[2]
Borgwardt, K. M.; Ong, C. S. and Schönauer, S.; Vishwanathan, S.; Smola, A. J.; and Kriegel, H. 2005. Protein function prediction via graph kernels. Bioinformatics 21(Suppl. 1):i47-i56.
[3]
Chang, C., and Lin, C. 2011. LIBSVM: A Library for Support Vector Machines. ACM Transactions on Intelligent Systems and Technology 2(3):27.
[4]
Debnath, A. K.; Lopez de Compadre, R. L.; Debnath, G.; Shusterman, A. J.; and Hansch, C. 1991. Structure-Activity Relationship of Mutagenic Aromatic and Heteroaromatic Nitro Compounds. Correlation with Molecular Orbital Energies and Hydrophobicity. Journal of Medicinal Chemistry 34(2):786-797.
[5]
Dobson, P. D., and Doig, A. J. 2003. Distinguishing Enzyme Structures from Non-enzymes Without Alignments. Journal of molecular biology 330(4):771-783.
[6]
Feragen, A.; Kasenburg, N.; Petersen, J.; de Bruijne, M.; and Borgwardt, K. 2013. Scalable kernels for graphs with continuous attributes. In Advances in Neural Information Processing Systems, 216-224.
[7]
Gärtner, T.; Flach, P.; and Wrobel, S. 2003. On Graph Kernels: Hardness Results and Efficient Alternatives. In Learning Theory and Kernel Machines. 129-143.
[8]
Gower, J. C., and Legendre, P. 1986. Metric and euclidean properties of dissimilarity coefficients. Journal of classification 3(1):5-48.
[9]
Gower, J. C. 1982. Euclidean Distance Geometry. Mathematical Scientist 7(1):1-14.
[10]
Grauman, K., and Darrell, T. 2007. The Pyramid Match Kernel: Efficient Learning with Sets of Features. The Journal of Machine Learning Research 8:725-760.
[11]
Hermansson, L.; Kerola, T.; Johansson, F.; Jethava, V.; and Dubhashi, D. 2013. Entity Disambiguation in Anonymized Graphs using Graph Kernels. In Proceedings of the 22nd ACM International Conference on Conference on Information & Knowledge Management, 1037-1046.
[12]
Horváth, T.; Gärtner, T.; and Wrobel, S. 2004. Cyclic Pattern Kernels for Predictive Graph Mining. In Proceedings of the 10th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 158-167.
[13]
Jackson, M. O. 2010. Social and Economic Networks. Princeton University Press.
[14]
Johansson, F. D., and Dubhashi, D. 2015. Learning with Similarity Functions on Graphs using Matchings of Geometric Embeddings. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 467-476.
[15]
Johansson, F.; Jethava, V.; Dubhashi, D.; and Bhattacharyya, C. 2014. Global graph kernels using geometric embeddings. In Proceedings of the 31st International Conference on Machine Learning, 694-702.
[16]
Kashima, H.; Tsuda, K.; and Inokuchi, A. 2003. Marginalized Kernels Between Labeled Graphs. In Proceedings of the 20th Conference in Machine Learning, 321-328.
[17]
Kusner, M.; Sun, Y.; Kolkin, N.; and Weinberger, K. Q. 2015. From Word Embeddings To Document Distances. In Proceedings of the 32nd International Conference on Machine Learning, 957-966.
[18]
Lazebnik, S.; Schmid, C.; and Ponce, J. 2006. Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. In Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition, volume 2, 2169-2178.
[19]
Luss, R., and d'Aspremont, A. 2008. Support Vector Machine Classification with Indefinite Kernels. In Advances in Neural Information Processing Systems, 953-960.
[20]
Mahé, P., and Vert, J. 2009. Graph kernels based on tree patterns for molecules. Machine learning 75(1):3-35.
[21]
Naor, A., and Schechtman, G. 2007. Planar Earthmover is not in L1. SIAM Journal on Computing 37(3):804-826.
[22]
Pele, O., and Werman, M. 2009. Fast and robust earth mover's distances. In Proceedings of the 12th International Conference on Computer Vision, 460-467.
[23]
Rubner, Y.; Tomasi, C.; and Guibas, L. J. 2000. The Earth Mover's Distance as a Metric for Image Retrieval. International Journal of Computer Vision 40(2):99-121.
[24]
Schoenberg, I. J. 1935. Remarks to Maurice Frechet's Article "Sur La Definition Axiomatique D'Une Classe D'Espace Distances Vectoriellement Applicable Sur L'Espace De Hilbert". Annals of Mathematics 724-732.
[25]
Schölkopf, B.; Tsuda, K.; and Vert, J.-P. 2004. Kernel Methods in Computational Biology. MIT press.
[26]
Shervashidze, N.; Petri, T.; Mehlhorn, K.; Borgwardt, K. M.; and Vishwanathan, S. 2009. Efficient Graphlet Kernels for Large Graph Comparison. In Proceedings of the International Conference on Artificial Intelligence and Statistics, 488-495.
[27]
Shervashidze, N.; Schweitzer, P.; Van Leeuwen, E. J.; Mehlhorn, K.; and Borgwardt, K. M. 2011. Weisfeiler-Lehman Graph Kernels. The Journal of Machine Learning Research 12:2539-2561.
[28]
Su, Y.; Han, F.; Harang, R. E.; and Yan, X. 2016. A Fast Kernel for Attributed Graphs. In Proceedings of the 2016 SIAM Conference on Data Mining.
[29]
Toivonen, H.; Srinivasan, A.; King, R. D.; Kramer, S.; and Helma, C. 2003. Statistical evaluation of the Predictive Toxicology Challenge 2000-2001. Bioinformatics 19(10):1183-1193.
[30]
Vert, J.-P. 2008. The optimal assignment kernel is not positive definite. CoRR, abs/0801.4061.
[31]
Vishwanathan, S. V. N.; Schraudolph, N. N.; Kondor, R.; and Borgwardt, K. M. 2010. Graph Kernels. The Journal of Machine Learning Research 11:1201-1242.
[32]
Wale, N.; Watson, I. A.; and Karypis, G. 2008. Comparison of descriptor spaces for chemical compound retrieval and classification. Knowledge and Information Systems 14(3):347-375.
[33]
Yanardag, P., and Vishwanathan, S. 2015a. A Structural Smoothing Framework For Robust Graph Comparison. In Advances in Neural Information Processing Systems, 2125-2133.
[34]
Yanardag, P., and Vishwanathan, S. 2015b. Deep Graph Kernels. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1365-1374.

Cited By

View all
  • (2023)PARROT: Position-Aware Regularized Optimal Transport for Network AlignmentProceedings of the ACM Web Conference 202310.1145/3543507.3583357(372-382)Online publication date: 30-Apr-2023
  • (2022)Template based graph neural network with optimal transport distancesProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3601127(11800-11814)Online publication date: 28-Nov-2022
  • (2022)Redundancy-free message passing for graph neural networksProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3600582(4316-4327)Online publication date: 28-Nov-2022
  • Show More Cited By
  1. Matching node embeddings for graph similarity

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Guide Proceedings
    AAAI'17: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence
    February 2017
    5106 pages

    Sponsors

    • Association for the Advancement of Artificial Intelligence
    • amazon: amazon
    • Infosys
    • Facebook: Facebook
    • IBM: IBM

    Publisher

    AAAI Press

    Publication History

    Published: 04 February 2017

    Qualifiers

    • Article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 25 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)PARROT: Position-Aware Regularized Optimal Transport for Network AlignmentProceedings of the ACM Web Conference 202310.1145/3543507.3583357(372-382)Online publication date: 30-Apr-2023
    • (2022)Template based graph neural network with optimal transport distancesProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3601127(11800-11814)Online publication date: 28-Nov-2022
    • (2022)Redundancy-free message passing for graph neural networksProceedings of the 36th International Conference on Neural Information Processing Systems10.5555/3600270.3600582(4316-4327)Online publication date: 28-Nov-2022
    • (2022)Graph KernelsJournal of Artificial Intelligence Research10.1613/jair.1.1322572(943-1027)Online publication date: 4-Jan-2022
    • (2022)Neural Subgraph Counting with Wasserstein EstimatorProceedings of the 2022 International Conference on Management of Data10.1145/3514221.3526163(160-175)Online publication date: 10-Jun-2022
    • (2021)PerfGuardProceedings of the VLDB Endowment10.14778/3484224.348423314:13(3362-3375)Online publication date: 1-Sep-2021
    • (2021)Interpretable Graph Similarity Computation via Differentiable Optimal Alignment of Node EmbeddingsProceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3404835.3462960(665-674)Online publication date: 11-Jul-2021
    • (2019)GOTProceedings of the 33rd International Conference on Neural Information Processing Systems10.5555/3454287.3455532(13899-13910)Online publication date: 8-Dec-2019
    • (2019)FSMProceedings of the 28th International Joint Conference on Artificial Intelligence10.5555/3367471.3367675(4547-4553)Online publication date: 10-Aug-2019
    • (2019)Attributed graph clustering via adaptive graph convolutionProceedings of the 28th International Joint Conference on Artificial Intelligence10.5555/3367471.3367643(4327-4333)Online publication date: 10-Aug-2019
    • Show More Cited By

    View Options

    View options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media