Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Two Accelerated Non-backtracking PageRank Algorithms for Large-scale Networks

Published: 16 November 2024 Publication History

Abstract

Non-backtracking PageRank is a variation of Google’s PageRank, which is based on non-backtracking random walk. However, if the number of dangling nodes of a graph is large, the non-backtracking PageRank algorithm proposed in [F. Arrigo, D. Higham, and V. Noferini, Non-backtracking PageRank, Journal of Scientific Computing, 80: 1419–1437, 2019] may suffer from huge memory requirements and heavy computational costs. Thus, the non-backtracking PageRank algorithm is only applicable to small-scale or medium-sized graphs with few dangling nodes. In this work, we first consider how to compute the non-backtracking PageRank vector efficiently by using the Jacobi iteration, and then propose two strategies to speed up the computation of non-backtracking PageRank, in which we add some edges to a graph in a randomized and a fixed way, respectively. The computational issues are discussed in detail. The advantages of the proposed algorithms are two-fold. First, the sizes of the matrix computation problems are much smaller than that of the original one. Second, there is no kronecker product in the involved non-backtracking edge matrices, and the structures of the non-backtracking PageRank problems are greatly simplified. Comprehensive numerical experiments are performed on some real-world network matrices, which show that the solutions obtained from the two proposed algorithms and that from the original non-backtracking PageRank algorithm are highly correlated, while the two proposed algorithms can be tens or even hundreds times faster than their original counterpart.

References

[1]
Aleja D, Criado R, Amo A, Pérez N, and Romance M Non-backtracking pagerank: from the classic model to hashimoto matrices Chaos, Solitons and Fractals 2019 126 283-291
[2]
Alon N, Benjamini I, Lubetzky E, and Sodin S Non-backtracking random walks mix faster Communications in Contemporary Mathematics 2007 9 585-603
[3]
Angel O, Friedman J, and Hoory S The non-backtracking spectrum of the universal cover of a graph Transactions of American Mathematical Society 2015 367 4287-4318
[4]
Arrigo F, Grindrod P, Higham D, and Noferini V Non-backtracking walk centrality for directed networks Journal of Complex Networks 2018 6 54-78
[5]
Arrigo F, Grindrod P, Higham D, and Noferini V On the exponential generating function for non-backtracking walks Linear Algebra and its Applications 2018 556 381-399
[6]
Arrigo F, Higham D, and Noferini V Non-backtracking PageRank Journal of Scientific Computing 2019 80 1419-1437
[7]
Arrigo F, Higham D, and Noferini V Non-backtracking alternating walks SIAM Journal on Applied Mathematics 2019 79 781-801
[8]
Arrigo, F., Higham, D., Noferini, V.: Beyond non-backtracking: Non-cycling network centrality measures, Proceedings of the Royal Society, Series A, 476, 2020
[9]
Benzi M and Klymko C Total communicability as a centrality measure Journal of Complex Networks 2013 1 124-149
[10]
Berkolaiko, G., Carlson, R., Fulling, SA., Kuchment, P.: Quantum Graphs and Their Applications, Contemporary Mathematics, 415: 173–190, 2006
[11]
Bowen R and Lanford O Zeta functions of restrictions of the shift transformation Proceedings of the Symposium in Pure Math 1970 14 43-49
[12]
Callaghan T, Mucha P, and Porter M Random walker ranking for NCAA division I-A football The American Mathematical Monthly 2007 114 761-777
[13]
Chartier T, Kreutzer E, Langville A, and Pedings K Sensitivity and stability of ranking vectors SIAM Journal on Scientific Computing 2011 33 1077-1102
[14]
Chodrow P, Eikmeier N, and Haddock J Nonbacktracking spectral clustering of nonuniform hypergraphs SIAM Journal on Mathematics of Data Science 2023 5 251-279
[15]
Crisostomi E, Kirkland S, and Shorten R A Google-like model of road network dynamics and its application to regulation and control International Journal of Control 2011 84 633-651
[16]
De Bacco, C., Larremore, D., Moore, C.: A physical model for efficient ranking in networks, Science Advances, 4, eaar826, (2018)
[17]
Forsyth, D.: Probability and Statistics for Computer Science, Springer, 2018
[18]
Fortunato S, Bergstrom C, Brner K, Evans J, Helbing D, Milojevic S, Petersen A, Radicchi F, Sinatra R, and Uzzi B Science of science Science 2018 359 1007
[19]
Fowler, J., Johnson, T., Spriggs, J., Jeon, S., Wahlbeck, P.: Network Analysis and the Law: Measuring the Legal Importance of Precedents at the U.S. Supreme Court, Political Analysis, 15: 324–346, 2007
[20]
Gleich D PageRank beyond the web SIAM Review 2015 57 321-363
[21]
Glover C and Kempton M Some spectral properties of the non-backtracking matrix of a graph Linear Algebra and its Applications 2021 618 37-57
[22]
Grindrod P, Higham D, and Noferini V The deformed graph Laplacian and its applications to network centrality analysis SIAM Journal on Matrix Analysis and Applications 2018 39 310-341
[23]
Hashimoto K Zeta functions of finite graphs and representations of p-adic groups Automorphic Forms and Geometry of Arithmetic Varieties 1989 15 211-280
[24]
Horton M Ihara zeta functions on digraphs Linear Algebra and its Applications 2007 425 130-142
[25]
Jeong, H., Mason, S.: A. Baraba´si, and Z. Oltvai, Lethality and centrality in protein networks, Nature, 411: 41–42, 2001
[26]
Kawamoto, T.: Localized eigenvectors of the non-backtracking matrix, Journal of Statistical Mechanics: Theory and Experiment, 023404, 2016
[27]
clustering sparse networks F. Krzakala, C. Moore, E. Mossel, J. Neeman, A. Sly, L. Zdeborova, and P. Zhang, Spectral redemption Proceedings of the National Academy of Sciences 2013 110 20935-20940
[28]
Lambiotte R, Rosvall M, and Scholtes I From networks to optimal higher-order models of complex systems Nature Physics 2019 15 313-320
[29]
Langville A and Meyer C Google’s PageRank and beyond: The science of search engine rankings 2006 Princeton Princeton University Press
[30]
Lin Y and Zhang Z Non-backtracking centrality based random walk on networks The Computer Journal 2019 62 63-80
[31]
Martin T, Zhang X, and Newman M Localization and centrality in networks Physical Review E 2014 90 052808
[32]
Morone F and Makse H Influence maximization in complex networks through optimal percolation Nature 2015 524 65-68
[33]
Page, L., Brin, S., Motwani, R., Winograd, T.: The pagerank citation ranking: Bringing order to the web, Stanford Digital Libraries Working Paper, 1998
[34]
Pastor-Satorras R and Castellano C Distinct types of eigenvector localization in networks Scientific reports 2016 6 18847
[35]
Saade, A., Krzakala, F., Zdeborova´, L.: Spectral clustering of graphs with the Bethe Hessian, Advances in Neural Information Processing Systems, 2014
[36]
Saavedra S, Powers S, Mccotter T, Porter M, and Mucha P Mutually-antagonistic interactions in baseball networks Physica A: Statistical Mechanics and its Applications 2010 389 1131-1141
[37]
Schlote A, Crisostomi E, Kirkland S, and Shorten R Traffic modelling framework for electric vehicles International Journal of Control 2012 85 880-897
[38]
Smilansky U Quantum chaos on discrete graphs Journal of Physics: A Mathematicala and Theoretical 2007 40 621-630
[39]
Sodin S and Sackler B Random matrices, non-backtracking walks, and the orthogonal polynomials Journal of Mathematical Physics 2007 48 123503
[40]
Stark H and Terras A Zeta functions of finite graphs and coverings Advances in Mathematics 1996 121 124-165
[41]
Stephan, L., Zhu, Y.: Sparse random hypergraphs: Non-backtracking spectra and community detection, IEEE Annual Symposium on Foundations of Computer Science, pp. 567–575, (2022)
[42]
Stewart GW and Sun J Matrix Perturbation Theory 1990 Boston Academic Press
[43]
Tarfulea A and Perlis R An Ihara formula for partially directed graphs Linear Algebra and its Applications 2009 431 73-85
[44]
Terras, A.: Harmonic analysis on symmetric spaces: Euclidean space, the sphere, and the Poincare upper half-plane, Springer, (2013)
[45]
Torres, L., Suarez-Serrato, P., Eliassi-Rad, T.: Graph distance from the topological view of nonbacktracking cycles, arXiv:1807.09592, (2018)
[46]
Trres L, Chan K, Tong H, and Eliassi-Rad T Nonbacktracking Eigenvalues under Node Removal: X-Centrality and Targeted Immunization SIAM Journal on Mathematics of Data Science 2021 3 656-675
[47]
Watanabe Y and Fukumizu K Graph zeta function in the Bethe free energy and loopy belief propagation Advances in Neural Information Processing Systems 2009 22 2017-2025
[48]
Wu G and Wei Y A Power-Arnoldi algorithm for computing PageRank Numerical Linear Algebra with Applications 2007 14 521-546
[49]
Wu G, Wang Y, and Jin X A preconditioned and shifted GMRES algorithm for the PageRank problem with multiple damping factors SIAM Journal on Scientific Computing 2012 34 A2558-A2575
[50]
Wu G Y, Zhang, and Y Wei, Accelerating the Arnoldi-type algorithm for the PageRank problem and the ProteinRank problem, Journal of Scientific Computing 2013 57 74-104
[51]
Wu G, Zhang Y, and Wei Y Krylov subspace algorithms for computing GeneRank for the analysis of microarray data mining Journal of Computational Biology 2010 17 631-646
[52]
Wu G and Peng K An inverse-free block-SOR method with randomly sampling for temporal multiplex PageRank problems IEEE Transactions on Knowledge and Data Engineering 2023 35 7736-7752
[53]
Xu J, Wickramarathne L, and Chawla N Representing higher-order dependencies in networks Science Advances 2016 2 1-10
[54]
Yu Q, Miao Z, Wu G, and Wei Y Lumping algorithms for computing Google’s PageRank and its derivative, with attention to unreferenced nodes Information Retrieval 2012 15 503-526

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Journal of Scientific Computing
Journal of Scientific Computing  Volume 102, Issue 1
Jan 2025
826 pages

Publisher

Plenum Press

United States

Publication History

Published: 16 November 2024
Accepted: 03 November 2024
Revision received: 31 July 2024
Received: 18 January 2024

Author Tags

  1. PageRank
  2. Non-backtracking walk (NB-walk)
  3. Non-backtracking PageRank
  4. Hashimoto matrix

Author Tags

  1. 65F15
  2. 65F10
  3. 05C50

Author Tag

  1. Information and Computing Sciences
  2. Artificial Intelligence and Image Processing
  3. Computation Theory and Mathematics

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 20 Feb 2025

Other Metrics

Citations

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media