Abstract
Betweenness centrality is one of the key measures of the node importance in a network. However, it is computationally intractable to calculate the exact betweenness centrality of nodes in large-scale networks. To solve this problem, we present an efficient CBCA (Centroids based Betweenness Centrality Approximation) algorithm based on progressive sampling and shortest paths approximation. Our algorithm firstly approximates the shortest paths by generating the network centroids according to the adjacency information entropy of the nodes; then constructs an efficient error estimator using the Monte Carlo Empirical Rademacher averages to determine the sample size which can achieve a balance with accuracy; finally, we present a novel centroid updating strategy based on network density and clustering coefficient, which can effectively reduce the computation burden of updating shortest paths in dynamic networks. The experimental results show that our CBCA algorithm can efficiently output high-quality approximations of the betweenness centrality of a node in large-scale complex networks.
Similar content being viewed by others
Introduction
Network analysis1 is a technique to investigate the structure and properties of networks, and one of the important tasks is to calculate the centrality of a node in the network2,3,4, which measures how connected or influential a node is within the network. Common centrality measures are degree centrality5, betweenness centrality6, closeness centrality7, etc. The betweenness centrality of a node has many applications in various domains, such as identifying critical nodes in transportation networks8, detecting essential proteins in protein networks9, and improving clustering10 and community detection algorithms11.
Betweenness centrality (BC) measures the importance of a vertex or an edge based on the shortest paths in a graph (i.e., a vertex or an edge with higher BC appears more frequently on the shortest paths in the graph). Several exact algorithms for computing Betweenness centrality have been proposed12,13,14,15,16, among which Brandesâ algorithm12 is a representative one that uses the single source shortest paths (SSSP) idea to optimize the computation process. The time complexity of this algorithm is \(O(nm+n^2log_n)\) for weighted graphs and O(nm) for unweighted graphs, where n and m are the numbers of vertices and edges in the graph, respectively.
However, exact algorithms are infeasible for large-scale networks17 due to their increasing size, and research emphasizes the ordering of nodes over exact values. Hence, some sampling-based approximation algorithms have emerged18,19,20,21,22,23,24,25,26,27,28,29,30, which can generate a betweenness centrality approximation with a high probability \((1-\delta )\) and a bounded maximum deviation, satisfying \(\varepsilon -approximation\)31. However, this category of approximation algorithms faces some challenges, such as determining the sample size that can represent the global distribution of parameters with the least samples; selecting samples that can better estimate the parameter distribution; and adapting to changes in network dynamics. Currently, some researchers have proposed many attempts to address these problems. For example, Brandes29 proposed a bp algorithm based on Hoeffdingâs inequality and union bound, but this algorithm relies too much on the number of nodes n, resulting in excessive running overhead; then Matteo et al22 proposed an rk algorithm based on Vapnik-Chervonenkis (VC) dimension theory, using VC dimension theory to limit the sample size so that the sample no longer depends on the number of nodes in the graph but on the diameter of the graph (i.e., the number of nodes with the largest shortest path in the graph). Nonetheless, the VC dimension does not yield the best \(\varepsilon -approximation\) for a given number of \(\delta \); therefore, Matteo et al20 proposed another ab algorithm based on the Rademacher averages32 and progressive sampling33 to estimate the betweenness centrality of the nodes. Rademacher averages with probability bounds34,35,36 and VC dimensions are also often used in pattern mining37,38,39. Bergamini et al40 proposed a new fully dynamic adaptive sampling update algorithm based on Matteoâs shortest paths sampling.
At the same time, the network is dynamic, with the addition or deletion of nodes and edges at any time. It would be costly to recalculate the betweenness centrality for each dynamic change. Therefore, many dynamic updating algorithms have been proposed41,42,43,44,45,46,47,48,49. These algorithms store the nodes or edges that change by using data structures to avoid re-computing the betweenness centrality from scratch. Hayashi41 proposed a fully dynamic algorithm and a new technique called Two-ball-index and Special-Purpose Reachability Index on the hypersketch sketch of Yoshida26, which improved the dynamic update by several orders of magnitude compared to Berigamini48. Berigamini extensively updated the number of pairwise distances and shortest paths and proposed a faster algorithm to update dependencies40. This algorithm decreased the number of operations performed by dynamic betweenness centrality algorithms, but they have the same worst-case running time as recalculations.
Although the above methods propose many improvement strategies for estimating the betweenness centrality, they do not improve the sampling method and consider network characteristics. To address the above problems, we present an efficient approximation algorithm CBCA (Centroids-based Betweenness Centrality Approximation) based on progressive sampling and shortest paths approximation. The algorithm firstly approximates the shortest paths by using the adjacency information entropy of nodes to generate the network centroid; then constructs Monte Carlo Empirical Rademacher averages based estimator to determine the sample size and achieve a balance between accuracy and efficiency; finally, we propose a new centroid updating strategy according to the network density and clustering coefficients, which effectively reduces the cost of updating the shortest paths in dynamic networks.
The main contributions and innovations in this paper are as follows:
-
We present a novel error estimator based on Monte Carlo Empirical Rademacher Averages (MCERA) and progressive sampling methods, which can balance the trade-off between sample size and accuracy. By using MCERA and adjusting the sample size according to the accuracy requirement, our estimator can effectively guarantee that the upper probability bound of the approximation error of the CBCA algorithm is within a predefined range. Experimental results demonstrate that the CBCA algorithm with our estimator is faster and requires smaller samples than existing methods under the same probability condition.
-
We propose a strategy to update the centroid in dynamic networks with frequent BC changes. Our strategy uses a dynamic detection mechanism that monitors the network density and clustering coefficients, which are important features of the network graph. The mechanism updates the centroid when these features exceed a set threshold, without adding or deleting nodes and edges at any time. This reduces the time to reselect high-quality centroids in dynamic networks.
-
We propose an improved shortest paths approximation method based on network centroids for sampling. Our method can be applied to both undirected and directed graphs. To select the number of centroids, we use different calculation methods of diameter and reduce the computation of dynamic network shortest paths update by distinguishing between undirected and directed graphs. We use the adjacency information entropy50 to select high quality centroids. The experimental results show that our method can cover more than 80% of the shortest paths in networks with scale-free51 and small-world characteristics52.
Preliminaries
We will describe the definitions and basic ideas in this section.
Graphs and betweenness centrality
Let \(G=(V,E)\) be a graph, either undirected or directed, and where each edge must have a non-negative weight. We denote \(n=|V|\) in the graph, and n is the number of all nodes. For any distinct node pair (u, v) in the graph, where \(u \ne v\). Let \(\sigma _{uv}\) denote the number of all shortest paths between node u and node v, and let \(\sigma _{uv}(w)\) be the number of shortest paths between node u and node v for all shortest paths passing through w. For convenience, we write the shortest paths as SPs.
Given a graph \(G=(V,E)\), the normalized betweenness centrality b(w) of a node \(w \in V\) is defined as:
Rademacher averages
Rademacher averages36 are an essential core of statistical learning theory53 and allow measuring the convergence speed of sample means concerning their expectations. More detailed information on the Rademacher averages can be found in35,36.
Define a finite field P and a uniform distribution \(\mu \) over the elements from P. Let \({\mathscr {F}}\) be a family of functions from P to [0,1], and let \(S=\{S_1,...,S_m\}\) be the set of m independent identically distributed samples of P with probability uniform distribution \(\mu \). The average value and its expectation for each function f, which is defined over the samples S, are as followed, respectively:
i.e., \(\rho _s(f)\) is an unbiased estimator of \(\rho _{\mu }(f)\).
Now, for a given S, we focus on the upper bound of the supremum deviation \(S({\mathscr {F}},S)\) of \(\rho _s(f)\) from \(\rho _{\mu }(f)\) among all \(f \in {\mathscr {F}}\), the quantity is:
The \(S({\mathscr {F}},S)\) is the vital notion in the study of empirical processes. The Empirical Rademacher Averages (ERA) \(\tilde{R}({\mathscr {F}},S)\) of \({\mathscr {F}}\) on S is the indicator that can effectively determine the sample-dependent upper bound of the supremum deviation \(S({\mathscr {F}},S)\), which can take into account the data distribution relationship. Let \(\lambda = (\lambda _1,..., \lambda _m)\) is the collection of m independent identically distributed (i.e., i.i.d) Rademacher random variables that takes the values \(\{-1,1\}\) with the same probability \(\frac{1}{2}\) of taking -1 or 1, respectively. This quantity is:
However, \(\tilde{R}({\mathscr {F}},S)\) is difficult and costly to compute. Monte Carlo estimation35 gives an efficient way to get the apparent sharply probability bound for ERA. For any \(k \ge 1\), let \(\lambda \in \{-1,+1\}^{k \times m}\) be a matrix of \(k \times m\) that is independently identically distributed for the Rademacher random variables. The k-Trials Monto-Carlo Empirical Rademacher Averages (i.e., k-MCERA) \(\tilde{R}_m^k({\mathscr {F}},S,\lambda )\) of \({\mathscr {F}}\) on S using \(\lambda \) is:
The Empirical Rademacher Averages \(\tilde{R}({\mathscr {F}},S)\) is the expectation of k-Trials Monto-Carlo Empirical Rademacher Averages \(\tilde{R}_m^k({\mathscr {F}},S,\lambda )\) of \({\mathscr {F}}\) on S, which controls the probability bound of \(S({\mathscr {F}},S)\). It is not efficient to use the Rademacher averages to obtain clear probability bounds, but rather to use k-MCERA to make a better balance between sample size and accuracy. That is because k-MCERA can directly estimate the highest deviation of the function set by data dependence. For each \(f \in {\mathscr {F}}\), We define the empirical wimpy variance as \(\alpha \), defined as:
Before stating Theorem 2.2, we need to know the upper bound of the wimpy variance (i.e., Theorem 2.1). Then, Theorem 2.2 shows how to use the k-MCERA to compute the upper bound of the maximum deviation \(S({\mathscr {F}},S)\), using only sample-dependent quantities.
Theorem 2.1
For any \(f \in {\mathscr {F}}\) is a family of functions in the domain P up to [0,1] and \(\mu \) is a uniform distribution of probabilities over the elements of P:
Proof
We have given in Online Appendix A.1, which leverages the properties of the betweenness centrality under large-scale networks and the basic variance formula.
Theorem 2.2
For \(k,m \ge 1\) and the function \(f \in {\mathscr {F}}\), where \({\mathscr {F}}\) is a family of functions from P to [0,1]. Let \(\lambda \in \{-1, +1\}^{k \times m}\) be a \(k \times m\) matrix of Rademacher random variables, such that independently and with equal probability \(\frac{1}{2}\). Let S be a sample size of m drawn i.i.d. from P, and take a distribution \(\mu \). For each \(f \in {\mathscr {F}}\), \(\delta \in (0,1)\), define:
With the probability at least \(1 - \delta \) over the choice of S and \(\lambda \), it holds:
The proof of Theorem 2.2
We put in Online Appendix A.2, using the self-boundary function54 and the symmetry inequality55, as well as the substitution theorem.
Observing Theorem 2.2, we can see that \(\alpha \) is the largest factor affecting the whole equation and controls the supremum deviation \(S({\mathscr {F}},S)\). Thus, we can achieve a better balance between sample size and accuracy, obtaining a uniform variance for most families of functions. This is the reason why k-MCERA outperforms rk and bp. The rk algorithm uses VC dimensional theory to obtain an upper limit on the sample size, which is data-independent and depends on the properties of the graph itself. However, it does not consider the feature of data dependence. The bp algorithm uses Hoeffdingâs inequality and union bound, which results in an excessive sample. These two methods lead to a large number of samples to guarantee a high quality approximation, so they are characterized by a sample size that is suboptimal, while k-MCERA can capture the relationship between sample size and accuracy very well.
Network density and clustering coefficient
In this section, we focus on the dynamic changes of complex networks.
We know that dynamic networks change by adding or deleting nodes and edges, but this requires updating and maintenance. However, not all nodes or edges addition and deletion have a significant impact on the network, and we can ignore some minor changes while pursuing approximate estimates. According to56,57,58, network density and clustering coefficient are closely related to the power law property and small world property of complex networks, which are the key assumptions of our algorithm. Therefore, we choose the network density and clustering coefficient, which are two parameters that can reflect the features of the network. And the network is considered to have been changed measurably when their changes exceed a certain threshold value. The centroid is a critical factor that affects the efficiency of the whole algorithm.
We present a strategy to update the network centroid based on the network density and clustering coefficients to detect the dynamic changes, thus avoiding a large amount of updating time.
Network density59: it can be used to characterize the density of interconnected edges of nodes in a network, which is defined as the ratio of the number of variables present in the network with the upper limit of the number of edges that can be accommodated. It is commonly used to measure the intensity of social relationships and the evolutionary trend in online social networks. For \(G=(V,E)\) with n nodes and m edges, the network density is defined as:
Clustering coefficient60,61: it quantifies how densely nodes form cliques in a graph. There is evidence62 that nodes tend to create tightly bound groups in most real-world networks, especially social networks. This is divided into a global clustering coefficient and a local clustering coefficient. We choose the local clustering coefficient as one of the parameters to reflect the features of the network, because it can capture the local structural changes of nodes and their neighbors in dynamic networks.
For \(G=(V,E)\), where \(V=(v_1,v_2,...,v_n)\) denotes the collection of vertices and \( E=\{e_{ij}:(i,j) \in U \subset [1,...,n]^2\} \) denotes the collection of edges (\(e_{ij}\) denotes the edge connecting vertices \(v_i\) and \(v_j\)). Denote by L(i) the collection of edges connected to the vertex \(v_i\): \(L(i) = \{ v_j: e_{ij} \in E \wedge e_{ji} \in E \}, z_i\) is the degree of node i. The local clustering coefficient of vertex \(v_i\) in an undirected graph is:
The local clustering coefficient of vertex \(v_i\) in a directed graph is:
The average clustering coefficient can be obtained as:
To facilitate the readerâs understanding of the article, we provide the explanations of the main parameters in Table 1.
Methods
This section shows our proposed CBCA algorithm, which is an efficient approximation algorithm based on progressive sampling and shortest paths approximation.
Progressive sampling is a technique that gradually increases the sample size until a desired accuracy is achieved. It allows us to avoid over-sampling or under-sampling the network, and adapts to the dynamic changes of the network. Shortest paths approximation is a technique that uses the network centroids to estimate the shortest paths between nodes. It allows us to reduce the computational complexity and memory requirement of the algorithm.
We firstly introduce the basic process and related results for approximating the shortest paths based on the network centroids, which can efficiently compute the betweenness centrality values after approximating the shortest paths in section âShortest paths approximation based on network centroidsâ, and we have provided the data-dependent bounds for these results in Theorem 2.2. Then, we describe the specific steps and parameters of the CBCA algorithm in Section 3.2, which uses this improved bound to obtain high-quality betweenness centrality approximations with high probability and ensures that the betweenness centrality values of all nodes are within the additive error \(\varepsilon \) by progressive sampling. The detailed theoretical and experimental results regarding the initial sample size, the selection of the sample schedule, and the sections on updating the network centroids are given in the introduction section of Experiment 4 and Experiment 4.5, respectively.
Shortest paths approximation based on network centroids
The common shortest paths algorithms do not exploit the properties of complex networks (i.e., scale-free network characteristic (power-law property) and small-world property). We leverage these two properties to improve a shortest paths approximation method based on the network centroids. The small-world network has two important properties: high clustering coefficient and short average shortest paths length. The scale-free network characteristic means that few nodes have a high degree and most nodes have a low degree. Then we can naturally select some nodes with high degree or high adjacency information entropy as the centroids, and divide the nodes near or adjacent to the centroids into subgroups. From these subgroups, we use the shortest paths algorithm to calculate the distance between each node and the centroids. This can reduce the search space and time. And it can improve the approximation accuracy. Therefore, the number and quality of the centroids are crucial.
Centroids screening strategy
We use the VC dimension theory to calculate the number of t centroids in statistical learning, and we refer the reader to32 for more details on the VC dimension theory:
where t is the number of centroids with c taking the value \(\frac{1}{3}\), D is the diameter of the graph, and \(\delta \in (0,1)\).
The equation is derived from Matteo22, but c is not the meaning of the coefficients among them in this paper, and they are irrelevant. The reason for employing this equation is that with the data independence of the VC dimension, where the number of centroids does not depend on the number of nodes, but only on the diameter in the graph (i.e., the maximum length of the shortest path). It reduces the number of t and speeds up the approximation time. At the same time, the value of c can affect that of t. We need to trade-off between the number of centroids and the ratio \(\frac{T_1}{T_0}\) (\(T_1\) is the shortest paths after approximation and \(T_0\) is the shortest paths without approximation) to get an acceptable value. According to experiments, we found that the quality of the centroids is best when \(c=\frac{1}{3}\) and \(t=2 or 3\). This range of values facilitates the calculation of the shortest paths approximation.
Furthermore, in this Eq. (14), we need to know the diameter of the graph D. One way to compute the exact value of D is by solving the shortest paths problem between all pairs of nodes. However, this exact calculation of the diameter D is not desirable, because it requires a time complexity of \(O(n^3)\), which is against our experimental purpose. Given the short average path length of complex networks and the data independent property of VC dimension, we can reason that the error of diameter has little or even negligible effect on the result. Thus, we adopt different approximate diameter calculation methods for directed and undirected graphs respectively, in this paper.
Approximate diameter methods:
-
1.
Let \(G=(V,E)\) be an undirected graph with all edges having equal weights. Choosing a vertex \(u \in V\) uniformly and randomly from the graph and computing the shortest paths from u as the source to all other nodes. We can calculate the diameter D equal to the sum of the two shortest paths from u to two other different nodes w, v.
-
2.
For a directed graph with weights, we note that D is not necessarily equal to the longest path among the shortest paths between all pairs of nodes, because the edge weights may affect the distance sums. This makes the calculation of the approximate diameter more complicated. We can use the maximum weakly connected component, as an upper bound on the diameter D.
Centroids quality screening strategy
We use the adjacency information entropy formula to effectively filter out high-quality centroids based on the small-world feature and the scale-free characteristic of complex network. Commonly used information entropy formulas are50,63,64. In this paper, we choose a more popular adjacency information entropy formula50 and give a reasonable explanation.
Definition 1
For a given G(V, E), where \(V(v_1,v_2,...,v_{n-1},v_n)\) refers to all nodes and \(E(e_1,e_2,...,e_{l-1},e_l)\) refers to all edges.
The undirected unweighted graph G(V, E): The node degree of the undirected unweighted graph can be obtained by \(h_i=\sum \limits _1^l o_{ij}\), where l is the number of node i and j is the neighbor of node i. \(o_{ij}\) is equal to 1 if an edge exists between node i and node j, otherwise it is 0.
The undirected weighted graph G(V, E): The node degree of the undirected unweighted graph can be obtained by \(h_i=\sum \limits _1^l w_{ij}\), where l is the number of node i, j is the neighbor of node i, and \(w_{ij}\) represents the weight magnitude between node i and node j.
The degrees in the directed graph are divided into in degrees and out degrees, which are divided into two cases, directed with weights and directed without weights, as follows.
Directed unweighted graph G(V, E):
Directed weighted graph G(V, E):
Where \(\xi _i\) is the set of the neighbors of node i.
When discussing the influence of graphs, we need to distinguish between directed and undirected graphs. In a directed graph, each node has an incoming degree and an outgoing degree, which indicates the number of edges pointing to and from that node, respectively. In an undirected graph, each node has a degree, which indicates the number of edges connected to that node. Thus, we introduce an influence factor \(\zeta \) to measure the influence of a node. It is a constant between 0 and 1 to regulate the contribution of incoming and outgoing degrees to influence. Usually, \(\zeta \) taken as 0.7 is a reasonable choice. In an unweighted graph, the calculation of influence is relatively simple by multiplying the in degree of nodes by \(\zeta \) and adding the out degree by \(1-\zeta \). In the weighted graph, the calculation of influence is more complicated, which requires considering the weights and directions of the edges, as follows:
Directed unweighted graph G(V, E):
Directed weighted graph G(V, E):
Definition 2
Adjacency \(A_i\):
we can easily obtain that \(A_i=\sum \limits _{j \in \xi _i}k_j\), if the graph is undirected.
Definition 3
Probability \(P_{i_j}\), we define the selection probability of node i in the network by considering the probability of node i being selected by its neighbor j with the following probability:
Definition 4
Information entropy formula, the important technical formula is used to carry out how to filter t network centroids to achieve the properties of complex networks in this paper, which compound our assumptions:
by the above way, we can reasonably screen out the high-quality centroids by the adjacency information entropy.
Subgraphs construction for the shortest paths approximation
In this section, we describe in detail how to generate subgraphs and how centroids of prime nodes are generated. As an example of an undirected unweighted graph, the same method is used for the other types of graphs.
Step 1
We use the adjacency list to represent the graph structure, so one Breadth-First Search (BFS) traversal gives us the degrees and weights of all nodes. As shown in Fig. 1a.
Step 2
When performing the BFS traversal, we get the diameter by the approximate diameter calculation method in section "Centroids screening strategy", (i.e., D = 10.) In addition, we use the method of screening the number and quality of centroids mentioned in sections "Centroids screening strategy" and "Centroids quality screening strategy". The method of screening the number of centroids is based on the diameter of the graph and a given confidence parameter \(\delta \) to determine the number of centroids to be selected as t. The formula is \(t=c(\lfloor log_2(D-2) \rfloor + 1 + ln \frac{1}{\delta })\), where \(c=\frac{1}{3}, \delta =0.1 \). We get \(t=2.1\), so there are two centroids. Then we utilize the adjacency information entropy formula to easily get the two high-quality centroid nodes, as shown in Fig. 1b).
Step 3
The nodes surrounding the centroids can be easily obtained by traversing the neighboring nodes one at a time, as in Fig. 2a. Then continue to traverse the neighboring nodes and finally a complete subgraph can be obtained as shown in Fig. 2b.
Eventually, we get the complete graph with two centroids by the above method.
We explain in detail how to perform the shortest paths approximation. According to section âShortest paths approximation based on network centroidsâ, we can reasonably infer that most of the shortest paths pass through the centroids of the network. Eqs. (22) and (23) can effectively reduce the influence of paths that do not pass through the centroids on sampling and estimation of the betweenness centrality. The experimental section âDifferent types of networksâ verifies our theoretical hypothesis.
As shown in Fig. 2c, the shortest paths after approximation becomes \(d(u,v) \doteq d(u,t_1)+d(t_1,t_2)+d(t_2,v)\).
Let the relationship of node pairs be written as \(\delta _{uv}(w)=\frac{\sigma _{uv}(w)}{\sigma _{uv}}\):
Then we can have:
CBCA algorithm description and analysis
In this section, we present the CBCA algorithm, which is based on the contributions of section âShortest paths approximation based on network centroidsâ, for computing a strict approximation of the betweenness centrality of all nodes in the graph. We firstly describe the effective estimators that can satisfy the \(\varepsilon - approximation\), which is an important component of the CBCA algorithm, for estimating the betweenness centrality in section âEffective estimator description and analysisâ. Then we describe the CBCA algorithm in section âOur CBCA algorithm flowâ.
Effective estimator description and analysis
Our CBCA algorithm takes as input a graph \(G=(V,E)\), which can be directed or undirected and can have non-negative weights on the edges and includes two parameters \(\varepsilon , \delta \in (0,1)\). It can output a set \(\tilde{B}=\{\tilde{b}(w),w \in V\}\) (i.e., with probability at least \(1-\delta \), betweenness centrality \(B=\{b(w),w \in V of \varepsilon approximation\}\)). Let \(P=\{(u,v) \in V \times V, u \ne v\}\) be the collection of all different node pairs. For each node \(w \in V\), let \(f_w\): the function of P mapping to [0,1].
To improve the computational efficiency, we use:
let the set \(S=\{(u_i,v_i)=(u_i,t_i)+(t_i,t_j)+(t_j,v_i), 1 \le i \le m\}\), where \(t_i,t_j\) refer to the centroids in \(u_i,u_j\), respectively, from the set of independent and uniformly sampled node pairs (u, v) from P. We define:
Thus, we have that
Our CBCA algorithm flow
Our CBCA algorithm is a method based on a progressive algorithm. A progressive algorithm is an algorithm that checks whether a certain stopping condition is satisfied after each iteration. If it is satisfied, the final result is output; if not, the iteration continues. The goal of the CBCA algorithm is to estimate an approximation to the betweenness centrality b(w) of each node w in the graph and output an approximate set \(\tilde{B}=\{\tilde{b}(w), w \in v\}\). To improve efficiency, the CBCA algorithm does not iterate through all possible node pairs, but samples node pairs from the set \(S_i\), which is used to estimate b(w). Here \(m_i=|S_i|\) denotes the size of the set \(S_i\). Therefore, it is important to choose a suitable stopping condition, which affects the accuracy and speed of the CBCA algorithm. Especially for large graphs, the computational cost of each sample is high.
We now present the CBCA algorithm and next show how to obtain the set of \(B=\{b(v), v \in V\}\) for \(\varepsilon -approximation\).
The input parameters of the CBCA algorithm: a graph, a failure probability \(\delta \in (0,1)\), the number of k for the k-MCERA, a user-specified error \({\bar{\varepsilon }}\), sample schedule, and a suitable sample size \(m \>0\). The output is a pair \((\tilde{B},\varepsilon )\), where \(\tilde{B}\) is a set of pairs \((v,\tilde{b}(v))\) for each \(v \in V\), where \(\tilde{b}(v)\) is the estimate of b(v), and \(\varepsilon \in (0,1)\) is the accuracy that is probabilistically guaranteed in the following Theorem 3.1.
Theorem 3.1
With probability at least \(1-\delta \) for the CBCA algorithm, the output \((\tilde{B},\varepsilon )\) such that \(|b(v)-\tilde{b}(v)| \le \varepsilon \).
This is presented in Online Appendix A.3, using the converse method.
Our CBCA algorithm computes an \(\varepsilon -approximation\) of \(B=\{b(v), v \in V\}\) by using the technique introduced in section âRademacher averagesâ. CBCA can be divided into two phases. In the first phase, the CBCA algorithm generates the required number of high-quality centroids (lines 1â3). In the second phase, it describes the main procedure of how the algorithm approximates the betweenness centrality (lines 4â18).
We start with the description of the first phase.
-
In line 1, the diameter of the graph is determined by using the procedure getDiameter(G) with the diameter method described in section âCentroids screening strategyâ.
-
In line 2, the number of required t centroids are obtained by following the formula (13) for calculating the centroids described in section âCentroids screening strategyâ.
-
In line 3, the CBCA algorithm obtains the high-quality network centroids based on the adjacency information entropy of section âCentroids quality screening strategyâ, for which the shortest paths approximation described in section âSubgraphs construction for the shortest paths approximationâ is used to determine the t subgraphs divisions and completes the approximation using the procedure getZone(t).
We now proceed to the second phase of the algorithm.
-
In line 4 and line 5, the initial value is assigned to enable that \(S_i\), which stores the sample size, is the empty set and i is the index iteration, while \(m_i\) can guarantee the size of the sample \(S_i\) considered at the \(i^{th}\) iteration. Here \(m_i \ge m_1\), which can guarantee that with probability \(1-\frac{\delta }{2}\) to satisfy the \(\varepsilon -approximation\). Then \(\lambda \) is initialized as the null matrix by the CBCA algorithm, and the main task is to calculate the k-MCERA for each iteration (see section âRademacher averagesâ).
-
In each iteration of the for loop, our CBCA algorithm performs the following operations: First of all, in line 6, the desired pairs of sample nodes, obeying a uniform distribution, can be easily obtained by using the program getUniformSample(P) through the domain P.
-
In line 7, At the \(i^{th}\) iteration, it generates new samples \(m_i-m_{i-1}\) and adds them to \(S_{i-1}\) to obtain the new sample set \(S_i\).
-
In line 8, an upper bound on the number of samples required for approximation is calculated with the function effectiveSampleSchedule \((S_i)\), which is used to ensure that any sample S has sufficient sample size to satisfy the \(\varepsilon -approximation\) with at least \(1-\delta \) probability. Although any schedule can be used, we give a suitable sample schedule to satisfy the \(\varepsilon -approximation\) in subsequent experiments.
-
In line 9, we use the procedure updateValues \((s_i)\) to obtain the sample set Q. The set Q helps to compute the variance and Rademacher values needed in the subsequent procedure. \(Q=\{(w, f_w(s_i)) for each w \in V s.t. f_w(s_i) \ne 0\}\). Then we extend to \(\lambda \) to add \(m_i-m_{i-1}\) columns, each column consists of k rows, so \(\lambda \in \{0, 1\}^{k \times m_i}\) to facilitate the computation of samples of size S.
-
In line 10, the \(k \times m_i\) matrices are sampled by the getSampleRademacher procedure, where each matrix is a Rademacher r.v. (see section âRademacher averagesâ).
-
In line 11, the procedure getUpdate\((m_i,\lambda ,f_w(s_i))\) is used, which updates the value of the computed k-MCERA (see section âRademacher averagesâ). And it can estimate \(\tilde{B}\) (in line 12), where \(\tilde{B}\) is a set of pairs \((v,\tilde{b}(v))\) for each \(v \in V\), where \(\tilde{b}(v)\) is the estimate of b(v). The value of \(\varepsilon \) is computed (in line 13), and the computed value of \(\varepsilon \) is large than the user-specified value of \({\bar{\varepsilon }}\). If the value of \(\varepsilon \) is over the size of the user-specified value of \({\bar{\varepsilon }}\), then the iteration is finally stopped and \((\tilde{B},\varepsilon )\) is output (in lines 14-18).
Experiments and analysis of results
In this section, we successfully implemented the CBCA algorithm and gave experimental evaluation results. We performed the experimental analysis in five aspects: sample size, running time, accuracy, different network characteristics, and dynamic centroids updating. We compared the sample size and running time of the CBCA algorithm with those of the algorithms Silvan and rk; and the accuracy rate with those of bp and rk. This is because Silvan is the newest algorithm and consistently outperforms other algorithms in terms of sample size and running time, while the bp algorithm has the highest accuracy rate among the known algorithms. We also tested five artificially generated random networks and networks with power-law property and Small-world property for network feature comparison. Finally, we gave the theoretical analysis and experimental results of dynamic centroids updating. All the above algorithms are guaranteed to satisfy \(\varepsilon -approximation\) with \(1-\delta \) probability for all nodes.
Implementation and environment. This part of the experiment is built on a Linux system, using Ubuntu 18.04 as the main operating system of the experiment platform, with hardware specifications: Intel(R) Core (TM) i9-9900K CPU@3.6GHz processor with 16GB of physical memory. It also has an NVIDIA GeForce RTX 2080Ti graphics processor with 11GB video memory capacity. Software drivers: The 2080Ti graphics processor comes with a 470.103.01 driver with CUDA 11.4 acceleration platform. All code is compiled via GCC 8.
Dataset and parameters. We used the publicly available real dataset SNAP from Stanford University. All features of the graphs are given in Table 2. Regarding the choice of multiple parameters, we first considered \(\varepsilon \in \{0.01,0.006,0.0015,0.008,0.003\}\) for each graph. For \(\delta \), we set its value to a fixed 0.1, and we tested different values of it separately in our experiments. We found that it has very little effect on the results due to the use of probabilistic tail bound perception leading to exponential dependence, which differs very little from that described by rk. We set the initial sample size \(m_1\) to the case \(R({\mathscr {F}},m)=0\), because this is the upper limit of the initial sample size that can be guaranteed with a high-quality approximation. The progressive sampling used was set to \(m_i=1.5m_{i-1}\) in the CBCA algorithm concerning the sample schedule. For the parameter k-Monte Carlo trials, referring to Bavarian [18] and MCRapper [44]. It was fixed to 25, which shows that clear bounds can be obtained even using a small number of Monte Carlo trials, but of course, we also experimented with \(k=50,100\), and 200 and found that it is not better than the case of \(k=25\). We ran all the algorithms 5 times and reported \(Avg \pm stddev\), which is representative of the standard deviation of a single measurement.
Sample size
We first show a comparison figure of the required sample sizes on different datasets in Fig. 3.
Figure 3a illustrates the ratio of sample size required by Silvan and CBCA to achieve high-quality approximation. First, for the large graphs Wiki_Talk and Wiki_topcats, CBCA requires at least 10.3% and at most 19.7% less sample size than Silvan, respectively. Although both Silvan and CBCA algorithms employ the k-MCERA technique, CBCA adopts the shortest paths approximation, which can effectively reduce the time to compute the shortest paths and thus decrease the sample size. In some small graphs, such as ca-GrQc, Silvanâs sample size is smaller than CBCAâs, which is due to CBCAâs consideration of the graph diameter, while Silvan uses an empirical peeling technique to reduce the required sample size. Finally, the CBCA algorithm performs better on large graphs, which is consistent with our experimental objective.
As shown in Fig. 3b, the CBCA algorithm requires much smaller sample sizes than the rk algorithm. The difference is up to an order of magnitude lower; and at least several times smaller. This is closely related to the different methods they use to reduce the sample sizes. The rk algorithm relies on the VC dimension, which can guarantee a high-quality approximation, but it only considers the diameter of the graph and ignores other features. This leads to an overly conservative estimation of the sample size. However, our CBCA algorithm employs the state-of-the-art k-Monto Carlo trials technique to obtain the maximum correlation index between the nodes with sharp variance-aware probability tail bounds. This can effectively reduce the sample size and provide better guarantees.
In conclusion, the CBCA algorithm can better obtain the minimum number of samples required to satisfy the high-quality approximation, which illustrates the importance of our shortest paths approximation and k-Monto Carlo trials techniques.
Running time
we report the running time, sample size, and \(\varepsilon \) of the CBCA algorithm on different datasets in Fig. 4. And we show a comparison of the required run times on different datasets in Fig. 5.
In Fig. 4, we can observe that the running time increases linearly with the sample size, because the main time-consuming step of the algorithm is sampling, which accounts for more than 90% of the running time. Similarly, from Fig. 4b,c, both the number of samples and the running time decrease as the error \(\varepsilon \) increases, because a larger error \(\varepsilon \) reduces the number of samples required to obtain a more accurate value. This also demonstrates that our algorithm does not waste time on calculating the centroids, but focuses on the useful work.
We can see the ratio of time required to achieve approximation in Fig. 5a. For the large graph Wiki_Talk and Wiki_topcats, CBCA performs better than Silvan in different errors \(\varepsilon \), saving 7.1% to 15.2% of time. This is because the algorithm spends more than 90% of the time on sampling. Our CBCA algorithm uses the shortest path approximation, which can speed up the sampling time, while Silvan uses bidirectional BFS traversal, which leads to an increase in sampling time. When the graph is small, such as ca-GrQc, Silvanâs sampling speed is faster than CBCAâs. The results show that CBCAâs running time is faster in large graphs.
As shown in Fig. 5b, the CBCA algorithm can be two to three orders of magnitude faster than rk in large graphs and one order of magnitude faster even in small graphs. This is attributed to the improvement of CBCA based on the shortest paths approximation, reducing the running time, as well as the sharply wimpy variance technique for satisfying approximations of high quality, reducing the number of samples.
Accuracy
we show a comparison of the absolute errors on the four datasets in Fig. 6.
In this section, we discuss the accuracy of the algorithm that we introduced in section âPreliminariesâ of this paper. As shown in Fig. 6aâd, the CBCA algorithm can always guarantee that all nodes satisfy \(\varepsilon -approximation\) with probability \(1-\delta \). Moreover, the absolute error computed is smaller than \(\varepsilon \), even by an order of magnitude. This indicates that the algorithm can perform better than the theoretical guarantee. This is due to the use of the technique of the k-Monto-Carlo trial, which can capture the probability tail bound with sharply wimpy variance, making a better balance between sample size and accuracy.
Compared with CBCA, the errors of both bp and rk algorithms are smaller. This is because the VC dimensional theory used by rk only considers the diameter of the graph without a more detailed understanding of the other structural underlying distributions of the graph. This results in too many samples, making it better in terms of accuracy guarantees. Moreover, the error of bp is minimal because the algorithm uses Hoeffdingâs inequality and union bound. Although both algorithms can satisfy \(\varepsilon -approximation\) with a low error and a probability of \(1-\delta \), they consume a lot of time in respect of running time. Increasing the sample size of the number of samples to improve the accuracy sacrifices the running time.
Different types of networks
We generate ER random networks65, WS small-world networks, and BA scale-free networks with 3000, 6000, 9000, 12000, and 15000 nodes (i.e., five graphs with random network properties and five graphs with the small-world property as well as power-law property, respectively).
Our Shortest Paths Approximation theory is based on two properties of complex networks: the small-world property and the power-law property. To verify this theory, we apply the shortest paths approximation to a random network. The clustering coefficient of random networks is small, while the clustering coefficient of small-world networks is large. Random networks do not have power-law distributions, while scale-free networks have a few high degree nodes and a large number of low degree nodes. These differences affect the effectiveness of the shortest paths approximation.
Figure 7a shows that the approximation time of the random network is at least 5.4 times longer than that of the small-world and scale-free network when the shortest paths approximation is used for all networks.
Figure 7b compares the ratio of shortest paths that pass through the selected centroids in the two types of networks. The figure shows that the shortest paths that pass through the centroids account for more than 81.3% of all shortest paths in the network with small-world and scale-free features, while in the random network, this ratio is only up to 52.1%.
This demonstrates the superiority of the CBCA algorithmâs shortest paths approximation in networks with small-world property and power-law property.
Updating centroids in dynamic networks
According to section âNetwork Density and Clustering Coefficientâ, we choose the network density and clustering coefficient to measure the dynamic changes of the network. Then, we establish a formula to represent the dynamic change before it occurs:
for \(\phi -\)value picking \(0,\frac{1}{4},\frac{1}{3},\frac{1}{2},\frac{2}{3},\frac{3}{4},\) and 1, respectively. 7 plans are selected.
We conduct comparative experiments on different methods or parameters, and based on the evaluation criteria of accuracy and efficiency, we choose:
Therefore, by setting different thresholds in the networks with small-world and power-law characteristics generated in section âDifferent types of networksâ, and recalculating the centroids. It is judged that the recalculation of the centroid nodes should be performed in the case of exceeding a certain threshold.
The initial state network is characterized by \(f_{ea_1}=\frac{1}{3}\bar{C_1}+\frac{2}{3}d_{G1}\), and after the dynamic updating, it is \(f_{ea_2}=\frac{1}{3}\bar{C_2}+\frac{2}{3}d_{G2}\).
Threshold qualifier:
we proceed to set the resulting THV for the threshold qualifier to 0.2, 0.3, 0.4, 0.5, and 0.6.
It can be seen from Table 3 that the original centroids need to be updated when the threshold THV exceeds 0.5. This shows that our CBCA algorithm updates the centroids only if the THV is set to a value greater than 0.5, saving a lot of time.
Conclusion
In this paper, we present a novel betweenness centrality approximation algorithm based on progressive sampling and shortest paths approximation. The algorithm firstly uses the adjacency information entropy to generate network centroids and constructs an efficient shortest paths approximation strategy; then, it uses the k-Monto Carlo trials technique to trade off the sample size and error to obtain a high-quality approximation of the betweenness centrality of all nodes. The algorithm can also handle dynamic networks with frequent BC changes by using a centroid updating strategy based on network density and clustering coefficients.
Our experimental results show that our algorithm outperforms the baseline algorithm for the same probability in various networks. Our algorithm can efficiently output high-quality approximations of the node betweenness centrality in large-scale complex networks. Our algorithm can also be applied to network analysis and applications, such as identifying the most influential or central nodes in a network, which can help us understand the network structure and function, as well as optimize its performance or resilience. However, our algorithm also has some limitations and challenges, such as relying on the quality of the network centroids, which may not always be optimal or representative. Therefore, we intend to extend our algorithm to address these issues in future work, such as exploring different methods or criteria to select or update network centroids, applying our algorithm to different types of networks, and applying our algorithm to other network analysis tasks.
Moreover, the network centroids and shortest paths approximation methods proposed in this paper can also be tried for other centrality measures, such as degree centrality, closeness centrality, etc. These centrality measures can also reflect the importance or influence of network nodes in different aspects, and have many practical applications. We believe that our methods can provide an effective and flexible approximation strategy for other centrality measures, and can adapt to different scales and characteristics of networks. We also believe that the methods proposed in this paper can be used to improve the speed and quality of data analysis and mining, such as finding similar or different points or groups in data faster, evaluating important or abnormal points or edges in data more accurately, etc. These are very important and valuable problems in the field of data science, and have many practical applications.
Data availability
The data generated and analysed during the current study are available in the OSFHOME repository: https://osf.io/xhs2q/?view_only=eed9bb3e28ac48f4acd527117e2037f4.
References
Schiessl, H., Dias, D. & Korelo, J. Artificial intelligence in marketing: A network analysis and future agenda. J. Market. Anal. 2022(10), 207â218. https://doi.org/10.1057/s41270-021-00143-6 (2022).
Curado, M., Tortosa, L. & Vicent, J. F. A novel measure to identify influential nodes: Return random walk gravity centrality. Inf. Sci. 628, 177â195. https://doi.org/10.1016/j.ins.2023.01.097 (2023).
Curado, M., Rodriguez, R., Terroso-Saenz, F., Tortosa, L. & Vicent, J. F. A centrality model for directed graphs based on the two-way-random path and associated indices for characterizing the nodes. J. Comput. Sci. 63, 101819. https://doi.org/10.1016/j.jocs.2022.101819 (2022).
Berahmand, N., Samadi, K. & Sheikholeslami, S. M. Effect of rich-club on diffusion in complex networks. Modern Phys. B 32(12), 1850142. https://doi.org/10.1142/S0217979218501424 (2018).
Cañete-Massé, C. et al. Abnormal degree centrality and functional connectivity in down syndrome: A resting-state fmri study. Int. J. Clin. Health Psychol. 23, 100341. https://doi.org/10.1016/j.ijchp.2022.100341 (2023).
Curado, M., Rodriguez, R., Tortosa, L. & Vicent, J. F. Anew centrality measure in dense networks based on two-way random walk betweenness. Appl. Math. Comput. 412, 126560. https://doi.org/10.1016/j.amc.2021.126560 (2022).
Skibski, O. Closeness centrality via the condorcet principle. Soc. Netw. 74, 13â18. https://doi.org/10.1016/j.socnet.2023.01.005 (2023).
Wu, Y., Li, P. & Li, C. Invulnerability of the urban agglomeration integrated passenger transport network under emergency events. Int. J. Environ. Res. Public Health 20(1), 450. https://doi.org/10.3390/ijerph20010450 (2023).
Dunn, F., Dudbridge, R. & Sanderson, C. M. The use of edge-betweenness clustering to investigate biological function in protein interaction networks. BMC Bioinformat. 6, 1â14. https://doi.org/10.1186/1471-2105-6-39 (2005).
Yang, Q. & Lonardi, S. A parallel edge-betweenness clustering tool for protein-protein interaction networks. Int. J. Data Min. Bioinform. 1(3), 241â247. https://doi.org/10.1504/IJDMB.2007.011611 (2007).
Arasteh, M. & Alizadeh, S. A fast divisive community detection algorithm based on edge degree betweenness centrality. Appl. Intell. 49, 689â702. https://doi.org/10.1007/s10489-018-1297-9 (2019).
Brandes, U. A faster algorithm for betweenness centrality. J. Math. Sociol. 25(2), 163â177. https://doi.org/10.1080/0022250X.2001.9990249 (2001).
Barthelemy, M. Betweenness centrality in large complex networks. Eur. Phys. J. B 38(2), 163â168. https://doi.org/10.1140/epjb/e2004-00111-4 (2004).
Feng, H., Wang, Y. & Lu, H. A faster algorithm for betweenness centrality based on adjacency matrices. arXiv e-prints arXiv:2205.00162 (2022)
Inoha, T., Sadakane, K., Uno, Y. & Yonebayashi, Y. Efficient computation of betweenness centrality by graph decompositions and their applications to real-world networks. IEICE Trans. Inf. Syst. 105(3), 451â458. https://doi.org/10.1587/transinf.2021FCP0003 (2022).
Chehreghani, A., Bifet, M. H. & Abdessalem, T. Efficient exact and approximate algorithms for computing betweenness centrality in directed graphs. PAKDD 752â764 https://doi.org/10.1007/978-3-319-93040-4_59 (2018).
Batagelj, V. & Mrvar, A. Pajek-program for large network analysis. Connections 21(2), 47â57 (1998).
Bader, K., David. Kintali. Shiva. Madduri & Mihail, M. Approximating betweenness centrality. WAW 124â137 (2007).
Geisberger, P., Sanders, R. & Schultes, D. Better approximation of betweenness centrality. in ALENEX 90â100 https://doi.org/10.1137/1.9781611972887.9 (2008).
Riondato, M. & Upfal, E. Abra: Approximating betweenness centrality in static and dynamic graphs with rademacher averages. TKDD 12(5), 1â38. https://doi.org/10.1145/3208351 (2018).
Cousins, C., Wohlgemuth, C. & Riondato, M. Bavarian: Betweenness centrality approximation with variance-aware rademacher averages.acm transactions on knowledge discovery from data. ACM Trans. Knowl. Discov. Data 17(6), 1â47 (2023).
Riondato, M. & Kornaropoulos, E. M. Fast approximation of betweenness centrality through sampling. in Proceedings of the 7th ACM international conference on Web search and data mining 413â422 https://doi.org/10.1145/2556195.2556224 (2014).
Pellegrina, L. & Vandin, F. Silvan: Estimating betweenness centralities with progressive sampling and non-uniform rademacher bounds. arXiv e-prints arXiv:2106.03462 (2021).
Yan, W., Xie, D. & Zhang, Y. Betweenness approximation for hypernetwork dismantling with hypergraph neural network. arXiv e-prints arXiv:2203.03958 (2022).
Chehreghani, A., Bifet, M. H. & Abdessalem, T. Exact and approximate algorithms for computing betweenness centrality in directed graphs. Fund. Inform.182, https://doi.org/10.3233/FI-2021-2071 (2021).
Yoshida, Y. Almost linear-time algorithms for adaptive betweenness centrality using hypergraph sketches. in ACM SIGKDD 1416â1425 https://doi.org/10.1145/2623330.2623626 (2014).
Haghir, A., Chehreghani. M. Bifet & Abdessalem, T. Adaptive algorithms for estimating betweenness and k-path centralities. in Proceedings of the 28th ACM International Conference on Information and Knowledge Management 1231â1240 https://doi.org/10.1145/3357384.3358064 (2019).
Bentert M, K. L., Dittmann A. arXiv e-prints arXiv:1802.06701, (2018).
Brandes, U. & Pich, C. Centrality estimation in large networks. Int. J. Bifurcat. Chaos 17(07), 2303â2318. https://doi.org/10.1142/S0218127407018403 (2007).
Borassi, M. & Natale, E. Kadabra is an adaptive algorithm for betweenness via random approximation. JEA 24, 1â35. https://doi.org/10.1145/3284359 (2019).
Har-Peled, S. & Sharir, M. Relative \((p, \varepsilon )\)-approximations in geometry. Dis. Comput. Geomet. 45(3), 462â496. https://doi.org/10.1007/s00454-010-9248-1 (2011).
Sain, S. R. The nature of statistical learning theory. Inform. Sci. Stat. 38(4), 409. https://doi.org/10.1080/00401706.1996.10484565 (1996).
Alewijnse, S. P. A. et al. Progressive geometric algorithms. in Proceedings of the thirtieth annual symposium on Computational geometry 50â59 https://doi.org/10.1145/2582112.2582156 (2014).
Zhang, R. R. & Amini, M. R. Generalization bounds for learning under graph-dependence: A survey. arXiv e-prints arXiv:2203.13534 (2022).
Pellegrina, L. Sharper convergence bounds of monte carlo rademacher averages through self-bounding functions. arXiv e-prints arXiv:2010.12103 (2020).
Oneto, L., Ghio, A., Ridella, S. & Anguita, D. Global rademacher complexity bounds: From slow to fast convergence rates. Neural Process. Lett. 43, 567â602. https://doi.org/10.1007/s11063-015-9429-2 (2016).
Riondato, M. & Upfal, E. Mining frequent itemsets through progressive sampling with rademacher averages. ACM SIGKDD 1005â1014 https://doi.org/10.1145/2783258.2783265 (2015).
Pellegrina, L., Cousins, C., Vandin, F. & Riondato, M. Mcrapper: MonteâCarlo rademacher averages for poset families and approximate pattern mining. TKDD 16(6), 1â29. https://doi.org/10.1145/3532187 (2022).
Riondato, M. & Vandin, F. Misosoup: Mining interesting subgroups with sampling and pseudodimension. TKDD 14(5), 1â31. https://doi.org/10.1145/3385653 (2020).
Bergamini. Elisabetta, O. M., Henning, M. & Slobbe, A. Faster betweenness centrality updates in evolving networks. arXiv e-prints arXiv:1704.08592, https://doi.org/10.48550/arXiv.1704.08592 (2017).
Hayashi, T., Akiba, T. & Yoshida, Y. Fully dynamic betweenness centrality maintenance on massive networks. in Proceedings of the VLDB Endowment vol 92, pp 48â59 https://doi.org/10.14778/2850578.2850580 (2015).
Satotani, T., Migita, Y. & Takahashi, N. An algorithm for updating betweenness centrality scores of all vertices in a graph upon deletion of a single edge. J. Complex Netw. 10(4), cnac033. https://doi.org/10.1093/comnet/cnac033 (2022).
Lee, J., Lee, M. J. & Park, J. Y. Qube: A quick algorithm for updating betweenness centrality. in Proceedings of the 21st International Conference on World Wide Web 351â360 https://doi.org/10.1145/2187836.2187884 (2012).
Chehreghani, A., Bifet, M. H. & Abdessalem, T. Dybed: An efficient algorithm for updating betweenness centrality in directed dynamic graphs. in Big Data 2114â2123 https://doi.org/10.1109/BigData.2018.8622452 (2018).
Lee, S., Choi, M. J. & Chung, C. W. Efficient algorithms for updating betweenness centrality in fully dynamic graphs. Inform. Sci. 326, 278â296. https://doi.org/10.1016/j.ins.2015.07.053 (2016).
Kumari P, S. A. Approximation and updation of betweenness centrality in dynamic complex networks. in Computational Intelligence 25â37 https://doi.org/10.1007/978-981-13-1132-1_3 (2019).
Rasti, S. & Vogiatzis, C. Novel centrality metrics for studying essentiality in protein-protein interaction networks based on group structures. Networks 80(1), 3â50. https://doi.org/10.1002/net.22071 (2022).
Bergamini, E. & Meyerhenke, H. Fully-dynamic approximation of betweenness centrality. inAlgorithms-ESA 2015: 23rd Annual European Symposium 155â166 https://doi.org/10.1007/978-3-662-48350-3_14 (2015).
Kas, K. M., Carley, M. & Carley, L. R. An incremental algorithm for updating betweenness centrality and k-betweenness centrality and its performance on realistic dynamic social network data. Soc. Netw. Anal. Min. 4, 1â23. https://doi.org/10.1007/s13278-014-0235-z (2014).
Xiang, X., Zhu, C., Wang, Q., Zhu, X. & Zhou, Y. Identifying vital nodes in complex networks by adjacency information entropy. Sci. Rep.https://doi.org/10.1038/s41598-020-59616-w (2020).
Broido, A. D. & Clauset, A. Scale-free networks. Sci. Am. 288(5), 60â69 (2003).
Barrat, A. & Weigt, M. On the properties of small-world network models. Eur. Phys. J. B Condens. Matter Complex Syst. 13, 547â560. https://doi.org/10.1007/s100510050067 (2000).
Noé, F. & Tkatchenko, A. Machine learning for molecular simulation. Ann. Rev. Phys. Chem. 71, 361â390. https://doi.org/10.1146/annurev-physchem-042018-052331 (2020).
Pellegrina, L. & Vandin, F. Efficient Mining of the Most Significant Patterns with Permutation Testing 2070â2079 (Association for Computing Machinery, 2018).
Mitzenmacher, M. & Upfal, E. Probability and Computing: Randomization And Probabilistic Techniques in Algorithms and Data Analysis (Cambridge University Press, 2017).
Gu, H. L., Huang, L. & Zhang, X. D. The clustering coefficient and the diameter of small-world networks. Acta Math. Sin. 29(1), 199â208. https://doi.org/10.1007/s10114-012-0387-6 (2013).
Heer, H., Streib, L., Schäfer, R. & Ruzika, S. Maximising the clustering coefficient of networks and the effects on habitat network robustness. PLoS ONE 15(10), e0240940. https://doi.org/10.1371/journal.pone.0240940 (2020).
Bienenstock, P., Bonacich, E. J. & Oliver, M. The effect of network density and homogeneity on attitude polarization. Soc. Netw. 12(2), 153â172. https://doi.org/10.1016/0378-8733(90)90003-R (1990).
Borruso, G. Network density and the delimitation of urban areas. Trans. GIS 7(2), 177â191. https://doi.org/10.1111/1467-9671.00139 (2003).
Soffer, S. N. & Vazquez, A. Network clustering coefficient without degree-correlation biases. Phys. Rev. E 71(5), 057101. https://doi.org/10.1103/PhysRevE.71.057101 (2005).
Berahmand, A., Bouyer, K. & Samadi, N. A new centrality measure based on the negative and positive effects of clustering coefficient for identifying influential spreaders in complex networks. Chaos, Solitons Fract. 110, 41â54. https://doi.org/10.1016/j.chaos.2018.03.014 (2018).
Watts, S. & Strogatz, D. Collective dynamics of âsmall-worldâ networks. Nature 393(6684), 440â442. https://doi.org/10.1038/30918 (1998).
Tsai, Y., Lee, D. Y. & Matsuyama, E. Information entropy measure for evaluation of image quality. J. Digit. Imaging 21, 338â347. https://doi.org/10.1007/s10278-007-9044-5 (2008).
Liang, J., Shi, Z., Li, D. & Wierman, M. J. Information entropy, rough entropy and knowledge granulation in incomplete information systems. Int. J. Gen. Syst. 35(6), 641â654. https://doi.org/10.1080/03081070600687668 (2006).
Aguilar-Sánchez, R., Herrera-González, I. F., Mendez-Bermudez, J. & Sigarreta, J. Computational properties of general indices on random networks. Symmetry 12(8), 1341. https://doi.org/10.3390/sym12081341 (2020).
Funding
This research was funded by the Natural Science Foundation of Chongqing Province of China, Grant Number CSTB2022NSCQ-MSX0786; the China Postdoctoral Science Foundation, Grant Number 2023M733358; and the Science and Technology Research Project of Chongqing Education Commission, Grant Number KJQN202001118, KJQN202201109.
Author information
Authors and Affiliations
Contributions
N.X. and Q.L.W. carried out the original conceptualization of the study, methodology, formal analysis, visualization, writing of the original draft, and review & editing. M.W.Y. carried out supervision, conceptualization of the study, and review & editing. Q.L.W. carried out conceptualization of the study and data analysis. M.W.Y. carried out assistance in data analysis. N.X. carried out assistance in data curation. Q.L.W. carried out consulting in statistical methods and review & editing.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the articleâs Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the articleâs Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Xiang, N., Wang, Q. & You, M. Estimation and update of betweenness centrality with progressive algorithm and shortest paths approximation. Sci Rep 13, 17110 (2023). https://doi.org/10.1038/s41598-023-44392-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-023-44392-0
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.