Next Article in Journal
Hacking the Predictive Mind
Next Article in Special Issue
Dynamic Contact Networks in Confined Spaces: Synthesizing Micro-Level Encounter Patterns through Human Mobility Models from Real-World Data
Previous Article in Journal
Intelligent Fault Diagnosis Method for Rotating Machinery Based on Recurrence Binary Plot and DSD-CNN
Previous Article in Special Issue
Non-Coding RNAs Extended Omnigenic Module of Cancers
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Evaluation Model for Node Influence Based on Heuristic Spatiotemporal Features

1
School of Computer Science, Qinghai Normal University, Xining 810016, China
2
Qinghai Provincial Key Laboratory of Tibetan Information Processing and Machine Translation, Qinghai Normal University, Xining 810008, China
3
Key Laboratory of Tibetan Information Processing of Ministry of Education, Qinghai Normal University, Xining 810008, China
*
Author to whom correspondence should be addressed.
Entropy 2024, 26(8), 676; https://doi.org/10.3390/e26080676
Submission received: 6 June 2024 / Revised: 30 July 2024 / Accepted: 2 August 2024 / Published: 10 August 2024

Abstract

:
The accurate assessment of node influence is of vital significance for enhancing system stability. Given the structural redundancy problem triggered by the network topology deviation when an empirical network is copied, as well as the dynamic characteristics of the empirical network itself, it is difficult for traditional static assessment methods to effectively capture the dynamic evolution of node influence. Therefore, we propose a heuristic-based spatiotemporal feature node influence assessment model (HEIST). First, the zero-model method is applied to optimize the network-copying process and reduce the noise interference caused by network structure redundancy. Second, the copied network is divided into subnets, and feature modeling is performed to enhance the node influence differentiation. Third, node influence is quantified based on the spatiotemporal depth-perception module, which has a built-in local and global two-layer structure. At the local level, a graph convolutional neural network (GCN) is used to improve the spatial perception of node influence; it fuses the feature changes of the nodes in the subnetwork variation, combining this method with a long- and short-term memory network (LSTM) to enhance its ability to capture the depth evolution of node influence and improve the robustness of the assessment. Finally, a heuristic assessment algorithm is used to jointly optimize the influence strength of the nodes at different stages and quantify the node influence via a nonlinear optimization function. The experiments show that the Kendall coefficients exceed 90% in multiple datasets, proving that the model has good generalization performance in empirical networks.

1. Introduction

Complex networks are graphical representations of real-world systems, where nodes and edges represent elements and their interrelationships. In networks, high-influence nodes play a decisive role in the operation and evolution of the system. For example, in social networks, key nodes such as internet celebrities and official accounts can spread information rapidly [1,2]; in power networks, the failure of high-influence nodes may lead to large-scale power outages [3]; and in virus propagation networks, super propagators can accelerate the spread of viruses [4,5]. Therefore, the assessment of node influence has become a focus of recent research; it is considered crucial to reveal the mechanism and functional roles of nodes in networks.
Currently, scholars discussing the issue of node influence primarily utilize the SIR propagation model, focusing on the following aspects: physical topology, node characteristics, and both physical topology and node characteristics.
Regarding approaches based on the physical topology of the network, scholars have developed two types of centrality metric, local and global, to conduct in-depth analyses of the structure and connectivity of networks. Local centrality metrics, such as degree centrality [6], can quickly pinpoint the core nodes in a network, but their view is limited to the direct neighbors of the nodes, and indirect connectivity relationships are ignored. Global centrality metrics, such as the k-shell approach [7], on the other hand, can reveal the network hierarchy, but nodes within the same shell layer are not sufficiently differentiated. To overcome these limitations, researchers have focused on improving the precision and breadth of local metrics [8,9,10] while strengthening the local differentiation abilities of global metrics [11,12,13,14], or proposing new centrality metrics by considering both local and global properties in an integrated manner to more accurately assess the roles and influences of nodes in a network [15,16,17,18]. However, this type of assessment method mainly focuses on the structure and ignores the node characteristics; as a result, the results have low interpretability. Therefore, scholars are turning to influence assessment methods based on node features to improve the accuracy and persuasiveness of the assessment results.
Other methods are based on node features. As the key elements involved in assessing the influence of nodes, node features comprise the inherent attributes and behavioral patterns of nodes. In social networks, these features may include personal attributes such as the users’ age, gender, and education, as well as behavioral patterns such as activity and interaction frequency. Using machine learning techniques, these features can be transformed into quantitative indicators of node influence. The construction of feature engineering is particularly important in this process, which can comprehensively capture the diversity of nodes’ characteristics and, thus, accurately assess their influence [19,20,21,22]. However, methods based on node characteristics often overemphasize the features themselves, neglecting the interactions between nodes, which constrains the accuracy of the assessment. To address this issue, scholars have begun exploring integrated evaluation methods that combine physical topology and node characteristics, aiming to more accurately depict node influence and their interactions
As for node influence evaluation methods based on physical topology and node characteristics, scholars utilize graph neural network (GNN) technology to establish node associations, inputting graph structure information and node features, enabling neural networks to learn network structures and evaluate node influence. However, methods based on graph neural networks (GNNs) [23] often focus excessively on local information and are susceptible to the influence of the network structure. To address this, scholars combine local and global centrality indicators, using models such as graph convolutional networks to aggregate node features and obtain more comprehensive node influence scores [24,25,26,27]. Additionally, due to their advantages in handling sequential data, long short-term memory networks (LSTMs) are widely applied to networks with time series relationships, precisely capturing the dynamic evolution of nodes and demonstrating excellent performance. Inspired by this, scholars have converted graph data into sequence data to fully leverage LSTM models for node influence evaluation [28,29]. However, deep-learning-based methods depend on network carriers, often employing classical network models as training networks [29,30]. These network models may not match empirical network topologies, potentially affecting the model’s evaluation performance across different network structures.
In summary, although these methods have made significant progress in utilizing network structure, node characteristics, or their combined factors to evaluate node influence, they often overlook the dynamic process of node influence from its initial formation to local diffusion and, ultimately, to its impact on the global network. Based on this, this study undertakes the following work, as illustrated in Figure 1.
  • Network structure optimization: We introduce the zero-model method to copy the empirical network topology, reduce the noise interference caused by network structure redundancy, and improve the learning ability of the assessment model for the empirical network topology characteristics.
  • Spatiotemporal depth perception module: This divides the subnetwork and feature construction to enhance the differentiation of node influence, strengthens the spatiotemporal depth of node influence perception, quantifies the node influence, and improves the robustness of the assessment.
  • Heuristic co-optimization: Heuristic evaluation algorithms are used to co-optimize the influence strength of nodes at different stages and quantify the influence of nodes through a nonlinear optimization function.

2. Model Description

The HEIST model aims to fuse the spatiotemporal characteristics of nodes for the accurate assessment of nodes’ influence in the process of network dynamic change. The framework is shown in Figure 2, and the specific steps are as follows:
(1)
Node influence label construction: Based on the SIR propagation model, the sequence R a n k R N × 1 of node influence scores is obtained.
(2)
High-order zero-model network construction: The zero-model concept is introduced, the empirical network topology is copied to generate the training network G , and the noise perturbation of the network structure redundancy is reduced.
(3)
Subnetwork delineation: The network nodes are traversed and the temporal association subnetwork G t i is delineated, centered on each node; t i is the subnetwork evaluation sequence.
(4)
Node feature construction: Based on the local subnetwork sequence G t 1 t N , we use the classical centrality index to characterize the different state neighborhood structures and feature differences of the nodes as the spatial features of the nodes; at the same time, we fill in the results of the subnetwork processed at different moments as the node influence historical a priori information Y v i | G t 1 t N , which is used as the node influence temporal features.
(5)
Spatiotemporal depth perception module: This has a built-in local and global two-layer structure. The local structure uses the GCN network to process node spatial features and the LSTM network to obtain historical information about changes in node influence.
(6)
The global structure is based on a heuristic algorithm that analyzes the likelihood of the influence distribution of nodes at different assessment stages and quantifies the node influence on a weighted average basis to achieve joint local and global optimization.

2.1. Node Influence Label Construction

The HEIST model uses the SIR propagation model [4] to construct node influence labels, and the SIR model classifies the nodes into three categories, susceptible (S), infected (I), and recovered (R), to simulate the process of infectious disease transmission. Initially, one node is infected and the rest are susceptible. In each time interval, the infected person infects the susceptible person in the neighborhood with a certain probability γ and turns to the recovered person directly after the completion of the infection, and the recovered person is no longer infected. The transmission process continues until there are no infected individuals. The number of recovered persons reflects the node’s propagation ability, i.e., its influence C . To simplify the calculation, the recovery rate is set to 1, i.e., infected persons are directly converted to recovered persons. The transmission process is shown in Algorithm 1.
Algorithm 1: SIR Propagation
Input: network G
Output:  R a n k N × 1
1:   for  v in G.nodes():
2:       R = 0 , I = 1 , S = N 1 , C = 0
3:      while  S t e p > 0 :
4:         while  I > 0 :
5:          Node I infects neighbors with γ , S R
6:          update I , S
7:         end while
8:          C = C + R , S t e p = S t e p 1
9:      end while
10:     append C to R a n k
11:  end for
In the algorithm, the input network is G , and output node influence sequence is R a n k N × 1 . Step 1 is to traverse the network nodes, in turn, as propagation sources. Step 2 is the initialization of the network node state, including the recovery state R , susceptible S , propagator I , and node influence C . Step 3 controls the number of iterations for a single node, and step 4 decides whether to continue the propagation or not, and ends when the infected person in the network is 0. Step 5 is the infection process; the infector I will infect the neighboring nodes with the propagation rate γ , and after infection it becomes the recovery state R. Step 6 updates the node state in the network. Step 7 calculates the node influence by accumulating the number of all restorer states during its iteration. Step 8 adds each node influence to the sequence R a n k .
The simulation is performed using the Monte Carlo method. The number of iterations is related to the number of network edges E . If E < 100 , it is 100,000 iterations; if E < 10 , 000 , it is 10,000 iterations; if E > 10 , 000 , it is 1000 iterations [18]. Finally, the ranked label R a n k N × 1 is obtained for the influence of nodes in the network.

2.2. Higher-Order Zero-Model Network Construction

The HEIST model treats the network carrier as an undirected unweighted graph containing multiple constraints G = { V , E , k , P , P j ( k 1 , k 2 ) , C ¯ , C ¯ ( k ) } ; V = { v 1 , v 2 , , v N } is the set of nodes in the graph and E = { e 1 , e 2 , , e N } is the set of edges in the graph. k is the average degree, P is the degree distribution matrix, P j ( k 1 , k 2 ) is the joint degree distribution, k 1 and k 2 denote the degrees of the two endpoints of a randomly selected edge in the graph, C ¯ is the average clustering coefficient, and C ¯ ( k ) is the average clustering coefficient of the degree correlation. A = [ a i j ] N x N is the neighborhood matrix of the graph, used to describe the network topology, and a ij is defined as follows:
a i j = 1 , v i   i s   c o n n e c t e d   t o   v j 0 , v i   i s   n o t   c o n n e c t e d   t o   v j .
In this study, we introduce the zero-model approach to copy the empirical network and reduce the noise interference due to the redundancy of the network structure; this also improves the learning ability of the evaluation model for the topological properties of the empirical network. The parameters of the constraints in the copying process are shown in Table 1, corresponding to different orders of the zero model.
In the table, the construction of the zero-model network shows a gradual increase in the number of orders with the fitting effect of the empirical network, from the 0th order G 0 k to retain the number of nodes N and the average degree k , the 1st order G 1 k to match the node degree distribution P , the 2nd order G 2 k to expand to the joint degree distribution P j ( k 1 , k 2 ) , the 2.25th order G 2.25 k to incorporate the average clustering coefficient C ¯ , up to the 2.5th order G 2.5 k , which accurately compounds the system-related average clustering coefficient C ¯ ( k ) ; we use this approach to comprehensively approach the complexity of the empirical network characteristics. Here, we use the 2.5-order zero model as the higher-order zero model, and the 2.5-order zero model is currently the highest-order and practically zero-model network [31,32].

2.3. Subnetwork Delineation

The HEIST model evaluates the influence of nodes by dividing the whole network into time-order-associated subnetworks G t 1 t N = { G t 1 , G t 2 , , G t N } with the same number of nodes; t i is the order of evaluation of each subnetwork, which corresponds to the node number in the network, i.e., subnetwork G t i at the moment of t i corresponds to subnetwork G v i with v i as the central node. For a node v i , there is a subnetwork G v i = { V v i   , E v i   } centered on it, which contains the set of nodes V v i   and the set of edges E v i   . The average degree of the top 10% nodes N 10% of the network degree ranking is selected as the local subnetwork size L to fully cover the global network, and the size of the local network L is defined as follows:
L = 10 N i = 1 N 10% k v i .
For a localized network S u b G ( v i ) , its set of nodes node V i l o c a l is defined as follows:
V v i   = { v i , e 1 v i , e 2 v i , , 0 } = { v i } { U ( v i ) { 0 , , 0 } L 1 s ( v i ) } i f   s ( v i ) < L 1 V v i   = { v i , e 1 v i , e 2 v i , , e L 1 v i } i f   s ( v i ) L 1 ,
U ( v i ) = arg max u ( v i ) = { e 1 v i , e 2 v i , , e n v i } .
where u ( v i ) is the neighboring node of node v i , U ( v i ) is the set of neighboring nodes of node v i in reverse order of their degree value, L is the subnet size, s ( v i ) is the number of neighbors of the node, and e n v i is the neighbor of node v i ranked n in degree.

2.4. Node Feature Construction

HEIST is used to investigate node influence based on both temporal and spatial dimensions, with spatiotemporal features constructed around the subnetwork G v i , spatial features F v i | G v i S as the node classical centrality indicators, and temporal features F v i | G t i S as the node influence historical a priori information. Details are shown in Figure 3.
Spatial feature construction: This model shows the features of each local subnetwork, and three types of classical node local and global centrality indicator cascades are chosen as the spatial features F v i | G v i S of the nodes in subnetwork G v i , as shown in Equation (5). The indicator information is shown in Table 2. For the node-centered local subnetwork G v i , the node spatial feature matrix F G v i s L × 6 and the subnetwork topology matrix A v i are used to fully reflect the spatial information related to the subnetwork node influence. For the study network G , the 2D node feature information of each subnetwork is spliced into 3D feature data F G N × L × 6 for easy model processing.
F v i | G v i S = [ D C ( v i | G v i ) | | E C ( v i | G v i ) | | H I T S ( v i | G v i ) | | C C ( v i | G v i ) | | B C ( v i   | G v i ) | | K s ( v i   | G v i ) ]
Temporal feature construction: Based on the temporal information t 1 t i 1 of the subgraph sequence G t 1 t i 1 , the temporal features of node v i in subgraph G t i are constructed to further enhance the model’s ability to perceive the temporal dimension by mining the influence of the node’s historical a priori information on the node’s influence. The construction of specific temporal features is shown below:
Y v i | G t 1 t N = [ Y v i | G t 1 | | Y v i | G t 2 | | | | Y v i | G t N ] , Y v i | G t i Y G t i
F v i | G t i t = [ Y v i | G t 1 | | Y v i | G t 2 | | | | Y v i | G t i 1 ] , F v i | G t i t F G t i t
Y G t i is the sequence of feature processing results of subgraphs at different moments as the node influence history prior information F G t i t , while Y v i | G t i corresponds to the node’s results in each subgraph and F v i | G t i t corresponds to the node’s timing information in each subnetwork. Here, Y v i | G t 1 t N N × N and F v i | G t i t N × ( i 1 ) .

2.5. Spatiotemporal Depth Perception Module

2.5.1. Local Structure

Spatial feature processing involves traversing the network 3D feature data F G , extracting one subnetwork node spatial feature F G v i s at a time and combining it with the subnetwork topology information A v i as model inputs, and obtaining the spatial representations of the subnetwork node influence Y G v i s L × 1 through GCN network aggregation. The detailed process is shown in Equation (8):
H ( l + 1 ) = σ ( D ˜ 1 / 2 A ˜ D ˜ 1 / 2 H ( l ) W ( l ) ) .
where H ( l ) is the node representation matrix of layer l , and A ˜ is the augmented adjacency matrix of A + I , where A is the original adjacency matrix and I is the unit matrix, which is used to consider the information of the node itself. D ˜ is the diagonal matrix of A ˜ , where D ˜ i i = j A ˜ i j , W ( l ) represents the weight matrices of layer l , σ is the activation function, and H ( 0 ) is the feature matrix of the input, denoted as F G v i s R L × 6 . The subnetwork node influence spatial representation Y G v i s serves as the final node representation matrix.
Temporal feature processing involves initializing the two-dimensional zero matrix F G T = Z N × N , which records the historical a priori information related to node influence at each moment; it also processes the spatial features of the subnetwork nodes F G v i s L × 6 via GCN and LSTM processing, using the processed results Y G t i to fill in F G T . The node data are filled in on a one-to-one basis, and a column of data is filled in at each moment. The historical a priori information is spliced with the spatial features of the subnetwork at the current moment to form the LSTM input data F G t i T . The processing is as follows:
i t = σ ( W i [ h t 1 , F G t i T ] + b i ) ,
f t = σ ( W f [ h t 1 , F G t i T ] + b f ) ,
o t = σ ( W o [ h t 1 , F G t i T ] + b o ) ,
C ˜ t = tanh ( W c [ h t 1 , F G t i T ] + b c ) ,
C t = f t C t 1 + i t C ˜ t ; h t = o t tanh ( C t ) .
Y G T = { h 1 , h 2 , h N } ; Y G t i T = h t .
where σ is the activation function, tanh is the hyperbolic tangent activation function, denotes element-by-element multiplication, F G t i T is the input of the current time step, h t 1 is the hidden state of the previous time step, W is the integrated weight matrix, and b is the bias vector. i t is an input gate for selectively accepting and storing information about the influence of nodes related to the current time step, and f t is a forgetting gate for selectively forgetting irrelevant historical information. o t is an output gate for deciding which information in the memory cells will be output to the hidden state. C ˜ t is the candidate memory cell and h t is the hidden state update cell. The output of the LSTM is a sequence of hidden states h t . Each subnetwork feature is processed to obtain the corresponding node influence time step representation Y G t i T .
Spatiotemporal feature processing: A subnetwork node feature matrix was used to obtain the node influence spatial representation Y G v i s and temporal representation Y G t i T after the batch normalization (BN) operation to accelerate the model convergence and to prevent overfitting; finally, the processed spatial and temporal representations are summed up to obtain the spatiotemporal representations of the influence of the nodes of the different subnodes. The details of the processing are shown in Equations (15) and (16):
B N ( s ) = ϒ s s μ s σ s 2 + ε + β s ; B N ( t ) = ϒ t t μ t σ t 2 + ε + β t ; t
Y G t i = B N ( Y G v i S ) + B N ( Y G t i T )
where μ s , σ s 2 , and μ t , σ t 2 , respectively, represent the mean and variance for spatial representation s and temporal representation t . Variables s and t correspond to Y G v i s and Y G v i T , while ϒ s and β s are learnable parameters.

2.5.2. Global Structure

A heuristic evaluation algorithm is used to jointly optimize the strength of the nodes’ influence at different stages and to quantify the nodes’ influence using a nonlinear optimization function. The specific process is shown in Algorithm 2.
Algorithm 2: Heuristic Joint Optimization
Input: F G N × L × 6 , A G N × L × L , R a n k N × L × 1
Output: Is N × 1
1:    while Epoch > 0:
2:        G L o s s = 0 , F G T Z N × N
3:       for  F G v i S , A G v i , R a n k G v i in F G , A G , R a n k :
4:         F G v i S L × 6 , A G v i L × L , R a n k G v i L × 1 , K d b e s t = 0 , L L o s s = 0
5:        while  L s t e p > 0 :
6:            Y G v i s = G C N ( F G v i S , A G v i )
7:            Y G t i T = L S T M ( F G T | F G v i S ) , Y G v i = B N ( Y G v i s ) + B N ( Y G t i T )
8:            L L o s s = M A E ( Y G v i , R a n k G v i ) , K d = K e n d a l l ( Y G v i , R a n k G v i )
9:           If  K d > K d b e s t :
10:            record Y G v i Record Y G v i , fill F G T with Y G v i .
11:          end if
12:          Backpropagate the L L o s s and update model parameters.
13:           L s t e p = L s t e p 1
14:       end while
15:      end for
16:       I s = M L P ( F G T )
17:       G L o s s = M A E ( I s , R a n k )
18:      Backpropagate the G L o s s and update model parameters.
19:      Epoch = Epoch − 1
20:   end while
In the algorithm, the input data F G N × L × 6 , A G N × L × L , and R a n k N × L × 1 are used to obtain the node influence score Is N × 1 . Step 2 involves global data initialization, containing global loss G L o s s and the node influence history information F G T Z N × N . Step 3 comprises data extraction, extracting the node spatial features F G v i S , subnetwork adjacency matrix A G v i , and subnetwork node influence labels R a n k G v i for one subnetwork at a time. Step 4 involves local data initialization, containing the most Kendall coefficients K d b e s t and the local loss L L o s s . Steps 3–11 and 14 are local data initialization. Steps 3–11 and 12–14 are local and global optimization, respectively, forming a heuristic joint optimization. Step 3 is the number of local structural optimizations required to ensure that the large-scale subnetwork can achieve the optimal characterization of node influence within the local area and to enhance the reliability of historical information on node influence. Step 8 records the node influence characterization under the optimal result into the historical information. Step 12 comprises different stages of node influence of the high-dimensional feature data using MLP down to the low-dimensional level, as the node global influence. The specific processing is as follows:
I s = W ( K ) σ ( W ( K 1 ) σ ( σ ( W ( 1 ) x + b ( 1 ) ) ) + b ( K 1 ) ) + b ( K )
where W ( K ) is the weight matrix of layer K , b ( K ) is the bias vector of layer K , σ is the activation function, and x corresponds to Y G .

2.6. Loss Function

The HEIST model uses the mean absolute error loss (MAE, MAE) as the local and global loss function for joint optimization, which is defined in Equation (18):
M A E ( y , y ^ ) = 1 N i = 1 N | y i y ^ i | .
where y i is the measured value of the i th sample, y ^ i is the actual value of the i th sample, and | y i y ^ i | is the absolute value of the prediction error of the i th sample.
In the local optimization, y corresponds to the spatiotemporal representation of the influence of subnetwork nodes Y G v i , and y ^ corresponds to the subseries of subnetwork node influence rankings R a n k G v i . In the global optimization, y corresponds to the node global influence I s , and y ^ corresponds to the network global node influence label R a n k .

3. Dataset

The dataset used in this study is shown in Table 3; it was sourced from the Network Repository (https://networkrepository.com/index.php (accessed on 15 November 2023)) and the KONECT Project (https://github.com/kunegis/konect-analysis (accessed on 15 November 2023)).
In the table, N represents the network size, E denotes the number of connected edges of the network, K denotes the average degree of the network, L denotes the size of the subnetwork, C denotes the network clustering coefficient, K s max denotes the maximum k-kernel degree of the network, and β t h denotes the network propagation threshold.

4. Experimental Analysis

In this section, we first introduce the experimental datasets and evaluation metrics, and this is followed by a series of experiments: (1) correlation analysis, (2) the maximum influence propagation experiment, (3) the visualization experiment using results from small networks, (4) the hyperparameter analysis experiment, and (5) the ablation experiment.

4.1. Evaluation Indicators

In this study, Kendall’s coefficient is used as an indicator to assess the correlation between the predicted and actual rankings, defined as shown in Equation (19):
K e n d a l l t a u = ( n c n d ) 1 2 n ( n 1 )
where n c is the number of consistent pairs, i.e., pairs whose relative order is consistent for the two variables; n d is the number of inconsistent pairs, i.e., pairs whose relative order is inconsistent for the two variables; and n is the number of samples. Kendall’s coefficient takes values between −1 and 1. K e n d a l l t a u = 1 means that the two sequences are in perfect agreement; K e n d a l l t a u = 1 means that the two sequences are in perfect opposition; K e n d a l l t a u = 0 means that the two sequences are not correlated.

4.2. Baseline Model

The baseline models used in this study are shown in Table 4.

4.3. Correlation Analysis

In this section, we compare the HEIST model with other algorithms, setting the infection rate β of the network dataset equal to the propagation threshold β t h . When the infection rate equals the propagation threshold, the system is in a critical state, where each infected node uniformly spreads to other nodes, thereby maintaining relative stability. We calculate the Kendall correlation coefficient between the influence sequences obtained from the HEIST model and the result sequences from the SIR propagation model. Detailed results are shown in Table 5.
Table 5 shows the following:
(1)
The performance of the HEIST model is closely related to the scale of subnetwork division; it performs well on datasets such as Karate, Road, Lesmis, Polbooks, Jazz, and PowerGrid, thanks to its dense connectivity relations and high coverage of subnetworks to networks, which enable the model to comprehensively capture the spatial information within the subnetworks and the temporal variations between subnetworks. On the contrary, in scale-free networks such as USAir97 and Email, the degree of front-end nodes is extremely high, which facilitates feature learning, but the large-scale subnetwork division introduces too much filler data and interferes with the model evaluation. However, the model still has advantages over other model-like methods, with the Kendall coefficients all stable above 0.86.
(2)
The performance of the HEIST model in Adjnoun networks is affected by low clustering coefficients, which leads to dispersed node relationships and limited tight group formation, which in turn challenges the effectiveness of the local unit feature learning. Nonetheless, the model still outperforms similar methods, highlighting the advantages of modeling based on subnetwork features rather than global features in enhancing the assessment.
(3)
When dealing with large networks such as PowerGrid, the HEIST model demonstrates significant advantages over other deep learning methods. The unique distribution of average degree and clustering coefficients in this network challenges the traditional model based on neighboring node feature evaluation, leading to a decrease in the evaluation accuracy. The HEIST model fully captures the network characteristics by setting a smaller subnetwork size and effectively aggregating the local feature information to construct the global features, which results in a better evaluation result.

4.4. Analysis of Maximum Influence Node Propagation Experiment

To verify the accuracy of the model in obtaining high-influence nodes, we conducted experiments on nine real network datasets of different sizes. The top five highest-influence nodes obtained using eight different methods were defined as high-influence nodes and used as transmission sources for the SIR infectious disease transmission experiments. The infection rates were set as 1, 1.2, 1.4, 1.6, 1.8, and 2.0 times the transmission threshold. The average impact value of the high-influence nodes selected using each method on the network size was calculated via a Monte Carlo simulation of a large number of transmission experiments. To simplify the experiments, the recovery rate of the SIR model was set to 1, i.e., a node becomes immune immediately after propagation. The number of immune nodes at the end of propagation is considered to be an indicator of the influence size. The specific results are shown in Figure 4.
The figure shows that the high-influence nodes identified by the HEIST model have the most significant impact on nine real networks of different sizes when acting as propagation sources. This means that the top five high-influence nodes evaluated by the model are closest to the super-propagators in the propagation mechanism. This phenomenon indicates that the model is efficient and discriminative in identifying front-end nodes; such nodes are contained in multiple spatially information-rich subnetworks with excellent feature learning.

4.5. Visualization of Experiments on Small Networks

To gain a clearer understanding of the model’s evaluation of the top five nodes in terms of influence, a small network with 26 nodes was generated for visualization and analysis. Eight different methods were used to evaluate the node influence in the network. The top five nodes with the highest influence were selected as sources for the SIR propagation model to observe the model’s effectiveness, as shown in Figure 5.
Figure 5 consists of three parts: the network topology visualization intuitively displays the degree of nodes, differentiated by color; the influence assessment comparison covers eight types of methods and SIR simulations, with the top five high-influence nodes marked in red; and the propagation simulation experiments are based on the top five nodes selected using each method, in order to visualize the propagation effect from the two dimensions of speed and scale. The results show that the model in this study exhibits outstanding performance in identifying the key front-end nodes, which can be used as the source to quickly infect the whole network, due to the rich features and pure neighborhood information of these nodes, which gives full play to the advantages of the model.

4.6. Hyperparametric Analysis

Analysis of Local Structural Parameters

HEIST introduces the heuristic idea of advancing global continuity from local ordering, so it is crucial to ensure the accuracy of the local node influence assessment. In this study, different local structure execution times are selected for the experiments, and the infection rate is selected as the propagation threshold β t h . The score sequence obtained from the model is compared with the infection sequence of the SIR propagation model, and the Kendall coefficient is calculated. Detailed results are shown in Table 6.
As shown in Table 6, the number of executions of the local structure significantly affects the final evaluation results, where the optimal effectiveness is closely related to the number of executions and the local cell size. For datasets with a large local size L , such as Jazz, USAir97, Email, etc., the model needs to increase the number of local executions to optimize its effectiveness; on the contrary, in networks with many nodes but a small local size L setting, such as PowerGrid, the model only needs a single local execution to achieve the optimal performance, which reflects the model’s adaptability and robustness under different network structures.

4.7. Ablation Experiment

4.7.1. Training Network Ablation Experiment

This study uses six types of datasets, including ER random networks, BA scale-free networks, WS small-world networks, PLC power-law cluster networks, and various order null model networks. These datasets have the same node size, average degree, and local structure as the original network. They were used as training sets for the model, while real network datasets were used for testing. As an example, the network structure of the Les Misérables real dataset was visualized, as shown in Figure 6.
As shown in the figure, compared to other network models, null model networks closely match the structure of the original network. To demonstrate the impact of training and testing network structures on evaluation results, different training networks are tested, with the results shown in Figure 7.
The bar chart in the figure compares the performance of different training network models in the training and testing phases and visualizes the difference in the training–testing ratio through the right-hand illustration. The analysis shows the following:
(1)
The training results of the training networks based on ER stochastic network, BA scale-free network, WS small-world network, and PLC power-law cluster network are significantly affected by the randomness of the generation rules and show a degree of uncertainty. On the contrary, as the order of the zero-model network increases, the constraints increase, the training network gradually approaches the real network characteristics, and the training test results tend to be stable, indicating that the model learns more accurate features.
(2)
ER networks have limited internode variability, which limits the model’s ability to capture the subtle features of complex networks, leading to significant differences between the training and testing results. WS networks, on the other hand, exhibit clear association structures with significant internode variability, but the phenomenon of overlapping associations may increase the training complexity and be affected by the structure of the real network, e.g., in the adjnoun network (with a low clustering coefficient of 0.17). Using high-clustering WS network training may lead to poor test performance.
(3)
In power-law distribution networks such as BA scale-free networks and PLC power-law cluster networks, the scarcity of highly influential nodes means that the selected scale L often exceeds the average degree range when dividing the local network, resulting in a large amount of filler data, introducing noise to the model, and affecting the stability of the test results. In particular, local networks centered on end nodes may affect the overall training effect due to the loss of feature information, a phenomenon reflected in several datasets such as karate, road, polbooks, and adjnoun.

4.7.2. Spatiotemporal Feature Ablation Experiment

The HEIST model fuses the GCN and LSTM models to obtain the spatial representation of network node influence using the GCN model and the temporal correlation of node influence in different subnets using the LSTM model. In order to verify the feasibility of the model, ablation experiments are carried out, where separate GCN and LSTM models are used for local-to-global learning to explore the influence of hybrid spatiotemporal features on the model effect. The specific experimental results are detailed in Table 7.
In this experiment, the HEIST model uses data that are locally executed once; it shows significant advantages in assessing node influence by fusing the GCN and LSTM models. The HEIST model significantly improves the assessment accuracy in all the tests on nine different datasets. The analysis shows that, when relying only on spatial features, it is possible to identify local node influence, but this method lacks global vision; meanwhile, focusing only on temporal features makes it difficult to ensure local accuracy, which in turn introduces larger errors into the global fusion. The success of the HEIST model lies in its heuristic learning mechanism, which emphasizes local ordering to drive global continuity and ensures the comprehensiveness and accuracy of the assessment. Local instability or global discontinuity can weaken the model, highlighting the importance of integrating the spatial and temporal features of node influence.

5. Conclusions

Node influence recognition has practical value in the fields of social networks, communication, and disease transmission; it helps to accurately identify key nodes to optimize information dissemination strategies and disease prevention and control measures. In this study, we introduce a high-order zero model as a training network, deconstruct the static network into multiple time-ordered correlated subnetworks, and comprehensively consider the spatiotemporal characteristics of each subnetwork; a heuristic joint optimization algorithm is applied to quantify the global influence of nodes through local ordering to drive global continuity. The experiments prove that the method performs well. This effectiveness is attributed to the strategy of exchanging space for time, but this also leads to high levels of time complexity. Future research will be devoted to exploring new feature construction methods, more reasonable subnet divisions, and more efficient models to deepen the study of node influence.

Author Contributions

Conceptualization, S.J.; methodology, S.J.; software, S.J.; validation, S.J., Y.X., T.H. and J.H.; formal analysis, S.J.; investigation, S.J.; resources, Y.X. and J.H.; data curation, S.J. and J.H.; writing—original draft preparation, S.J.; writing—review and editing, T.H., Y.X. and J.H.; visualization, S.J.; supervision, J.H. and Y.X.; project administration, J.H. and Y.X.; funding acquisition, Y.X. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by National Key Research and Development Program of China (314) and The State Key Laboratory Program (2024-SKL-005).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data that support the findings of this study are available upon request from the corresponding author. The data are not publicly available due to ongoing follow-up research.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Belfin, R.V.; Bródka, P. Overlapping community detection using superior seed set selection in social networks. Comput. Electr. Eng. 2018, 70, 1074–1083. [Google Scholar]
  2. Chandran, J.; Viswanatham, V.M. Dynamic node influence tracking based influence maximization on dynamic social networks. Microprocess. Microsyst. 2022, 95, 104689. [Google Scholar] [CrossRef]
  3. Huang, J.; Xiong, M.; Wang, J. Route choice and parallel routes in subway Networks: A comparative analysis of Beijing and Shanghai. Tunn. Undergr. Space Technol. 2022, 128, 104635. [Google Scholar] [CrossRef]
  4. Kermack, W.O.; McKendrick, A.G. Contributions to the mathematical theory of epidemics--I. 1927. Bull. Math. Biol. 1991, 53, 33–55. [Google Scholar] [CrossRef] [PubMed]
  5. Fu, L.; Yang, Q.; Liu, Z.; Liu, X.; Wang, Z. Risk identification of major infectious disease epidemics based on complex network theory. Int. J. Disaster Risk Reduct. 2022, 78, 103155. [Google Scholar] [CrossRef]
  6. Gao, S.; Ma, J.; Chen, Z.; Wang, G.; Xing, C. Ranking the spreading ability of nodes in complex networks based on local structure. Phys. A Stat. Mech. Its Appl. 2014, 403, 130–147. [Google Scholar] [CrossRef]
  7. Kitsak, M.; Gallos, L.K.; Havlin, S.; Liljeros, F.; Muchnik, L.; Stanley, H.E.; Makse, H.A. Identification of influential spreaders in complex networks. Nat. Phys. 2010, 6, 888–893. [Google Scholar] [CrossRef]
  8. Chen, D.; Su, H. Identification of influential nodes in complex networks with degree and average neighbor degree. IEEE J. Emerg. Sel. Top. Circuits Syst. 2023, 13, 734–742. [Google Scholar] [CrossRef]
  9. Flores, J.; Romance, M. On eigenvector-like centralities for temporal networks: Discrete vs. continuous time scales. J. Comput. Appl. Math. 2018, 330, 1041–1051. [Google Scholar] [CrossRef]
  10. Zhang, H.; Zhong, S.; Deng, Y.; Cheong, K.H. LFIC: Identifying influential nodes in complex networks by local fuzzy information centrality. IEEE Trans. Fuzzy Syst. 2021, 30, 3284–3296. [Google Scholar] [CrossRef]
  11. Yuan, H.L.; Feng, C. Ranking and Recognition of Influential Nodes Based on k-shell Entropy. Comput. Sci. 2022, 49, 226–230. [Google Scholar]
  12. Yang, X.; Xiao, F. An improved gravity model to identify in-fluential nodes in complex networks based on K-shell method. Knowl. Based Syst. 2021, 227, 107198. [Google Scholar] [CrossRef]
  13. Chawla, P.; Mangal, R.; Chandrashekar, C.M. Discrete-time quantum walk algorithm for ranking nodes on a network. Quantum Inf. Process. 2020, 19, 1–21. [Google Scholar] [CrossRef]
  14. Zhao, X.; Yu, H.; Huang, R.; Liu, S.; Hu, N.; Cao, X. A novel higher-order neural network framework based on motifs attention for identifying critical nodes. Phys. A Stat. Mech. Its Appl. 2023, 629, 129194. [Google Scholar] [CrossRef]
  15. Yang, S.; Zhu, W.; Zhang, K.; Diao, Y.; Bai, Y. Influence Maximization in Temporal Social Networks with the Mixed K-Shell Method. Electronics 2024, 13, 2533. [Google Scholar] [CrossRef]
  16. Xi, Y.; Cui, X. Identifying Influential Nodes in Complex Networks Based on Information Entropy and Relationship Strength. Entropy 2023, 25, 754. [Google Scholar] [CrossRef]
  17. Yu, Y.; Zhou, B.; Chen, L.; Gao, T.; Liu, J. Identifying Important Nodes in Complex Networks Based on Node Propagation Entropy. Entropy 2022, 24, 275. [Google Scholar] [CrossRef]
  18. Wu, Y.; Ren, Y.; Dong, A.; Zhou, A.; Wu, X.; Zheng, S. Key Nodes Identification Method Based on Neighborhood K-shell Distribution. Comput. Eng. Appl. 2024, 60, 87–95. [Google Scholar] [CrossRef]
  19. Inuwa-Dutse, I.; Liptrott, M.; Korkontzelos, I. Detection of spam-posting accounts on Twitter. Neurocomputing 2018, 315, 496–511. [Google Scholar] [CrossRef]
  20. Zhao, G.; Jia, P.; Huang, C.; Zhou, A.; Fang, Y. A machine learning based framework for identifying influential nodes in complex networks. IEEE Access 2020, 8, 65462–65471. [Google Scholar] [CrossRef]
  21. Wen, X.; Tu, C.; Wu, M.; Jiang, X. Fast ranking nodes importance in complex networks based on LS-SVM method. Phys. A Stat. Mech. Its Appl. 2018, 506, 11–23. [Google Scholar] [CrossRef]
  22. Qiu, L.; Zhang, J.; Tian, X. Ranking influential nodes in complex networks based on local and global structures. Appl. Intell. 2021, 51, 4394–4407. [Google Scholar] [CrossRef]
  23. Zhang, M.; Wang, X.; Jin, L.; Song, M.; Li, Z. A new approach for evaluating node importance in complex networks via deep learning methods. Neurocomputing 2022, 497, 13–27. [Google Scholar] [CrossRef]
  24. Fan, C.; Zeng, L.; Ding, Y.; Chen, M.; Sun, Y.; Liu, Z. Learning to identify high betweenness centrality nodes from scratch: A novel graph neural network approach. In Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China, 3–7 November 2019; pp. 559–568. [Google Scholar]
  25. Zhao, G.; Jia, P.; Zhou, A.; Zhang, B. InfGCN: Identifying influential nodes in complex networks with graph convolutional networks. Neurocomputing 2020, 414, 18–26. [Google Scholar] [CrossRef]
  26. Qu, H.; Song, Y.-R.; Li, R.; Li, M. GNR: A universal and efficient node ranking model for various tasks based on graph neural networks. Phys. A Stat. Mech. Its Appl. 2023, 632, 129339. [Google Scholar] [CrossRef]
  27. Hamilton, W.L.; Ying, R.; Leskovec, J. Inductive Representation Learning on Large Graphs. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS’17), Long Beach, CA, USA, 4–9 December 2017; pp. 1025–1035. [Google Scholar]
  28. Kumar, S.; Mallik, A.; Panda, B.S. Influence maximization in social networks using transfer learning via graph-based LSTM. Expert Syst. Appl. 2023, 212, 118770. [Google Scholar] [CrossRef]
  29. Zhu, J.; Wang, L. Identifying influential nodes in complex networks based on node itself and neighbor layer information. Symmetry 2021, 13, 1570. [Google Scholar] [CrossRef]
  30. Xi, Y.; Wu, X.; Cui, X. Node Influence Ranking Model Based on Transformer. Comput. Sci. 2024, 51, 106–116. [Google Scholar]
  31. Gjoka, M.; Kurant, M.; Markopoulou, A. 2.5 k-graphs: From Sampling to Generation. In Proceedings of the 32nd IEEE International Conference on Computer Communications, Turin, Italy, 14–19 April 2013; pp. 1968–1976. [Google Scholar]
  32. Mahadevan, P.; Hubble, C.; Krioukov, D.; Huffaker, B.; Vahdat, A. Orbis: Rescaling degree correlations to generate annotated internet topologies. In Proceedings of the 2007 Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications, Kyoto, Japan, 27–31 August 2007; pp. 325–336. [Google Scholar]
Figure 1. Study overview.
Figure 1. Study overview.
Entropy 26 00676 g001
Figure 2. Node influence assessment process diagram.
Figure 2. Node influence assessment process diagram.
Entropy 26 00676 g002
Figure 3. Nodal spatiotemporal feature construction maps.
Figure 3. Nodal spatiotemporal feature construction maps.
Entropy 26 00676 g003
Figure 4. Plot of the scale of impact on the network when the HEIST model is compared to other models with high-impact nodes selected as propagation sources.
Figure 4. Plot of the scale of impact on the network when the HEIST model is compared to other models with high-impact nodes selected as propagation sources.
Entropy 26 00676 g004
Figure 5. Analysis of propagation in a small network.
Figure 5. Analysis of propagation in a small network.
Entropy 26 00676 g005
Figure 6. Visualization of different network structures.
Figure 6. Visualization of different network structures.
Entropy 26 00676 g006
Figure 7. Graph of the effect of different training network training tests.
Figure 7. Graph of the effect of different training network training tests.
Entropy 26 00676 g007
Table 1. Correlation table of constraints for different orders of zero models.
Table 1. Correlation table of constraints for different orders of zero models.
Zero ModelRestrictive Condition
G 0 k N , k .
G 1 k P
G 2 k P j ( k 1 , k 2 )
G 2.25 k C ¯
G 2.5 k C ¯ ( k )
Table 2. Descriptions of the selected features.
Table 2. Descriptions of the selected features.
FeaturesDescriptions
Degree centrality (DC)Measures the number of direct connections a node has in the network and reflects the direct influence and activity of the node.
Eigenvector centrality (EC)Measures the pattern of connections between a node and its neighboring nodes and takes the importance of the neighboring nodes into account.
HITSMeasures the importance of the node as a source of information and information disseminator in the network.
Closeness centrality (CC)Measures the total length of the shortest path between a node and other nodes and describes the role of a node as a broadcaster in the network.
Betweenness centrality (BC)Measures the number of shortest paths through a node and describes the node’s role as a bridge in the network.
K-shell (Ks)Measures the structural position of a node in the network and describes the node’s central role in the network.
Table 3. Network statistical characteristics.
Table 3. Network statistical characteristics.
Network N E K L C K s max β t h
Karate341569.18150.5780.13
Road391708.72260.4560.08
Lesmis772546.6200.5790.08
Polbooks1054418.4210.4960.08
Adjnoun11285015.18220.17120.07
Jazz198274227620.62300.03
USAir97332212612.8640.63270.02
Email90810430221170.49840.01
PowerGrid494165942.6760.0850.26
Table 4. Baseline model characteristics.
Table 4. Baseline model characteristics.
Baseline ModelMethod Description
K-shell [7]Quantifies the influence of a node by assigning it to different shell levels. No des within the same shell have the same core value, i.e., they have similar position and importance in the network. The higher the shell value of a node, the more significant its core position in the network structure and the higher its influence.
DC+ [8]Comprehensively assesses the node influence by combining the degree of the node itself and the degree of its neighboring nodes.
KEM [14]Calculates the K-order information entropy of nodes in the network as the node influence score.
InfGCN [25]Learns representations of nodes by combining neighboring graphs and classical structural features as input. These representations contain the structural and feature information of the nodes, which can reflect the importance and influence of the nodes in the process of virus propagation or information dissemination.
GCN [26]Learns the embedding representation of a node by aggregating its neighbor information. These embedding vectors fuse the local and global information of a node, which can reflect the node’s position, role, and relationship with other nodes in the network.
GraphSAGE [27]An inductive learning approach is used to generate the embedding representation of a node by sampling and aggregating the information of its neighboring nodes. This approach both considers the local information of the nodes and captures the global structure of the network.
Table 5. Comparison of Kendall’s correlation coefficients between the HEIST model and other models.
Table 5. Comparison of Kendall’s correlation coefficients between the HEIST model and other models.
DatasetNetwork CharacteristicMethods
N K L C DC+KSKEMGCNGraph
SAGE
Inf
GCN
HEIST
Karate349.18150.570.790.800.7830.8030.8170.800.946
Road398.72260.450.890.6770.9080.8430.8730.8390.924
Lesmis776.6200.570.8640.8010.8640.8780.8640.8680.88
Polbooks1058.4210.490.8410.7460.8590.8010.8540.7980.873
Adjnoun11215.2220.170.8720.830.8810.820.8470.8540.853
Jazz19827620.620.9470.810.9540.740.9150.9250.958
USAir9733212.8640.630.8990.800.9130.860.8610.8990.886
Email908221170.490.790.7360.9330.7640.6370.7880.799
PowerGrid49412.760.080.7090.6060.7310.430.440.7140.759
Table 6. Effect of the number of executions of the local model.
Table 6. Effect of the number of executions of the local model.
Network L β HEIST1HEIST3HEIST5HEIST7HEIST10HEIST12
Karate150.130.9170.9460.9340.9380.9350.938
Road260.080.8910.8960.920.9240.9220.911
Lesmis200.080.8580.8610.8810.8670.8660.865
Polbooks210.080.8520.8550.8730.8630.8650.861
Adjnoun220.070.8190.8230.8240.8530.8430.85
Jazz620.030.9360.9360.9380.9480.9580.947
USAir97640.020.8020.8170.8330.8560.8860.869
Email1170.010.7010.7130.7370.7460.7650.799
PowerGrid60.260.7590.7470.7420.7450.7480.745
Table 7. Ablation experiment effect graph.
Table 7. Ablation experiment effect graph.
Network L β GCNLSTMHEIST
Karate150.130.8650.91080.917
Road260.080.86780.88660.8914
Lesmis200.080.84210.84540.8578
Polbooks210.080.83590.760.8520
Adjnoun220.070.80720.81080.8191
Jazz620.030.9280.89230.9357
USAir97640.020.76810.74080.8015
Email1170.010.66520.67250. 7012
PowerGrid60.260.73630.72150.7585
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Jin, S.; Xiao, Y.; Han, J.; Huang, T. An Evaluation Model for Node Influence Based on Heuristic Spatiotemporal Features. Entropy 2024, 26, 676. https://doi.org/10.3390/e26080676

AMA Style

Jin S, Xiao Y, Han J, Huang T. An Evaluation Model for Node Influence Based on Heuristic Spatiotemporal Features. Entropy. 2024; 26(8):676. https://doi.org/10.3390/e26080676

Chicago/Turabian Style

Jin, Sheng, Yuzhi Xiao, Jiaxin Han, and Tao Huang. 2024. "An Evaluation Model for Node Influence Based on Heuristic Spatiotemporal Features" Entropy 26, no. 8: 676. https://doi.org/10.3390/e26080676

APA Style

Jin, S., Xiao, Y., Han, J., & Huang, T. (2024). An Evaluation Model for Node Influence Based on Heuristic Spatiotemporal Features. Entropy, 26(8), 676. https://doi.org/10.3390/e26080676

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop