Next Article in Journal
Wavelet-Based Multiscale Intermittency Analysis: The Effect of Deformation
Next Article in Special Issue
Synchronization Induced by Layer Mismatch in Multiplex Networks
Previous Article in Journal
Stochastic Thermodynamics of Multiple Co-Evolving Systems—Beyond Multipartite Processes
Previous Article in Special Issue
Exponentially Long Transient Time to Synchronization of Coupled Chaotic Circle Maps in Dense Random Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Unveiling the Connectivity of Complex Networks Using Ordinal Transition Methods

by
Juan A. Almendral
1,2,*,
I. Leyva
1,2 and
Irene Sendiña-Nadal
1,2
1
Complex Systems Group & Grupo Interdisciplinar de Sistemas Complejos (GISC), Universidad Rey Juan Carlos, 28933 Móstoles, Madrid, Spain
2
Center for Biomedical Technology, Universidad Politécnica de Madrid, 28223 Pozuelo de Alarcón, Madrid, Spain
*
Author to whom correspondence should be addressed.
Entropy 2023, 25(7), 1079; https://doi.org/10.3390/e25071079
Submission received: 14 June 2023 / Revised: 10 July 2023 / Accepted: 14 July 2023 / Published: 18 July 2023
(This article belongs to the Special Issue Synchronization in Complex Networks of Nonlinear Dynamical Systems)

Abstract

:
Ordinal measures provide a valuable collection of tools for analyzing correlated data series. However, using these methods to understand information interchange in the networks of dynamical systems, and uncover the interplay between dynamics and structure during the synchronization process, remains relatively unexplored. Here, we compare the ordinal permutation entropy, a standard complexity measure in the literature, and the permutation entropy of the ordinal transition probability matrix that describes the transitions between the ordinal patterns derived from a time series. We find that the permutation entropy based on the ordinal transition matrix outperforms the rest of the tested measures in discriminating the topological role of networked chaotic Rössler systems. Since the method is based on permutation entropy measures, it can be applied to arbitrary real-world time series exhibiting correlations originating from an existing underlying unknown network structure. In particular, we show the effectiveness of our method using experimental datasets of networks of nonlinear oscillators.

1. Introduction

Time series analysis has garnered significant research attention in recent decades. However, the exponential growth in data generation from various social, technological, and natural sources observed in recent years has posed a challenge for researchers seeking to extract valuable information from these datasets. Among the array of new tools developed for this purpose, the ordinal methods derived from the seminal work of Bandt and Pompe [1] have emerged as particularly intriguing.
In this approach, the original data series undergoes a process of coarse-graining, wherein it is replaced by a reduced set of symbols representing the order permutations of consecutive data points. The statistical properties and correlations of these ordinal permutation series effectively capture much of the dynamical information inherent to the original system. Moreover, its analysis is faster, computationally affordable and more robust to noise than raw data analysis. As a result, the applications of ordinal methods continue to expand [2], encompassing diverse fields such as neuronal [3] and brain dynamics [4], laser dynamics [5], and sports data analysis [6], among others.
Recently, the field of ordinal methods has advanced to incorporate “ordinal transition networks” (OTN). Initially proposed in Ref. [7], this concept introduces an additional layer of temporal correlation to the analysis by examining the statistics of ordinal patterns and their transitions. The time series is now represented as a network, where each ordinal pattern corresponds to a node, and the possible transitions among them are the links.
This innovative tool has demonstrated its potential in detecting subtle dynamical changes [8,9], and its associated ordinal transition entropy has proven to be more robust than standard permutation entropy when dealing with noisy signals [10,11]. Furthermore, the statistics of self-transitions within an OTN [12,13] offers an effective means of characterizing diverse time series dynamics. Notably, OTN complexity can accurately reproduce the results of Lyapunov exponents even for small embedding sizes [14].
The versatility of this method extends to various applications, such as distinguishing between different consciousness states [15], analyzing EEG data [16], investigating stock markets [17,18], and examining transportation data [13]. In combination with complex network techniques for nonlinear time series analysis, such as visibility or recurrence networks [10,19,20,21,22,23], this approach presents a valuable addition to the set of available tools.
Ordinal methods offer good potential for various applications, particularly in finding correlations between time series. The multivariate extension of these methods enables the synthesis of information from multiple data sources, resulting in a unified set of symbols [24,25,26]. This approach proves useful in detecting phase transitions within the collective state of small groups of coupled chaotic nodes. Furthermore, by incorporating delays into the analysis, multivariate ordinal methods can unveil the directionality of the coupling relationships [27].
Recent developments have introduced the concept of an ordinal network based on pattern co-occurrence between time series [28]. This approach facilitates the inference of correlations between different time series. Moreover, the notion of ordinal synchronization [29] demonstrates the capability to detect phase and anti-phase synchronization even in noisy real data.
These examples highlight the significant potential of ordinal methods in studying dynamical ensembles and networks. However, it is important to note that most of these applications currently remain confined to proof-of-concept studies involving small networks [24,25]. In addition, many of these approaches rely on multivariate pairwise correlations to extract information [4].
Nevertheless, it is crucial to realize that each element within a networked ensemble undergoes an information flux that alters its dynamics, effectively encoding valuable information regarding its topological role and the collective state. Ordinal methods serve as an ideal tool for unveiling these dynamical changes, enabling the creation of centrality rankings for nodes without solely relying on pairwise correlations [30,31].
Building upon this premise, our work extends the application of these methods to analyze the synchronization process in complex networks. Our findings demonstrate that ordinal transition methods outperform conventional ordinal patterns’ statistics when it comes to detecting subtle dynamical changes and discriminating nodes based on their topological roles. These initial results, using synthetic networks of chaotic Rössler systems and data from experiments with nonlinear electronic circuits, illuminate new possibilities for using ordinal methods in various applications, including functional brain data analysis [4], power grids, mobility networks, or any other domains involving the close interplay between structural and functional relationships within large-scale dynamical ensembles.

2. Model and Methods

2.1. Model

We consider a network of N identical Rössler dynamical systems [32] whose dynamics are governed by the following equations:
x ˙ i = f ( x i ) σ ˜ L i j h ( x j ) ,
with i = 1 , , N ; x i = ( x i , y i , z i ) the vector state of the node i; f x and h x : R 3 R 3 , being f ( x ) = [ y z , x + a y , b + z ( x c ) ] the vector flow of the Rössler system, and h ( x ) = [ 0 , y , 0 ] T the coupling function. We set a = b = 0.2 and c = 9.0 to get a phase-coherent chaotic attractor. The coefficients L i j = k i δ i j a i j are the elements of the Laplacian matrix whose adjacency matrix A : = ( a i j ) encodes the connectivity among the nodes of the network: a i j = 1 , if i and j are connected, and a i j = 0 otherwise. Thus, the degree of node i is k i = j a i j . The constant σ ˜ = σ k max is the coupling strength normalized by the maximum degree present in the network, that is, k max = max ( k i ) . This normalization is introduced to properly compare observables between different network realizations [33]. The system of N equations described by (1) has been numerically integrated using a Runge–Kutta method of 4th order with a time discretization of 0.005 . In all simulations, the time evolution is extended up to 12,000 time units, discarding the first half, which is considered a transient.
In ordinal methods, how the raw data is projected into an ordinal series depends on the particularities of the data, their sampling, or their continuous or discrete nature, without affecting the rest of the procedure [9]. In our case, to extract information about the temporal organization of each nodal dynamics x i ( t ) , we first computed the two-dimensional Poincaré section P { [ x i ( t m ) , z i ( t m ) ] R 2 | y ˙ i ( t m ) = 0 , y ¨ i ( t m ) > 0 } [34]. This allows us to map the whole attractor x i of node i into the one-dimensional time series S i { y i ( t m ) , m = 1 , , M } , generated at the times t m the attractor crosses the section P . Then, we construct the order relations of D successive data points in the sampled time series S i in the following manner. Once the terms in the sequence S i are split into disjoint blocks of size D, we create a symbolic sequence in which each element is replaced by a number in [ 1 , , D ] , corresponding to its relative ranking respect to its D 1 neighbours in the block. Therefore, each block is mapped into one of the D ! possible permutations in which D different elements can be arranged. We refer to these permutations as ordinal patterns, using the notation π with = 1 , , D ! . As an example, let us consider the series { 2.3 , 3.4 , 2.7 , 0.4 , 1.6 , 2.9 , 2.8 , 0.5 , 3.1 , 2.4 , } . We first split the series into disjoint blocks of size D = 3 : { 2.3 , 3.4 , 2.7 } , { 0.4 , 1.6 , 2.9 } , { 3.1 , 0.5 , 3.8 } , { 2.4 , } . Then, we derive the ordinal pattern for each block. This can be done from maximum to minimum or vice versa. In the first case, the ordinal patterns would be { 2 , 1 , 3 } , { 3 , 2 , 1 } , { 2 , 3 , 1 } , , which are arbitrarily denoted as π 5 , π 1 , π 2 ,
Finally, we define the probability of occurrence of a given pattern π as p = # ( π ) / L , being # ( π ) the number of times the ordinal pattern π appears in the sequence S i and L = M / D the total number of blocks of size D in which we divide the series S i ( is the floor function). Note that this procedure is only meaningful if M D ! .

2.2. Methods

In this Section, we present the methods employed to characterize the statistical complexity of a nodal dynamics. Our ultimate objective is to establish a relationship between the dynamical behaviour of each node and its structural connectivity within the network. To achieve this, we compare the ordinal permutation entropy based on the probability distribution of ordinal patterns and the ordinal transition entropy based on the transition probabilities between consecutive non-overlapping ordinal patterns.
Permutation entropy has previously been identified as a reliable indicator of the topological role of a node within a dynamical network [30,31]. However, our study reveals that analysing the transition probabilities between ordinal patterns offers a more effective and informative measure for assessing a node’s degree centrality.

2.2.1. Ordinal Permutation Entropy

Given the probability distribution of the ordinal patterns π of size D, with = 1 , , D ! , we define the normalized permutation entropy as the Shannon entropy evaluated on the ordinal pattern probability distribution:
H 0 = 1 ln D ! p ln p ,
with the criterion 0 0 = 1 to deal the case p = 0 . According to Bandt and Pompe [1], 3 D 7 values provide reliable information on the natural complexity of time series coming from chaotic dynamical systems as long as M D ! . However, unobserved ordinal patterns have been reported in chaotic dynamical systems, no matter how large the time series is, due to the underlying temporal correlations [35].

2.2.2. Ordinal Transition Entropy

In addition to the probability p of each ordinal pattern π , the transition probability p m , from the ordinal pattern π to π m , may reveal information into the finer temporal organization of a dynamical system [7]. We define the ordinal transition probability (OTP) matrix T : = ( p m ) as
p m = # ( π , π m ) # ( π )
being # ( π , π m ) the number of times the pair π π m consecutively occurs in the time series. Note that, in case # ( π ) = 0 for some pattern π , we can define p m = 0 . The total number of blocks L of size D must now be L D ! 2 so that the OTP matrix T is statistically significant.
Equation (3) is a proper stochastic matrix whose weights encode an OTN among ordinal patterns, including self-transitions, into which the time series of each nodal dynamics can be mapped. Hence, the complexity of this OTN will depend on the diversity of both ordinal patterns and transitions occurring among them.
Since m p m = 1 , we can define the node permutation entropy H π associated with the ordinal pattern π , a node of the OTN, which quantifies the randomness of the local transitions from the ordinal pattern π to any other pattern [36,37], as
H π = 1 l n D ! m = 1 D ! p m ln p m .
We characterize the transitional complexity of the OTN at the global level with a network permutation entropy obtained as the average of the node permutation entropies given by Equation (4). Depending on how the average is performed, we consider using either the first moment of the distribution of the H π values as in [36]
H T = 1 D ! = 1 D ! H π
or, alternatively, as defined in [38]:
H ^ T = = 1 D ! p H π l
which characterizes the weighted average (over the stationary probabilities p of each pattern π ) of the diversity of consecutive ordinal patterns. Other measures to characterize ordinal transition networks can be found in Refs. [22,39].

2.2.3. Synchronization Measures

In addition to characterizing the nodal dynamics by the randomness of the ordinal patterns and their transitions, we evaluate the dynamical network’s collective state for increasing coupling values since the chosen networked system (1) is known to evolve from a totally incoherent state when σ = 0 to a regime where the phases are locked while the amplitudes vary chaotically and uncorrelated, up to a regime of complete synchronization for very large σ . We compute the time-averaged phase order parameter
R = 1 N | j = 1 N e i θ j | t
with the phase θ j of the j-oscillator defined as θ j = arctan ( y j / x j ) [40], and synchronization error
E = 2 N ( N 1 ) i j x i x j t ,
which account for the level of phase ( 0 R 1 ) and total synchronization ( E 0 ), respectively. When the network is in complete synchrony, R = 1 and E = 0 . Here, t stands for the time average along a sufficiently large time series.

3. Results

3.1. Star Network

Let us start with a star configuration of N coupled Rössler systems. This network topology has N 1 nodes of degree k leaf = 1 connected to a central one, the hub, with k hub = N 1 , thus, offering two types of nodal dynamics with the maximum topological distance possible.
Figure 1a illustrates the transition to synchronization of an N = 9 star as the coupling strength σ increases. Along this route, the initially identical dynamics exhibited by the hub and the leaves start to differentiate due to the coupling interaction. This differentiation becomes evident in Figure 1b–i when examining the OTP matrix T for D = 3 , which has six ordinal patterns (corresponding to the following permutations: π 1 321 , π 2 312 , π 3 231 , π 4 132 , π 5 213 , π 6 123 ).
The colormap panels depict the OTP matrices T of the hub (Figure 1b–e) and one of the leaves (Figure 1f–i), representing four different values of σ corresponding to various synchronization stages. When σ = 0 (Figure 1b,f) and σ = 0.2 (Figure 1e,i), the hub and the leaves’ OTP matrices exhibit the same color coding. This similarity arises because they describe the transition probabilities between ordinal patterns of the same intrinsic dynamics, given by the flow f in Equation (1) when the systems are uncoupled or coupled but synchronized. In these panels, white and red dots indicate unobserved ordinal transitions ( p m = 0 ). These transitions may be absent either because the chosen chaotic dynamics include one forbidden ordinal pattern, white dots (caused by the forbidden pattern π 1 ), or because unreachable ordinal patterns exist from certain initial states, red dots (for instance, a π 3 pattern cannot follow a π 5 pattern).
As soon as the hub and the leaf interact (Figure 1c,g,d,h), the colormap changes differently for each of them. New transitions appear while others disappear. Notably, all ordinal transitions become nearly equiprobable for the hub, which is indicative of noisy dynamics—a characteristic feature.
To closely inspect how those transitions between ordinal patterns evolve along the synchronization process for each type of node in a star graph, we plot in each panel of the top row of Figure 2 the node permutation entropy H π of each ordinal pattern π for the hub and one of the leaves and the corresponding ordinal pattern frequencies p π at the bottom row as a function of the coupling strength σ . The most remarkable differences between hub and leaf come from those transitions starting at patterns π 1 , π 4 , and π 5 , since the gap between the node permutation entropies H π between hub and leaf is the largest, while for the rest of patterns is less pronounced. In particular, the pattern π 1 , which is forbidden in the isolated dynamics, not only emerges due to the interaction but also becomes much more entropic in the hub’s dynamics than in the leaves. In addition, note the differences in the probability frequency p π of each pattern that will have an effect on the network permutation entropy of the OTN as defined in Equation (6).
The primary objective of this work is to evaluate whether an entropic measure based on the information encoded in the OTN can outperform the predictive power of the entropic quantifiers based on just the probability distribution of the ordinal patterns. To examine this, we compare in Figure 3 how the ordinal permutation entropy H 0 [Equation (2)] and the network permutation entropies H T [Equation (5)] and H ^ T [Equation (6)] differentiate between the hub and leaf dynamics for two star networks of N = 9 and N = 31 nodes. The network permutation entropy H T (panel (b)) effectively separates the hub and leaf dynamics right from the onset of phase synchronization, and maintains this distinction over a broader range of coupling strengths compared to the two other entropies. This is linked to the results shown in Figure 2, in which those patterns with the greatest differences between hub and leaf node permutation entropies ( π 1 , π 4 and π 5 ) are those for which the probabilities of occurrence are smaller than for the rest ( π 2 , π 3 , and π 6 ). Note that the scale is not the same for all the panels. Consequently, the weighted version of the network permutation entropy, H ^ T , is biased by the most frequent patterns π 2 , π 3 , and π 6 which are the ones with the most similar hub and leaf node permutation entropies and there, less sensitive to distinguish between the nodes’ different roles in the collective dynamics.
Furthermore, a noteworthy observation is that the differentiation in the H T of the hub is more pronounced, and occurs at a lower coupling strength, in the case of the larger star with N = 31 , compared to the smaller one with N = 9 . On the other hand, the values for the leaf nodes in both stars are similar, which is expected as they have the same degree, k leaf = 1 . This finding implies that the network permutation entropy H T has the potential for effectively discerning topological roles within more complex ensembles, as we will explore in Section 3.2.

3.2. Scale-Free Network

Once we have evidence that the network permutation entropy H T can uncover the information stored in the OTN and discriminate the different roles that nodes have in star networks, we move forward to test this measure in the more challenging task of analyzing the synchronisation process of a scale-free network. Precisely, we consider the network dynamics of N = 300 nodes, as described by Equation (1), whose connectivity follows a scale-free degree distribution [41].
Given a coupling value σ , for each node i we compute the corresponding ordinal permutation entropy H 0 ( i ) and the network permutation entropy H T ( i ) . Since we expect that the nodes with the same degree k will have the same dynamical role within the network, we define a k-class average for the network permutation entropies as [30]:
H T k = 1 N k { i | k i = k } H T ( i ) ,
where N k is the number of nodes with degree k and k is just to denote how the measure has been obtained as an ensemble average of the given measure at the node level restricted to nodes with the same connectivity k. Similarly, we define a k-class average for the ordinal permutation entropies of those nodes with the same degree: H 0 k .
The results are presented in Figure 4, which compares H 0 k (a,c) and H T k (b,d). It is clear that the network permutation entropy surpasses the ordinal permutation entropy in its ability to sort nodes according to their degree. Upon increasing the normalized coupling strength σ / k max , both entropies exhibit a distinct separation based on node degrees. However, the differences between k-classes are more pronounced in the case of H T k .
It is worth noting that, for weak values of the coupling network, hubs exhibit higher entropy values, similar to the behaviour of the central node of a star network. However, as the synchronization progresses further, the ranking of the degree classes reverses. This change in behaviour throughout the synchronization process reflects an interesting fact: in weakly coupled networks, highly connected nodes perceive the information from the network as a source of noise, thereby increasing their entropy above that of the low-connected nodes. However, beyond this point, the highly connected nodes take the lead in driving the transition to coherence, while the other nodes remain unsynchronized [42,43], resulting, as a consequence, in an exchange of entropy trends.
The results shown in Figure 4b,d shed light on understanding this entropy-based centrality ranking. We plot the ordinal permutation entropy (Figure 4b) and the network permutation entropy (Figure 4d) as a function of k for various coupling values. The entropies of the degree classes demonstrate a quasi-linear relationship with k, displaying a positive slope for weak coupling (solid lines) and a negative slope for coupling strengths close to the system’s synchronization (dashed lines). Therefore, network permutation entropy measures stand out as a superior choice. Consequently, a centrality ranking can be established solely based on this entropy without prior knowledge of the underlying structure or costly pairwise computations of the observed time series.
To assess the method’s validity in a more realistic environment with available ground truth structural information, we analysed the experimental datasets of networks of nonlinear electronic circuits provided by Ref. [44]. These datasets comprise the time series of the output voltage of N = 28 electronic circuits coupled in 20 different network configurations and monitored along their synchronization process for 100 coupling levels, ranging from disconnection (isolated nodes) to values producing a network state of complete synchrony. Please refer to the reference [44] for a full description of the experiments.
Therefore, these experimental datasets provide the ideal testbed for our inference method and to predict the connectivity of the circuits by means of the network permutation entropy of each time series’ circuit. In order to do so, we choose a weak coupling condition (level 9 over 100) and, for only one of the network configurations [the one that is used as ground truth reference, plotted in Figure 5a], we calculate the average k-class network permutation entropy H T k .
The output of this calibration procedure is a function that maps the node degree classes of the network used as ground truth and the corresponding assigned network permutation entropies. One possible way is to produce a piecewise function k a ( H T ) such that the sequence of intervals are defined by interpolating the entropies measured in the experiment used as calibration for the degrees k and k + 1 , that is, T H ( k ) = [ H T k + 1 H T k ] / 2 for k = 1 , , k max 1 . Now, for each node i in any network different from the one used as a reference, we blindly assign a degree k a as a function of their dynamics using the following map:
k a i = 1 i f H T i < T H ( 1 ) k i f T H ( k ) < H T i < T H ( k + 1 ) ; k = 2 , , k max 1 k max i f H T i > T H ( k max 1 )
Since the real degree k r i of the node i is available in the dataset, we can compare the predicted value k a i with the real one. In Figure 5b, we plot the assigned degree versus the real one averaged for all the nodes in the 19 networks. Notice that these networks are very small and relatively sparse, with a maximum degree k max = 7 and, therefore, the degree sequence spans a much narrower interval than in the SF networks used in the simulations shown in Figure 4. Remarkably, even in this degree-constrained scenario and despite the noise inherent to an experimental environment, we obtain that for the 91 % of the nodes | k r i k a i | 1 , constituting a very high confidence level.

4. Conclusions

Ordinal measures provide a valuable collection of tools for analyzing correlated data series. However, the use of these methods to understand information interchange in coupled networks and the interaction between dynamics and structure during the synchronization process remains relatively unexplored. In this study, using networks of coupled Rössler systems in chaotic regime, we assessed the performance of the standard ordinal permutation entropy H 0 compared to the network permutation entropy H T , which captures information about transitions between ordinal patterns, and applied the proposed methodology to infer the connectivity of experimental datasets of networks of nonlinear circuits.
Whereas there exist other measures, such as statistical permutation complexity [30] and ordinal structurality [31], which have demonstrated their usefulness as proxies for degree distributions, our findings highlight the ordinal transition entropy as a more effective method for distinguishing topological roles, and producing more satisfactory outcomes, particularly for lower embedding dimensions.
Many methods focused on the structure–function relationship are primarily intended to infer the detailed connectivity network, down to the level of the individual links, from time series. However, in many cases, knowledge of centrality roles alone is sufficient for designing successful interventions in the dynamics. Therefore, we anticipate that our results, which do not rely on pairwise correlations between time series, will be of particular interest in the context of functional networks and other scenarios in which the underlying structural information is inaccessible.

Author Contributions

Software, J.A.A., I.L. and I.S.-N.; Investigation, J.A.A., I.L. and I.S.-N.; Writing—review & editing, J.A.A., I.L. and I.S.-N. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Spanish Ministerio de Ciencia e Innovación under Project PID2020-113737GB-I00.

Institutional Review Board Statement

Not applicable.

Data Availability Statement

Data sharing not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bandt, C.; Pompe, B. Permutation Entropy: A Natural Complexity Measure for Time Series. Phys. Rev. Lett. 2002, 88, 174102. [Google Scholar] [CrossRef] [PubMed]
  2. Leyva, I.; Martínez, J.H.; Masoller, C.; Rosso, O.A.; Zanin, M. 20 years of ordinal patterns: Perspectives and challenges. Europhys. Lett. 2022, 138, 31001. [Google Scholar] [CrossRef]
  3. Tlaie, A.; Ballesteros-Esteban, L.; Leyva, I.; Sendiña-Nadal, I. Statistical complexity and connectivity relationship in cultured neural networks. Chaos Solitons Fractals 2019, 119, 284–290. [Google Scholar] [CrossRef]
  4. Lehnertz, K. Ordinal methods for a characterization of evolving functional brain networks. Chaos 2023, 33, 022101. [Google Scholar] [CrossRef] [PubMed]
  5. Tiana-Alsina, J.; Quintero-Quiroz, C.; Masoller, C. Comparing the dynamics of periodically forced lasers and neurons. New J. Phys. 2019, 21, 103039. [Google Scholar] [CrossRef] [Green Version]
  6. Buldú, J.M.; Gómez, M.Á.; Herrera-Diestra, J.L.; Martínez, J.H. Nonlinear dynamics and networks in sports. Chaos Solitons Fractals 2021, 142, 110518. [Google Scholar] [CrossRef]
  7. Small, M. Complex networks from time series: Capturing dynamics. In Proceedings of the IEEE International Symposium on Circuits and Systems, Beijing, China, 19–23 May 2013; pp. 2509–2512. [Google Scholar] [CrossRef]
  8. Sun, X.; Small, M.; Zhao, Y.; Xue, X. Characterizing system dynamics with a weighted and directed network constructed from time series data. Chaos 2014, 24, 24402. [Google Scholar] [CrossRef] [Green Version]
  9. McCullough, M.; Small, M.; Stemler, T.; Ho, H.; Iu, C.; Iu, H.H.C. Time lagged ordinal partition networks for capturing dynamics of continuous dynamical systems. Chaos 2015, 25, 53101. [Google Scholar] [CrossRef] [Green Version]
  10. Pessa, A.A.; Ribeiro, H.V. Characterizing stochastic time series with ordinal networks. Phys. Rev. E 2019, 100, 42304. [Google Scholar] [CrossRef] [Green Version]
  11. Olivares, F.; Zanin, M.; Zunino, L.; Pérez, D.G. Contrasting chaotic with stochastic dynamics via ordinal transition networks. Chaos 2020, 30, 063101. [Google Scholar] [CrossRef]
  12. Borges, J.B.; Ramos, H.S.; Mini, R.A.; Rosso, O.A.; Frery, A.C.; Loureiro, A.A. Learning and distinguishing time series dynamics via ordinal patterns transition graphs. Appl. Math. Comput. 2019, 362, 124554. [Google Scholar] [CrossRef]
  13. Cardoso-Pereira, I.; Borges, J.B.; Barros, P.H.; Loureiro, A.F.; Rosso, O.A.; Ramos, H.S. Leveraging the self-transition probability of ordinal patterns transition network for transportation mode identification based on GPS data. Nonlinear Dyn. 2022, 107, 889–908. [Google Scholar] [CrossRef]
  14. Huang, M.; Sun, Z.; Donner, R.V.; Zhang, J.; Guan, S.; Zou, Y. Characterizing dynamical transitions by statistical complexity measures based on ordinal pattern transition networks. Chaos 2021, 31, 33127. [Google Scholar] [CrossRef]
  15. Varley, T.F.; Denny, V.; Sporns, O.; Patania, A. Topological analysis of differential effects of ketamine and propofol anaesthesia on brain dynamics. R. Soc. Open Sci. 2021, 8, 201971. [Google Scholar] [CrossRef] [PubMed]
  16. Kulp, C.W.; Chobot, J.M.; Freitas, H.R.; Sprechini, G.D. Using ordinal partition transition networks to analyze ECG data. Chaos 2016, 26, 073114. [Google Scholar] [CrossRef]
  17. Wang, X.; Han, X.; Chen, Z.; Bi, Q.; Guan, S.; Zou, Y. Multi-scale transition network approaches for nonlinear time series analysis. Chaos Solitons Fractals 2022, 159, 112026. [Google Scholar] [CrossRef]
  18. Peng, K.; Shang, P. Characterizing ordinal network of time series based on complexity-entropy curve. Pattern Recognit. 2022, 124, 108464. [Google Scholar] [CrossRef]
  19. Nicolis, G.; Cantú, A.G.; Nicolis, C. Dynamical aspects of interaction networks. Int. J. Bifurc. Chaos 2005, 15, 3467–3480. [Google Scholar] [CrossRef]
  20. Zhang, J.; Small, M. Complex Network from Pseudoperiodic Time Series: Topology versus Dynamics. Phys. Rev. Lett. 2006, 96, 238701. [Google Scholar] [CrossRef] [Green Version]
  21. Lacasa, L.; Luque, B.; Ballesteros, F.; Luque, J.; Nuño, J.C. From time series to complex networks: The visibility graph. Proc. Natl. Acad. Sci. USA 2008, 105, 4972–4975. [Google Scholar] [CrossRef]
  22. Zou, Y.; Donner, R.V.; Marwan, N.; Donges, J.F.; Kurths, J. Complex network approaches to nonlinear time series analysis. Phys. Rep. 2019, 787, 1–97. [Google Scholar] [CrossRef]
  23. Silva, V.F.; Silva, M.E.; Ribeiro, P.; Silva, F. Time series analysis via network science: Concepts and algorithms. WIREs Data Min. Knowl. Discov. 2021, 11, e1404. [Google Scholar] [CrossRef]
  24. Zhang, J.; Zhou, J.; Tang, M.; Guo, H.; Small, M.; Zou, Y. Constructing ordinal partition transition networks from multivariate time series. Sci. Rep. 2017, 7, 7795. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Shahriari, Z.; Small, M. Permutation Entropy of State Transition Networks to Detect Synchronization. Int. J. Bifurc. Chaos 2020, 30, 2050154. [Google Scholar] [CrossRef]
  26. Subramaniyam, N.P.; Donner, R.V.; Caron, D.; Panuccio, G.; Hyttinen, J. Causal coupling inference from multivariate time series based on ordinal partition transition networks. Nonlinear Dyn. 2021, 105, 555–578. [Google Scholar] [CrossRef]
  27. Ruan, Y.; Donner, R.V.; Guan, S.; Zou, Y. Ordinal partition transition network based complexity measures for inferring coupling direction and delay from time series. Chaos 2019, 29, 043111. [Google Scholar] [CrossRef]
  28. Ren, H.; Yuan, Q.; Semba, S.; Weng, T.; Gu, C.; Yang, H. Pattern interdependent network of cross-correlation in multivariate time series. Phys. Lett. Sect. A Gen. At. Solid State Phys. 2020, 384, 126781. [Google Scholar] [CrossRef]
  29. Echegoyen, I.; Vera-Ávila, V.; Sevilla-Escoboza, R.; Martínez, J.H.; Buldú, J.M. Ordinal synchronization: Using ordinal patterns to capture interdependencies between time series. Chaos Solitons Fractals 2019, 119, 8–18. [Google Scholar] [CrossRef] [Green Version]
  30. Tlaie, A.; Leyva, I.; Sevilla-Escoboza, R.; Vera-Avila, V.P.; Sendiña Nadal, I. Dynamical complexity as a proxy for the network degree distribution. Phys. Rev. E 2019, 99, 012310. [Google Scholar] [CrossRef] [Green Version]
  31. Letellier, C.; Leyva, I.; Sendiña Nadal, I. Dynamical complexity measure to distinguish organized from disorganized dynamics. Phys. Rev. E 2020, 101, 022204. [Google Scholar] [CrossRef] [Green Version]
  32. Rössler, O.E. An equation for continuous chaos. Phys. Lett. A 1976, 57, 397–398. [Google Scholar] [CrossRef]
  33. Gómez-Gardeñes, J.; Moreno, Y.; Arenas, A. Synchronizability determined by coupling strengths and topology on complex networks. Phys. Rev. E 2007, 75, 066106. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Shahriari, Z.; Algar, S.D.; Walker, D.M.; Small, M. Ordinal Poincaré sections: Reconstructing the first return map from an ordinal segmentation of time series. Chaos Interdiscip. J. Nonlinear Sci. 2023, 33, 053109. [Google Scholar] [CrossRef]
  35. Amigó, J.M.; Zambrano, S.; Sanjuán, M.A.F. True and false forbidden patterns in deterministic and random dynamics. Europhys. Lett. 2007, 79, 50001. [Google Scholar] [CrossRef]
  36. Masoller, C.; Hong, Y.; Ayad, S.; Gustave, F.; Barland, S.; Pons, A.J.; Gómez, S.; Arenas, A. Quantifying sudden changes in dynamical systems using symbolic networks. New J. Phys. 2015, 17, 023068. [Google Scholar] [CrossRef]
  37. McCullough, M.; Small, M.; Iu, H.H.C.; Stemler, T. Multiscale ordinal network analysis of human cardiac dynamics. Philos. Trans. R. Soc. A Math. Phys. Eng. Sci. 2017, 375, 20160292. [Google Scholar] [CrossRef] [Green Version]
  38. Unakafov, A.M.; Keller, K. Conditional entropy of ordinal patterns. Phys. D Nonlinear Phenom. 2014, 269, 94–102. [Google Scholar] [CrossRef] [Green Version]
  39. Zanin, M.; Olivares, F. Ordinal patterns-based methodologies for distinguishing chaos from noise in discrete time series. Commun. Phys. 2021, 4, 190. [Google Scholar] [CrossRef]
  40. Boccaletti, S.; Kurths, J.; Osipov, G.; Valladares, D.; Zhou, C. The synchronization of chaotic systems. Phys. Rep. 2002, 366, 1–101. [Google Scholar] [CrossRef]
  41. Barabási, A.L.; Albert, R. Emergence of scaling in random networks. Science 1999, 286, 509–512. [Google Scholar] [CrossRef] [Green Version]
  42. Zhou, C.; Kurths, J. Hierarchical synchronization in complex networks with heterogeneous degrees. Chaos Interdiscip. J. Nonlinear Sci. 2006, 16, 015104. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Pereira, T. Hub synchronization in scale-free networks. Phys. Rev. E 2010, 82, 036201. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Vera-Ávila, V.; Sevilla-Escoboza, R.; Lozano-Sánchez, A.; Rivera-Durón, R.; Buldú, J.M. Experimental datasets of networks of nonlinear oscillators: Structure and dynamics during the path to synchronization. Data Brief 2020, 28, 105012. [Google Scholar] [CrossRef] [PubMed]
Figure 1. OTP matrices for a star graph of N = 16 identical Rössler systems along the route to synchronization. (a) Phase order R (left axis) and synchronization error E (right axis) as a function of the coupling strength σ . (bi) OTP matrices T, with ordinal patterns π ( = 1 , , 6 since D = 3 ), of the hub (be) and one of the leaves (fi), for the coupling values marked with dotted lines in the top panel along the synchronization process. Ordinal transitions with zero probability are marked with dots: in white, those caused for π 1 being a forbidden ordinal pattern, and in red, the transitions that, despite being between existing ordinal patterns, actually do not occur. Time series length M = 1000 . Rössler parameters: a = b = 0.2 and c = 9.0 .
Figure 1. OTP matrices for a star graph of N = 16 identical Rössler systems along the route to synchronization. (a) Phase order R (left axis) and synchronization error E (right axis) as a function of the coupling strength σ . (bi) OTP matrices T, with ordinal patterns π ( = 1 , , 6 since D = 3 ), of the hub (be) and one of the leaves (fi), for the coupling values marked with dotted lines in the top panel along the synchronization process. Ordinal transitions with zero probability are marked with dots: in white, those caused for π 1 being a forbidden ordinal pattern, and in red, the transitions that, despite being between existing ordinal patterns, actually do not occur. Time series length M = 1000 . Rössler parameters: a = b = 0.2 and c = 9.0 .
Entropy 25 01079 g001
Figure 2. Evolution of the node permutation entropies H π (top row) and the corresponding probabilities p π (bottom row) of each ordinal pattern π , for D = 3 , as a function of the coupling σ (crosses for the hub and dots for one of the leaves). Notice that the scale is different for all the panels in the bottom row. In the upper right corner of each panel in the top row, it is shown schematically, with three connected black dots, the permutation of the corresponding ordinal pattern (for instance, π 2 is 312 and π 3 is 231). Data are for the same N = 16 star of Rössler systems and parameters as in Figure 1.
Figure 2. Evolution of the node permutation entropies H π (top row) and the corresponding probabilities p π (bottom row) of each ordinal pattern π , for D = 3 , as a function of the coupling σ (crosses for the hub and dots for one of the leaves). Notice that the scale is different for all the panels in the bottom row. In the upper right corner of each panel in the top row, it is shown schematically, with three connected black dots, the permutation of the corresponding ordinal pattern (for instance, π 2 is 312 and π 3 is 231). Data are for the same N = 16 star of Rössler systems and parameters as in Figure 1.
Entropy 25 01079 g002
Figure 3. Comparison between (a) the ordinal permutation entropy H 0 , and (b) the weighted H ^ T and (c) unweighted H T network permutation entropies along the route to synchronization, for the hub (blue crosses) and one of the leaves (red dots), of a star graph of size N = 9 (dotted curves) and N = 31 (solid curves). Insets show, in a log-linear scale, the absolute difference between the entropies of hub and leaf ( Δ H 0 = H 0 hub H 0 leaf , and the same for Δ H ^ T and Δ H T ).
Figure 3. Comparison between (a) the ordinal permutation entropy H 0 , and (b) the weighted H ^ T and (c) unweighted H T network permutation entropies along the route to synchronization, for the hub (blue crosses) and one of the leaves (red dots), of a star graph of size N = 9 (dotted curves) and N = 31 (solid curves). Insets show, in a log-linear scale, the absolute difference between the entropies of hub and leaf ( Δ H 0 = H 0 hub H 0 leaf , and the same for Δ H ^ T and Δ H T ).
Entropy 25 01079 g003
Figure 4. Comparison between the k-class ordinal permutation entropy H 0 k (a,c) and the k-class network permutation entropy H T k (b,d) for heterogeneous scale-free networks of N = 300 nodes and mean degree 4: (a,b) as a function of the normalized coupling strength σ k max , for several values of degree k class; (c,d) as a function of k, for several values of σ . In panel (d), solid lines refer to weak coupling values while dashed ones refer to couplings favoring a state close to synchronization. In panel (a), the synchronization error E (dashed line and rescaled for clarity) and the Kuramoto parameter R (dotted line) have been added as a reference. Colors in panels (c) and (d) are coded in the legends of (a) and (b), respectively. Each curve is the result of averaging over 50 network instances. Shaded bands indicate the confidence interval around the mean value computed as three times the standard error of the mean.
Figure 4. Comparison between the k-class ordinal permutation entropy H 0 k (a,c) and the k-class network permutation entropy H T k (b,d) for heterogeneous scale-free networks of N = 300 nodes and mean degree 4: (a,b) as a function of the normalized coupling strength σ k max , for several values of degree k class; (c,d) as a function of k, for several values of σ . In panel (d), solid lines refer to weak coupling values while dashed ones refer to couplings favoring a state close to synchronization. In panel (a), the synchronization error E (dashed line and rescaled for clarity) and the Kuramoto parameter R (dotted line) have been added as a reference. Colors in panels (c) and (d) are coded in the legends of (a) and (b), respectively. Each curve is the result of averaging over 50 network instances. Shaded bands indicate the confidence interval around the mean value computed as three times the standard error of the mean.
Entropy 25 01079 g004
Figure 5. Inference of the nodes’ degree of networks of electronic circuits based on the k-class network permutation entropy H T k of the timeseries available in Ref. [44]. (a) Structure connectivity of the electronic circuit network used as ground truth. (b) Average assigned degree k a versus the real degree k r obtained when using a single network as a training reference.
Figure 5. Inference of the nodes’ degree of networks of electronic circuits based on the k-class network permutation entropy H T k of the timeseries available in Ref. [44]. (a) Structure connectivity of the electronic circuit network used as ground truth. (b) Average assigned degree k a versus the real degree k r obtained when using a single network as a training reference.
Entropy 25 01079 g005
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Almendral, J.A.; Leyva, I.; Sendiña-Nadal, I. Unveiling the Connectivity of Complex Networks Using Ordinal Transition Methods. Entropy 2023, 25, 1079. https://doi.org/10.3390/e25071079

AMA Style

Almendral JA, Leyva I, Sendiña-Nadal I. Unveiling the Connectivity of Complex Networks Using Ordinal Transition Methods. Entropy. 2023; 25(7):1079. https://doi.org/10.3390/e25071079

Chicago/Turabian Style

Almendral, Juan A., I. Leyva, and Irene Sendiña-Nadal. 2023. "Unveiling the Connectivity of Complex Networks Using Ordinal Transition Methods" Entropy 25, no. 7: 1079. https://doi.org/10.3390/e25071079

APA Style

Almendral, J. A., Leyva, I., & Sendiña-Nadal, I. (2023). Unveiling the Connectivity of Complex Networks Using Ordinal Transition Methods. Entropy, 25(7), 1079. https://doi.org/10.3390/e25071079

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop