2. Instantaneous Lyapunov Exponent Analysis
Solutions of non-autonomous vector fields,
such as the motion of a fluid element
in the time-dependent fluid velocity field
, can be challenging to analyze. The method of Lagrangian coherent structures (LCS) has become a popular tool to analyze structures in the phase space of low-dimensional non-autonomous vector fields [
1,
2,
3]. A popular computational framework to obtain LCS considers a scalar field derived from numerically integrated trajectories (i.e., numerical approximation of solutions of (
1), called the “Lagrangian” point of view in the fluid literature). Specifically, the finite-time Lyapunov exponent (FTLE) field [
2,
4].
Recently, new tools have been developed which use vector field gradients, instead of integrating trajectories, the instantaneous time limit of FTLE and LCS. These vector gradients are assembled into the Eulerian “rate-of-strain” tensor,
so-called because of its relationship to the space-fixed, or “Eulerian” point-of-view in the fluid literature. The Eulerian rate-of-strain tensor was shown to provide an instantaneous approximation of LCS in two-dimensional fluid flows [
5].
Further work on this topic extended the ideas to
n dimensions [
6], showing that the minimum and also the maximum eigenvalues of the Eulerian rate-of-strain tensor,
and
, are each the limits of the backward-time and forward-time FTLE fields, as the integration time goes to zero. Troughs of the field associated with the minimum eigenvalue can be identified as instantaneous attracting LCSs whereas ridges of the maximum eigenvalue field can be identified as instantaneous repelling LCSs. For the remainder of this paper, we will refer to the negatively signed minimum and positively signed maximum eigenvalues of the
as the attraction and repulsion rates, each, and both can be considered as
instantaneous, rather than finite-time, Lyapunov exponents. For brevity we refer to the iLE field, the instantaneous Lyapunov exponent, field, following [
6].
Broadly speaking, the trenches of the attraction rate field reveal where phase space regions will congregate under the flow, as shown in the schematic of
Figure 1.
These are instantaneous attracting LCSs, that is, the instantaneously most attracting co-dimension 1 surfaces in
M, also referred to as instantaneous Lyapunov exponent structures (iLES) [
6]. In practical applications, the primary focus has been on the attraction rate given its importance for prediction [
7] as opposed to repelling features particles that will diverge from before flowing independent of those features.
In the remainder of this paper, we will restrict ourselves to autonomous systems, where the vector field (
1) is independent of time, that is,
2.1. Instantaneous Attraction and Repulsion Rates
For ease of exposition, we limit our discussion in this section to autonomous two-dimensional vector fields. To calculate the attraction rate, we must calculate the gradient of the vector field, , for the vector field , where u is the first component and v is the second component. Additionally, the two-dimensional state is written as .
The gradient of the velocity vector is,
and the Eulerian rate-of-strain tensor (
2) is explicitly,
The attraction rate,
, which is the minimum eigenvalue of
at the location
is given analytically by,
where the dependence of
u and
v on
is understood. Similarly, the repulsion rate is given analytically by,
2.2. Finite-Time Lyapunov Exponent
Based on the ordinary differential equation (ODE), (
3), we can calculate the flow map,
. The flow map,
, where
, is given by,
and is typically given numerically [
2,
8,
9,
10]. Taking the gradient of the flow map
with respect to initial conditions
,
, the right Cauchy–Green strain tensor over a time epoch of interest can be calculated,
which is positive-definite, giving eigenvalues which are all positive. In the special case of a two-dimensional flow, the resulting two eigenvalues are ordered
. From the maximum eigenvalue,
, the FTLE [
2,
11] can be defined as,
where
t is the (signed) elapsed time, often referred to as the integration time or evolution time in the FTLE literature. The FTLE measures the rate of separation of two nearby fluid parcels in a flow over the time horizon
t. Ridges of the
field for
indicate regions of the flow which are the most attracting over the time interval
. Furthermore, in [
6] it was demonstrated that the
field (with the minus sign, where
is from (
6)) is the limit of the
field as
. Thus, the attraction rate field,
, provides a computationally inexpensive instantaneous approximation of the main attracting curves, as it is based on a single velocity snapshot; the strength is that no trajectory integration is necessary.
3. On Evolution of Observations, the Koopman Operator and Its Eigenfunction PDE
The Koopman spectral analysis has become extensively popular and relevant lately in science and engineering [
12,
13,
14] especially for a data-driven perspective for analyzing dynamical systems. The idea is that even a non-linear dynamical system can be interpreted as a linear system, which is obviously much easier to analyze. However, this reinterpretation of the non-linear dynamical system is as a linear dynamical system in a function space, which may be infinite dimensional. The trade-off is that an infinite dimensions but linear system replaces the low-dimensional non-linear system. From there, computational schemes proceed to estimate the representation in terms of finite dimensional truncation of the infinite dimensional embedding. Often, by finite truncation the linear dynamics is approximated by finite dimensional embedding to a linear subspace.
We first review Koopman spectral analysis in brief details. Consider, the autonomous differential equation in (
3). As above, the flow for each time
(or semi-flow for positive times
) as a function,
for a trajectory starting at initial condition
. There is the dynamics of the associated Koopman operator, also often called a composition operator, which describes evolution of “observables”, meaning “measurements” along the flow, [
12,
15]. Rather than analyzing individual trajectories in the phase space, as is classically done, observations measured as functions over the space are analyzed. These “observation functions”,
are elements of a space of observation functions
. For example,
is commonly used since it is especially convenient for numerical applications that utilize the inner product associated with a Hilbert space structure [
12,
13,
14,
16,
17]. We will assume scalar observation functions, but multiple scalar observation functions can also be considered together, “stacked” as a composite vector-valued observation function.
The dynamics of how observation functions change over time as sampled along orbits is precisely what the Koopman operator describes, as illustrated in
Figure 2. The Koopman operator, (or composition operator), [
15,
18,
19,
20],
, associated with
, is a (semi-)flow, stated as the following composition,
on the function space
, for each
(or as a semi-flow if the relation only holds for
). In other words, for each
, we observe the value of an observable
g not at
, but “downstream” by some elapsed time
t, at
. See
Figure 2. Notice that for brevity we have suppressed the starting time
in the statement of the Koopman operator semi-flow notation,
. A significant feature of the Koopman operator is that it is a linear operator on its domain, the function space
, but at the cost of possibly being infinite-dimensional. It is an
infinite-dimensional linear operator despite being associated with a flow
that evolves on a
finite-dimensional space, and indeed even due to a
non-linear vector field.
The spectral theory of Koopman operators [
12,
15,
20,
21] concerns eigenfunctions and eigenvalues of the operator
. Writing an eigenvalue, eigenfunction pair of the Koopman operator as
, the pair must satisfy the equation,
See
Figure 2. For convenience, we will write “KEIGs” to refer to a Koopman eigenvalue and eigenfunction pair,
. Though it may seem surprising if trying to make an analogy to the spectrum of matrices (finite rank operators), for each eigenvalue
, the eigenfunction
is not unique. In fact, there are
uncountably infinitely many functions associated with each eigenvalue λ [
22,
23]. If one allows only unit-normalized eigenfunctions, to remove the trivial idea that constant multiples of eigenfunctions are eigenfunctions, this infinite multiplicity is still true.
An emerging concept in the empirical study of dynamical systems is the spectral decomposition of observables into eigenfunctions of the Koopman operator. Let a
D-dimensional vector valued set of observables
be written as a linear combination of eigenfunctions,
where the vectors
are called Koopman modes. The true power of this concept lies in the following expression, which describes the dynamics of observation functions in a form reminiscent of linear Fourier analysis, but now in terms of Koopman modes. That is if,
, then,
We considered the non-uniqueness of such a decomposition, and moreover the nature and cardinality of these eigenfunctions in [
22]. In this current work, this property leads to our goal to contrast such a Koopman spectral decomposition to other notions of coherence, such as the FTLE and iLE [
6]. In this way, we highlight that interesting global observation functions, such as the FTLE field, can be usefully presented as series in Koopman eigenfunctions, and in some cases, as Koopman eigenfunctions themselves.
A rapidly growing literature exists concerning data-driven approaches to construct Koopman eigenfunctions for an observed flow, given data as trajectories, namely dynamic mode decomposition, (DMD), extended dynamic mode decomposition (EDMD) and variants [
24,
25,
26,
27]. However, we will pursue an analytical description of KEIGs. This is best done in terms of a partial differential equation (PDE) which follows from the infinitesimal generator of the Koopman operator. Since the Koopman operator
is a semi-group of compositions, we can consider the action of the infinitesimal generator, [
17,
28,
29],
We recall [
17,
28,
30] that a smooth exact eigenfunction of the Koopman operator of a given flow, for a given eigenvalue
must satisfy the following PDE based on the generator (
17),
if
M is compact, and
, is in
, or, alternatively, if
. Here, we will use solutions constructed directly from (
18), to compare the Koopman perspective to the LCS and iLE perspective.
This PDE is of a form that is often called quasilinear in the PDE literature [
31], and, therefore, solvable by the method of characteristics, [
22,
23]. Note however that our specific quasilinear PDE in fact gives a linear eigenvalue problem. An initial data function
propagates throughout an open domain in which the flow of the differential equation is defined, and respecting (
18). That an open-KEIGS pair,
has the form,
where
is the “time”-of-flight such that for a point
, there is an intersection in
U by pull back to the data surface
,
For each
,
is the parameterization on
of that first intersection point. This solution is valid when the orbit is non-recurrent in the open domain, during the period of interest. In
Figure 3 we illustrate schematically that a general solution of the eigenfunction PDE (
18) is a pull back along the flow through
, to read the measurement data on
. The measurement (observation) is then scaled according to the linear action of
, for the “time” it takes to pull back the point
.
5. Two-Dimensional Non-Linear Saddle Flow
While in 1 dimension, the iLE field is not a Koopman eigenfunction, perhaps the situation is different in 2 dimensions. As an initial 2-dimensional vector field to motivate our study, we consider the following non-linear saddle flow which has cubic term,
in the domain
. So
. These two uncoupled ordinary differential equations admit the explicit solutions,
where the initial condition at time 0 is
. The right Cauchy–Green tensor for a backward integration time
, is,
which yields a backward-time FTLE (
), from (
10), of,
From a Taylor series approximation for small
, the backward FTLE can be written as an expansion in
t for small
,
The backward-time FTLE can be approximated to leading order,
, by the negative of the minimum eigenvalue of
. The matrix
is,
The minimum eigenvalue is the iLE, the attraction rate (
6),
.
Using
as our candidate function, we find,
which is not in the form
(as in (
18)), so
is not a Koopman eigenfunction. However, it can be written as a
sum of Koopman eigenfunctions.
Following the prescription given above for constructing Koopman eigenfunction using the explicit solution (
27) to the ODE, we find that the Koopman eigenfunctions are of the form,
where
is any scalar function of
and
is a constant. One can verify directly that a function of the form (
33) satisfies (
18), the infinitesimal form of the eigenvalue equation. Details are in
Appendix A.
We can now construct the scalar function
in terms of Koopman eigenfunctions. Note that
is a Koopman eigenfunction, using
and
, a constant function, in (
33).
Additionally, note that, via Taylor series expansion, we have,
where
due to our domain
U, therefore,
Note that the following is a Koopman eigenfunction, using
and
,
We can remove the
term by adding another Koopman eigenfunction, using
and
,
We can remove the leading order remainder term from
, which is
, via
A choice of
will cancel out
. Following in a similar manner, we can remove the leading order remainder term from
, which is
, and subsequently all higher order terms, since the leading order term of
is of order
. Thus, we can write the term
as an infinite of Koopman eigenfunctions,
where,
for integer
. Defining
as
,
, the instantaneous attraction rate, can be written exclusively in terms of these Koopman eigenfunctions,
This simple example demonstrates that the infinitesimal FTLE, that is the iLE, is not a Koopman eigenfunction in general. However, there may be certain special case vector fields that have this property, which would imply a strong relationship between the geometric theory and the theory of evolution operators. We will consider these special vector fields in the following sections.
On the other hand, in a general scenario for a given vector field, if the corresponding eigenfunctions are dense in a space of functions that includes the iLEs, then clearly the iLE can be written as a superposition of Koopman eigenfunctions, such as described by the example above of (
41). Thus, the geometric theory can still be interpreted in terms of the spectral theory. In the intermediate scenario, homogeneous polynomials (see
Appendix B) offer an enticing class of problems with a general relationship. In some vector fields then, the iLE may be a finite sum of Koopman eigenfunctions.
6. General Two-Dimensional Vector Fields
Consider a general two-dimensional autonomous vector field of the form,
where the right-hand-side functions
u and
v are as smooth as necessary in their arguments. The gradient matrix is given by (
4) and the attraction and repulsion rates given by (
6) and (
7), respectively. We will focus on the repulsion rate,
, but similar arguments can be applied equally to the attraction rate.
We will proceed by seeking the conditions under which
is also a Koopman eigenfunction for some non-trivial eigenvalue
, which is,
To simplify the calculation, we consider only vector fields, such that,
which, in fluid terms, means the vector field has zero shear component of the strain rate [
6], in which case the repulsion rate,
, in (
7), simplifies to,
with partial derivatives,
and so the condition for the repulsion rate to be a KEIG, (
43), is the following condition on the vector field functions
u and
v,
where the
dependence of the vector field components is understood. Furthermore, under the assumption (
44), the attraction rate,
, also simplifies to,
with partial derivatives,
and so the condition for the attraction rate to be a KEIG is the following condition on the vector field functions
u and
v,
7. Polynomial Vector Fields
It is not immediately obvious if (
47) or (
50) admit any solutions. We seek to construct solutions, if they exist. To simplify this search, we will look initially at a special class of vector fields, polynomial vector fields.
Adopting the common notation of the polynomial vector field literature (see, e.g., [
32]), we let
and
be polynomials of degree
m. We consider a system of the form (
42) with an equilibrium point which we may place at the origin,
where
and
are both members of
, the homogeneous polynomials of degree
k (understood to be in the 2 variables
x and
y). The dimension of the vector space
is equal to the number of monomials of degree
k in
x and
y, and is,
. The number of terms in (
51) is, therefore,
We will denote the polynomials in terms of monomials,
where
and
are real scalar coefficients. For (
51), the coefficients form a space of dimension
. Based on the non-linear saddle flow example, we expect the vector fields which satisfy (
47) or (
50) will be some subspace of dimension
.
7.1. Quadratic Vector Fields
Consider (
51) with
,
Our assumption (
44) implies,
Therefore, the vector fields of interest are quadratic vector fields of the form,
which is a 7-dimensional subspace of the original 10-dimensional space of quadratic vector fields. Furthermore, for this vector field, we have,
and,
Since
has no second order terms, the left-hand-side of (
47) must have all coefficients of second order terms identically zero, i.e.,
This leads to three more algebraic conditions. Among them we choose,
which reduces the space of possible vector fields to 4-dimensional.
The constant and linear terms of (
47) provide the following algebraic conditions,
This leads to conditions on
and
,
which further reduces the space of vector fields to only a 2-dimensional subspace with free parameters
.
By construction, the repulsion rate is now a Koopman eigenfunction,
with eigenvalue
, where both
and
are free parameters. The quadratic vector fields which this Koopman eigenfunction corresponds to is
where
are free parameters. Notice that the linear part of the vector field is skew-symmetric and that the quadratic terms in
P and
Q are opposite sign.
We note that while the repulsion rate is a KEIG, there is no guarantee that the attraction rate will be.
7.2. Cubic Vector Fields
For polynomial vector fields of order
m, the
or
fields will be polynomials of order
, since they are based on gradients of the vector field. Thus, quadratic vector fields produced a linear
above. By the definition of an instantaneous Lyapunov exponent structure (iLES) [
6], we need a ridge of
for a repelling iLES or a trench of
for an attracting iLES. To have this, we need an
or
which is quadratic. Thus, we must consider polynomial vector fields of at least cubic order.
We perform the same procedure using the same assumption (
44), but now for the attraction rate,
, and for vector fields satisfying (
50) which are homogeneous polynomials in
x and
y through order
. We augment polynomial fields of the form (
51) by allowing constant terms,
and
, which leads to
terms. Out of the 20-dimensional space of planar cubic vector fields, we follow an approach analogous to the quadratic example above, and obtain,
where, assuming
,
where
are free parameters. Notice that the linear part of the vector field is skew-symmetric and that the quadratic and cubic terms in
P and
Q are opposite sign.
For this cubic vector field, the attraction rate function,
is a Koopman eigenfunction with eigenvalue,
Because the attraction rate field is quadratic, it can potentially have a ridge. We re-write the vector field in terms of
and
,
where
are free parameters. The attraction rate,
is a Koopman eigenfunction with eigenvalue
for vector field (
69).
7.3. Cubic Vector Field Example
As an explicit example of (
69), consider the following, where
,
The attraction rate for this vector field,
is a Koopman eigenfunction with eigenvalue
. We note that if we perform a linear transformation to new variables,
we obtain a vector field that does not have the same symmetries,
but nonetheless has the same attraction rate,
which is a Koopman eigenfunction of the new velocity field, with the same eigenvalue
.
7.4. Cubic Vector Field Transformation to Simplify
For general parameters, the same linear transformation
T leads to the vector field (
69) in the
variables as follows,
As the
equation is uncoupled from
s, it can be solved in closed form. For an initial condition
at time
, we have,
where
and
. Therefore, the
s ODE can be considered a time-dependent ODE in 1D.
Notice that is an invariant manifold, i.e., (and this is also the location of the attraction rate iLE ridge for ).
It turns out we can transform the non-linear ODE (
76) into a form where it can be solved analytically. We translate the vector field so the new origin is the single equilibrium point of (
76),
by defining,
where the vector field in
is,
Notice this transformed system depends on only 2 parameters,
. Furthermore, the vector field (
80) does not satisfy the simplifying assumption (
44) which held in the original variables. We note that the origin of (
80) is the only equilibrium point and is either a stable or unstable node, depending on whether
is negative or positive, respectively.
The system has an
field that is a KEIG,
, with eigenvalue
,
which has a trench at
for
, which is a necessary condition for being an attracting iLES [
6]. From (
80), we see that the set
, the
-axis, is also an invariant manifold. For
, the
-axis is the fastest direction along the stable (unstable) invariant manifold of the origin.
7.5. Properties of KEIGs of 2-Dimensional Cubic Vector Fields
We discuss some of the properties of KEIGs of cubic vector fields in two dimensions. The ODE (
80), though non-linear, is nonetheless in a form which admits Carleman linearization [
33].
Augment the system with a third non-linear variable,
. Then, we have a linear ODE,
where the
space can be interpreted as a three-dimensional Koopman observable vector space [
34]. The linear ODE in
admits an analytical solution,
which implies
.
Using
in (
81) as the observable function in (
13), we can explicitly find that,
so following individual trajectories, the
field at time
t is the same as the
field at the initial time 0 multiplied by a factor
as we expect from an observable that is also a KEIG; see (
14).
We show an example phase portrait for
in
Figure 4.
For these parameters, the -axis, , is an attracting iLES.
Note that
is not unique as a Koopman eigenfunction with eigenvalue
. We can verify that
is itself a KEIG with eigenvalue
, and due to the theorem of [
22], any power of
is also a KEIG, in particular,
is a KEIG with eigenvalue
, as is
for any constant
.
7.6. A Family of Polynomial Vector Fields with a KEIG Attraction Rate
Based on the form of (
80), we can construct a family of vector fields which all have the attraction rate as a KEIG,
where we include in
only additional powers of
, with additional parameters
,
, etc. The vector field (
85) has the attraction rate,
which is a KEIG with eigenvalue
. As before, the
-axis is (i) an attracting iLES for
and (ii) the fastest direction along the stable (unstable) invariant manifold of the origin for
(
).