Koopman analysis of isolated fronts and solitons
Jeremy Parker, Jacob Page

TL;DR
This paper develops Koopman decompositions for localized solutions of nonlinear PDEs like Burgers, KdV, and sine-Gordon, revealing multiple expansions and their implications for data-driven analysis methods like DMD.
Contribution
It derives analytical Koopman decompositions for solitons and fronts, highlighting the existence of multiple expansions and their impact on Koopman mode extraction.
Findings
Koopman decompositions for Burgers and KdV equations have upstream and downstream forms.
Full Koopman decomposition for KdV solitons using inverse scattering transform.
Multiple Koopman expansions affect the effectiveness of DMD in analyzing nonlinear structures.
Abstract
A Koopman decomposition of a complex system leads to a representation in which nonlinear dynamics appear to be linear. The existence of a linear framework with which to analyse nonlinear dynamical systems brings new strategies for prediction and control, while the approach is straight-forward to apply to large datasets owing to a connection with dynamic mode decomposition (DMD). However, it can be challenging to connect the output of DMD to a Koopman analysis since there are relatively few analytical results available, while the DMD algorithm itself is known to struggle in situations involving the propagation of a localised structure through the domain. Motivated by these issues, we derive a series of Koopman decompositions for localised, finite-amplitude solutions of classical nonlinear PDEs. We first demonstrate that nonlinear travelling wave solutions to both the Burgers and KdV…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Koopman analysis of isolated fronts and solitons
Jeremy P. Parker
Jacob Page
Department of Applied Mathematics and Theoretical Physics, Centre for Mathematical Sciences, University of Cambridge, Wilberforce Road, Cambridge CB3 0WA, UK
Abstract
A Koopman decomposition of a complex system leads to a representation in which nonlinear dynamics appear to be linear. The existence of a linear framework with which to analyse nonlinear dynamical systems brings new strategies for prediction and control, while the approach is straightforward to apply to large datasets owing to a connection with dynamic mode decomposition (DMD). However, it can be challenging to connect the output of DMD to a Koopman analysis since there are relatively few analytical results available, while the DMD algorithm itself is known to struggle in situations involving the propagation of a localised structure through the domain. Motivated by these issues, we derive a series of Koopman decompositions for localised, finite-amplitude solutions of classical nonlinear PDEs. We first demonstrate that nonlinear travelling wave solutions to both the Burgers and KdV equations have two Koopman decompositions; one of which converges upstream and another which converges the other downstream of the soliton or front. The crossover point in space-time where both expansions break down is typically at the centre of the isolated structure itself. We then use the inverse scattering transform to derive a full Koopman decomposition for (pure soliton) solutions to the KdV equation, identifying Koopman eigenvalues, eigenfunctions and modes. Our analysis indicates that there are many possible Koopman decompositions when the solution involves the interaction of multiple solitons. The correct expansion to use at any point in space (i.e. the one that converges) depends on the relative positions of all solitons, and remains valid until a soliton passes through the observation point. The existence of multiple expansions in space and time has a critical impact on the ability of DMD to extract Koopman eigenvalues and modes – which must be performed within a temporally and spatially localised window to correctly identify the separate expansions. In addition, we provide evidence that these features may be generic for isolated nonlinear structures by applying DMD to a moving breather solution of the sine-Gordon equation.
pacs:
I Introduction
The recent emergence and development of Koopman analysis for studying dynamical systems, starting with Mezić (2005), is a major step towards the often sought-after goal of being able to understand complex behaviour in nonlinear dynamical systems as a combination of much simpler behaviours. The Koopman operator (Koopman, 1931) is a linear operator acting on the space of observables for potentially nonlinear systems, allowing us to perform spectral decompositions in the usual way (Rowley et al., 2009; Mezić, 2013). The resulting Koopman decompositions (or expansions) of observables, and in particular the state of the system, cast the evolution as a sum of spatial Koopman modes with exponential temporal behaviour. This is possible via a projection of the observable of interest onto Koopman eigenfunctions, scalar functionals of the state of the system which have a ‘linear’ evolution despite the underlying nonlinear dynamics. In this perspective, the fixed Koopman modes assume a secondary importance despite their physical significance, and can be regarded as the coefficients in the expansion (Rowley et al., 2009; Mezić, 2013).
One particularly attractive feature of Koopman analysis is the apparent simplicity with which it can be applied in large-scale problems, such as fluid turbulence, owing to a connection with dynamic mode decomposition (DMD) (Schmid, 2010). DMD is a numerical technique that identifies a least-squares best-fit linear operator that maps between equispaced-in-time snapshots, and which can be used to represent a time series as a sum of spatial modes with exponential dependence on time. In a series of important contributions, various authors have identified strict requirements under which DMD is capable of performing a Koopman mode decomposition (Rowley et al., 2009; Tu et al., 2014; Williams et al., 2015; Brunton et al., 2016a; Rowley and Dawson, 2017).
The DMD algorithm is straightforward to apply to very complex systems since it requires only a sequence of snapshot pairs as input. In particular, it has seen many applications in fluid dynamics (Schmid et al., 2010; Jovanović et al., 2014; Kutz et al., 2016), though it is also increasingly being used in other areas, for example in neuroscience (Brunton et al., 2016b). However, it is often difficult to verify that the low-rank dynamics identified in DMD correspond to a Koopman decomposition due to a lack of analytical results beyond ODE model problems (e.g. Bagheri, 2013; Brunton et al., 2016a; Rowley and Dawson, 2017). Some of these ODE results have allowed extraction of Koopman modes in more complex nonlinear PDEs, e.g. the Stuart-Landau equation examined by Bagheri (2013) describes the transient collapse of unstable flow past a cylinder onto a limit cycle, and this connection allowed him to find the corresponding Koopman modes for the velocity field. Certain nonlinear PDEs can also be rendered linear under a transformation of the state variable which allows for identification of Koopman eigenvalues (e.g. Page and Kerswell, 2018; Kutz et al., 2018). Page and Kerswell (2018) exploited the linearising transform to derive a full Koopman decomposition for the velocity field in the Burgers equation. In this work we exploit a similar feature in the KdV equation to derive Koopman decompositions there.
Beyond DMD, a variety of alternative methods to extract Koopman decompositions have been proposed. For example, Sharma et al. (2016) have found a connection between Koopman modes and the ‘response modes’ of the resolvent operator. In statistically stationary flows, Arbabi and Mezić (2017) have demonstrated an approach motivated by signal processing to allow for extraction of Koopman modes and eigenfunctions. Other approaches involve altering the snapshots on which DMD is applied, by adding additional functionals (observables) of the state of the system (Williams et al., 2015) or by ‘stacking’ snapshots of the state equispaced-in-time along the trajectory to form a single large observable (Brunton et al., 2017).
However, despite this progress there are still open questions as to how Koopman and DMD should be applied to systems which transit between multiple simple invariant solutions (Brunton et al., 2016a; Page and Kerswell, 2018). In fact, Koopman analysis applied to a simple ODE with a pair of fixed points (Page and Kerswell, 2018) has shown that each simple invariant solution has an associated Koopman expansion. Each expansion is convergent up to a crossover point along the heteroclinic connection between the fixed points. This introduces a critical constraint on DMD, which to function as a proxy for Koopman must be performed on an observation window in which there is a single valid decomposition. In addition, it is known that the DMD algorithm struggles when applied to localised travelling waves (e.g. Kutz et al., 2016) both in providing a low rank approximation to the dynamics and in extrapolating beyond the observation window. Our analysis of the KdV equation suggests that these two behaviours may be related, as we show that localised nonlinear waves possess multiple Koopman decompositions, each of which converges in different regions of space-time. For DMD to extract the different expansions, observations must be restricted in both time and space to a region where a single expansion holds.
The remainder of this paper is structured as follows. In §II we introduce the Koopman operator and derive a pair of Koopman decompositions for a travelling-front solution of the Burgers equation. In §III we perform a similar analysis for a one-soliton solution of the KdV equation, before using the inverse scattering transform to derive Koopman eigenfunctions, eigenvalues and modes for general (non-dispersive) solutions to the KdV equation, establishing the need for potentially many different Koopman decompositions in a generic case. The consequences of these decompositions for DMD are examined in §IV, and an observable that can robustly determine Koopman eigenvalues and modes is defined. We then apply DMD to find Koopman decompositions of the sine-Gordon equation, where the analytical decomposition is unknown. Finally, concluding remarks are provided in §V.
II Koopman decompositions of nonlinear dynamics
In this paper we will consider nonlinear PDEs of the form
[TABLE]
for some , with time forward map .
The (one parameter family of) Koopman operator(s) acts on functionals, or ‘observables’, of the state by shifting them along a trajectory of (1),
[TABLE]
This perspective is useful due to the linearity of the Koopman operator. In particular, the eigenfunctions of are scalar observables with an exponential dependence on time,
[TABLE]
and therefore constitute a coordinate system for representing arbitrary observables in which the nonlinear evolution appears to be linear,
[TABLE]
where are Koopman modes for the observable .
Often the desire is to find a representation like (4) for the function describing the state itself, , so that for equation (1),
[TABLE]
In this notation, is viewed as a family of observables parameterised by .
The recent work by Page and Kerswell (2018) demonstrated that separate Koopman decompositions (5) can be constructed around simple invariant solutions of (1), and in general multiple decompositions will be required for a given trajectory as it wanders between unstable exact solutions. In this work our focus is on spatially localised dynamics, which typically require multiple Koopman decompositions in both time and space to represent the full nonlinear evolution.
II.1 Motivating example: a front in the Burgers equation
The Burgers equation was considered by Page and Kerswell (2018), who used the Cole-Hopf transformation to derive a Koopman decomposition for the state variable . In that study, only trajectories running down to the trivial solution were considered. Here, our focus is on travelling waves. The Burgers equation is defined by,
[TABLE]
and supports a variety of equilibria and travelling wave solutions (Benton and Platzman, 1972). We consider a right-propagating front with and ,
[TABLE]
where the propagation speed .
In the approach of Page and Kerswell (2018), Koopman eigenfunctions for the Burgers equation were obtained by exploiting the Cole-Hopf transformation and performing a Koopman mode decomposition (KMD) of the linearising variable. A KMD for the velocity field was then found by inverting this transformation. While such an approach should also be possible here, we instead derive the KMD(s) for the propagating front via a Laplace transform approach (Page and Kerswell, 2018). This approach is more appropriate here, as it identifies regions in the plane where a particular KMD is convergent.
In Page and Kerswell (2018) it was shown that the Koopman eigenvalues of the Burgers equation are all real. Therefore, we adopt the following ansatz for the velocity field:
[TABLE]
where is a Koopman mode density for the observable , which is parameterised by .
Equation (8) is a bilateral Laplace transform with time as the transform variable. The Koopman mode density can be obtained by inverting the transform by integration along a Bromwich contour in the complex- plane,
[TABLE]
For unilateral Laplace transforms, convergence is assured by selecting to lie to the right of the singularities of the integrand. For the bilateral transform, can be selected to the right or left of the singularities (the contour then closed to the left or right respectively) provided that the Koopman mode density vanishes below or above a critical value of respectively (Page and Kerswell, 2018). This results in two possible Koopman mode densities. In practice, one is associated with exponentially decaying Koopman eigenvalues, the other with exponential growth.
The inversion integrand (9) has simple poles at , . The inversion can therefore be accomplished by selecting either and closing to right or and closing to the left, a choice which yields a convergent KMD either upstream () or downstream () of the front. The solution procedure is almost identical for both cases, and we discuss only the upstream calculation in detail.
For the upstream expansion, , we close the contour in a large semicircle to the left. The contribution to the integral from the semicircular contour vanishes for , hence the corresponding Koopman mode density has support for and the upstream KMD is
[TABLE]
where
[TABLE]
where is the closed contour built from the Bromwich contour and the large semicircle. Evaluating the residues at the poles, we find
[TABLE]
using the identity for generalised functions . Inserting the upstream density in (10) yields the upstream KMD,
[TABLE]
valid for .
A similar approach with yields
[TABLE]
with the KMD for the velocity downstream
[TABLE]
valid for . Both the downstream expansion (15) and the upstream expansion (13), truncated at terms, are overlayed onto the true travelling front solution in figure 1. The loss of convergence in both expansions at is clear.
There is a simple dynamical systems interpretation to these results: Under the ansatz of travelling-wave dynamics, the Burgers equation reduces to a simple one-dimensional (nonlinear) ordinary differential equation and the front depicted in figure 1 is a heteroclinic connection between the (unstable) trivial solution at the origin and the (stable) equilibrium . The pair of Koopman decompositions found above thus corresponds to expansions about these two equilibria, which both breakdown at the same “crossover point” in state space (see also Page and Kerswell, 2018). These equilibria have one-dimensional linear subspaces, and the associated Koopman decompositions begin with eigenvalues corresponding to these unstable/stable linear dynamics, . The higher order terms in the expansion then correspond to integer powers of the associated Koopman eigenfunction.
III Koopman decomposition of Korteweg-de-Vries equation
The Korteweg-de-Vries (KdV) equation is the canonical and simplest example of a nonlinear dispersive wave equation. It is defined by
[TABLE]
The term makes this a dispersive wave equation, and is a nonlinear self-advection term. Equation (16) naturally arises as the inclusion of simple nonlinearity in a number of wave phenomena, including internal waves in a stratified fluid.
In an early example of the numerical solution of PDEs, Zabusky and Kruskal (1965) simulated the KdV equation and discovered the rich behaviour of so-called ‘solitons’. These exact coherent structures of the PDE are strongly stable. They can interact with one another and preserve their form post-interaction. The behaviour of solitons led to the development of the inverse scattering transform (IST), which can be used to analytically solve KdV as well as a number of other, more complicated, so-called ‘integrable’ equations.
III.1 Single-soliton solution
The canonical one-soliton solution to KdV is given by
[TABLE]
which is a simple travelling wave propagating to the right. Note that , which is the case for all soliton solutions of (16).
We will follow the methodology outlined for the front in the Burgers equation in §II.1 and assume that the Koopman eigenvalues required to described the evolution of (17) are real. This assumption will be justified §III.3, where we derive the Koopman eigenfunctions required to describe arbitrary soliton evolutions.
Expressing the evolution as an integral over a Koopman mode density (see §II.1), ,
[TABLE]
This Laplace transform (transform variable ) can be inverted in the normal way to give
[TABLE]
where . Similar to the Burgers equation example presented in §II.1, we can close the contour for this integral in two different directions, yielding a pair Koopman decompositions which hold upstream/downstream of the soliton.
Closing the contour to the left, we label the Koopman modes as , with for . Then (18) becomes
[TABLE]
Equation (19) has second order poles at , . The residue theorem gives, for ,
[TABLE]
Substituting this into (20), we find a decomposition
[TABLE]
This expansion involves Koopman eigenvalues , with corresponding Koopman modes . In this derivation, it is not possible to determine the Koopman eigenfunctions in their general form.
Equation (22) is a convergent expansion for , i.e. downstream of the peak of the soliton. Analogous behaviour was seen in the front solution to Burgers equation (e.g. (13)), which suggests that the need for multiple Koopman decompositions to describe nonlinear wave evolution is generic. The upstream expansion for the one soliton solution to KdV can be obtained by closing the contour to the right, which yields
[TABLE]
which could also be anticipated from symmetry. The upstream expansion is convergent for and involves Koopman eigenvalues – temporally decaying modes.
Similar to the Burgers equation, there is a simple dynamical systems interpretation to these results which rests on the fact that Koopman expansions appear to be defined about simple invariant solutions of the governing equation, and connecting orbits between such solutions contain a crossover point where one expansion fails and another takes over. The one soliton solutions to the KdV equation in a travelling frame, (here ), are homoclinic orbits about the trivial solution , and the crossover point divides these trajectories into ‘repelling’ and ‘attracting’ sections. The Koopman expansions for these sections of the orbit are built from eigenfunctions which are integer powers of the Koopman eigenfunctions associated with the linear subspace around and have eigenvalues (i.e. in the lab frame).
These effects have interesting consequences for describing more complex dynamics – soliton interactions – in terms of Koopman expansions. In order to generalise the approach above, we will use the inverse scattering transform (e.g. Drazin and Johnson, 1989) to derive Koopman eigenfunctions for the KdV equation in their general form, which will allow us to examine these more interesting situations.
III.2 Inverse scattering method
The inverse scattering method is one the most celebrated results of twentieth century mathematics. It can be used to solve a variety of nonlinear PDEs, including the nonlinear Schrödinger equation and the sine-Gordon equation (Ablowitz et al., 1974). In the inverse scattering approach, the solution to the nonlinear PDE, , is treated as a potential in a linear scattering problem in which time appears parametrically. It can be shown that the scattering data (the eigensolutions of the scattering problem) evolve linearly as evolves according to its nonlinear evolution equation. Therefore, the scattering data can be obtained for all time from the initial condition alone. The solution to the nonlinear PDE at any time can then be extracted from the scattering data via an inverse scattering transform, which amounts to the solution of a linear integral equation. The existence of a linearising transform allows us to derive Koopman eigenfunctions, which can then be used to construct Koopman decompositions for the state variable itself.
Here we concentrate on the specific case of KdV, for which the inverse scattering method was first developed (Gardner et al., 1967). Throughout, we follow the notation and conventions of Drazin and Johnson (1989). Let be some initial condition for the KdV equation on the real line, with as . The time evolution can then be obtained as follows:
Solve the eigenvalue Sturm-Liouville scattering problem . The eigenvalue spectrum has a discrete negative part for , and a continuous positive part . The eigenvalues and their corresponding eigenfunctions are called the ‘scattering data’. 2. 2.
It is then possible to predict how the scattering data will evolve as evolves from according to the KdV equation. In particular, it is sufficient to consider the ‘reflection coefficient’ for the continuous spectrum and for the discrete spectrum. These are defined by requiring that the eigenfunctions or as . The latter (discrete) case is normalised so that .
The scattering data evolve according to the linear equations
[TABLE]
as the potential evolves according to the KdV equation. 3. 3.
Given the scattering data at initial time, one can then calculate at some future time through ‘inverse scattering’, which amounts to solving the Marchenko equation,
[TABLE]
for , where
[TABLE]
In all but the simplest cases, this must be done numerically. The velocity is then obtained via .
III.3 Koopman eigenpairs of the KdV equation
With the inverse scattering transform in mind, we now define a family of observables , where is a positive real number, on the state space for the unbounded KdV equation. The value of , a real number, can be computed as follows: First, determine whether the ordinary differential equation has a non-trivial, square-integrable solution, with decaying exponentially as . If it does, the solution is made unique by requiring . In the limit , for some , which allows us to define . If there is no solution to the Sturm-Liouville problem, define .
Due to their linear evolution equations (24b), it is clear that the scattering data are Koopman eigenfunctions of the nonlinear KdV equation,
[TABLE]
i.e. , the Koopman eigenfunction with Koopman eigenvalue .
We note that the same approach can be used to construct a family of Koopman eigenfunctions with purely imaginary Koopman eigenvalues from the reflection coefficients associated with the continuous spectrum of the scattering problem. Because of difficulties solving the integral equation in cases where , we consider only ‘reflectionless potentials’ where .
Since the scattering data are sufficient to reconstruct the whole solution to the KdV equation, we therefore assume that these Koopman eigenpairs, and their products, as discussed below, are sufficient to find decompositions.
III.4 Single-soliton revisited
Before examining soliton interactions, we will first revisit the one soliton solution of the KdV equation considered in §III.1,
[TABLE]
and use knowledge of the Koopman eigenfunctions and the inverse scattering approach to construct the Koopman decompositions. From our family of Koopman eigenfunctions , only is non-zero in this case, with , and there is no continuous spectrum in the scattering problem. However, note that can be raised to any power to give a Koopman eigenfunction with Koopman eigenvalue (Mezić, 2013).
Initially, we introduce as an ansatz a Koopman decomposition using only positive integer powers of – i.e. one associated with exponential growth in time. We will see that this approach yields the upstream expansion (22) found via the Laplace transform approach in §III.1. Rather than seeking a decomposition for directly, we first decompose , the solution to the Marchenko equation described in §III.2. With our ansatz, we write
[TABLE]
where . Note the change in notation to reflect that is an observable of the state, , parameterised by and . The Marchenko equation (25) now reads
[TABLE]
Examining the dependence of the terms, it is apparent that for some . We can therefore perform the integration, to give
[TABLE]
Comparing coefficients of , we have
[TABLE]
Assuming that the Koopman modes associated with the exponentially decaying eigenfunctions not included in the ansatz () are zero, for , this recurrence may be solved directly to give
[TABLE]
The resulting Koopman decomposition for is then
[TABLE]
and a Koopman decomposition for can be obtained from , giving
[TABLE]
This is a Koopman decomposition, using Koopman eigenfunctions with Koopman eigenvalues , and Koopman modes .
Equation (31) matches that found in §III.1 using the inverse Laplace transform (22). To find the second Koopman expansion, valid downstream of the soliton, we would begin with the ansatz,
[TABLE]
i.e. an expansion in exponentially decaying Koopman eigenfunctions.
In summary, we have used the inverse scattering transform approach to identify Koopman eigenfunctions and eigenvalues of the KdV equation and shown how different sets of eigenfunctions are required in different regions of space-time to express localised nonlinear wave evolution in the form of a Koopman decomposition. We now extend this approach to examine more complex dynamics involving soliton interactions, where the number of possible Koopman decompositions increases dramatically. Selecting the appropriate decomposition for a given region of the plane depends on the relative positions of all solitons.
III.5 Multiple solitons
The method presented in §III.4 can be generalised to an arbitrary but finite number of solitons, so long as the initial condition has no continuous spectrum in the scattering problem. To demonstrate the approach, we examine in detail the interaction of two solitons.
With two solitons, we now have two non-zero scattering eigenvalues and , with corresponding Koopman eigenfunctions and and Koopman eigenvalues and . The eigenfunctions and can be raised to arbitrary powers to produce further Koopman eigenfunctions, but we can now also multiply them (Mezić, 2013). As was found in the one-soliton case, only even powers are required, since rather than appears in the Marchenko equation. The possible combinations of and thus yield a set of Koopman eigenfunctions of the form
[TABLE]
with corresponding Koopman eigenvalues . If and are both rational numbers then the Koopman eigenvalues will be degenerate, an effect that has also been observed in Koopman decompositions of the Burgers equation (Page and Kerswell, 2018).
With two scattering eigenvalues, the Marchenko equation (25) becomes
[TABLE]
The -dependence of the terms in (33) implies is of the form
[TABLE]
which reduces (33) to a pair of coupled equations:
[TABLE]
We propose Koopman decompositions for the observables and of the form
[TABLE]
As found in the single soliton case, the range of values over which we sum and , or equivalently whether the expansion is constructed using exponentially growing or decaying modes (or a combination), implicitly selects a region of space-time in which the expansion converges. The various choices are discussed in detail below. Substituting the ansatz (37) into (35) and comparing coefficients of exponentials (assuming no degeneracy) yields the recurrence relations
[TABLE]
With some rearrangement, these can be solved straightforwardly for and either increasing or decreasing, and various boundary conditions are therefore possible. The solutions are too complicated to include here, but can be found using a computer algebra system. As described previously in the one soliton calculation, the Koopman decomposition for the pair of observables can be converted into a Koopman decompositions for via equation (34), before the decomposition for the velocity is obtained from (Drazin and Johnson, 1989). We now discuss the solutions for various boundary conditions in the above recurrence relations.
First, we adopt the assumption that and are zero for and , or equivalently seek to build a solution using only temporally growing modes. In this instance, an expansion is obtained that is valid downstream of both solitons. The velocity field resulting from this solution for is reported in figure 2 (the red curves) for a particular choice of and which is discussed further below.
On the other hand, if both and are assumed to be zero for and , an expansion is obtained in terms of only temporally decaying modes. As shown in figure 2 (blue curves), this expansion converges upstream of both solitons. Both this time-decaying expansion and the temporally growing expansion discussed above are analogous to the expansions obtained for the single soliton (see §III.1 and §III.4). However, the inclusion of products of the Koopman eigenfunctions allows the ‘linear’ Koopman decompositions to represent the dynamics upstream and downstream of the solitons during their interaction. As shown in figure 2, these expansions apply both before and after the faster soliton overtakes the slower.
A more interesting ansatz is to assume and for but . This amounts to a decomposition involving growing modes associated with the eigenvalue (i.e. those that describe the evolution upstream of soliton 1) but decaying modes associated with the eigenvalue (describing the evolution downstream of soliton 2). An example of this expansion, which describes the evolution between the solitons up to (and including part of) their interaction, is shown in figure 2 (green curves). The products in the Koopman expansion of the form allow for a ‘linear’ representation of the strongly nonlinear dynamics between the solitons as they interact.
However, as the faster soliton approaches the slower, the region of space in which this decomposition holds shrinks and eventually vanishes. For a Koopman decomposition which holds between the solitons post-interaction, it is necessary to instead assume and for and , i.e. an ansatz using the unstable eigenvalues for the soliton and the stable eigenvalues associated with the soliton. This expansion is shown in pink in figure 2.
The particular two soliton interaction reported in figure 2 is the ‘classical’ two soliton solution (see e.g. Drazin and Johnson, 1989) defined by the initial condition,
[TABLE]
for which the KdV equation has the known analytical solution,
[TABLE]
This solution is particularly useful when assessing the crossover between the multiple Koopman decompositions owing to the fact that the initial condition (40) corresponds to the temporal “midpoint” in the interaction between the two solitons which separate as . In fact, precisely when , neither of the interior decompositions (the green and pink curves in figure 2) are valid, and they are nowhere pointwise convergent to a finite value (not shown). When is very small, a very large number of terms is required for the expansions to well approximate the true solution near the solitons.
Another consequence of using the solution defined by (41) is the occurrence of degeneracy in the Koopman eigenvalues. The scattering problem for this potential gives discrete eigenvalues of and . These values correspond to Koopman eigenvalues and and normalisation coefficients (Koopman eigenfunctions) and respectively (Drazin and Johnson, 1989). The fact that the two Koopman eigenvalues are both proportional to perfect cubes, coupled with allowance for both exponentially decaying and growing modes, causes the degeneracy. For example, the combinations (eigenfunction ) and (eigenfunction ) both share the eigenvalue . In the degenerate case, the recurrence relations presented above (38, 39) are now only one possible solution to the Marchenko equation. However, considering the nondegenerate situation with and as , which does not become invalid, implies that our solution is the correct one.
To summarise, we have demonstrated that four Koopman decompositions are required to describe the interaction of a pair of solitons in the KdV equation. Each expansion is convergent in a particular region of space-time, either: (i) upstream of both solitons, (ii) downstream of both solitons, (iii) between the solitons with the slower wave upstream of the faster or (iv) between the solitons with the faster wave upstream of the slower. There is a simple logic to selecting the eigenfunctions required for any given expansion: Alone, any individual soliton has a pair of Koopman decompostions; an expansion describing the solution upstream of the soliton requires exponentially growing eigenfunctions while temporally decaying eigenfunctions are needed downstream. In the two-soliton interaction, this continues to apply. However, products of the two sets of eigenfunctions must also be included to account for interaction between the solitons.
The approach outlined above naturally extends to arbitrary numbers of solitons, where construction of a Koopman decomposition at any point in space requires products of all the growing eigenfunctions for any solitons downstream of that point and all of the decaying eigenfunctions from the upstream solitons. For solitons, this would involve the solution of recurrence relations similar to (38, 39) simultaneously. The existence of multiple Koopman decompositions which partition the spatiotemporal domain to describe the full solution to a nonlinear PDE has important consequences for DMD, which we now examine.
IV Dynamic mode decomposition
Dynamic mode decomposition (DMD) can be an effective way to extract Koopman eigenvalues, modes and eigenfunctions from numerical data. A rigorous connection between Koopman decompositions and DMD has been established under certain conditions (Williams et al., 2015; Rowley and Dawson, 2017). The key requirements are (i) that the Koopman eigenfunctions can be expressed as a linear combination of the elements of the DMD observable vector, , and (ii) that sufficient data is available.
A variety of methods have been proposed to augment DMD and aid its ability to extract Koopman eigenfunctions from data. For example, in ‘extended’ DMD, the observable vector is built from a dictionary of functionals of the state. For the nonlinear PDEs considered in this paper, we will see that standard DMD (where the observable is simply the state variable itself, ), is sufficient to perform numerical Koopman decompositions, provided that the observations are restricted to a particular region of space-time where a single Koopman decomposition holds.
As a first example, consider the two-soliton KdV dynamics in figure 3. The parameters match those considered in §3. Two groups of DMD calculations are considered with a windowed observable
[TABLE]
where the elements of are observations of the state at the grid points, , and the choices for the window are identified in figure 3. The DMD methodology is as described in (Tu et al., 2014).
For each of the two observation windows , we perform many DMD calculations over short time intervals . The real parts of the eigenvalues obtained in these calculations are reported in figure 4, as a function of the final time of each individual DMD computation. For the window , while , the DMD identifies eigenvalues . This corresponds to the analytical prediction for the Koopman decomposition upstream of both solitons, where the set of Koopman eigenvalues required to correctly describe the time evolution is the product of the unstable eigenvalues associated with each individual soliton.
Near , complex-conjugate pairs of eigenvalues (shown in red in figure 4) emerge and DMD is unable to find a robust representation that remains consistent between subsequent calculations. This behaviour coincides with the observation window viewing regions of the solution which are expressed in terms of multiple Koopman decompositions; namely the top of the faster soliton is included in the observation window. In this case, DMD is unable to build a consistent linear representation for the dynamics.
When , the observation windows occupy a region of space-time between the two solitons, and the DMD algorithm is able to correctly identify the exponentially growing and decaying eigenvalues required in one of the central Koopman decompositions. As well as the exponentially growing terms associated with being upstream of the slower soliton, , the rapidly decaying eigenvalue is also obtained. This is the slowest-decaying eigenvalue associated with being downstream of the faster soliton. Note that the other visible decaying eigenvalue () in this region is associated with the product of the first unstable Koopman eigenfunction associated with the slower soliton and the first stable Koopman eigenfunction connected with the faster wave, (see §3). Other decaying eigenvalues are also anticipated based on interactions , though these terms are all much smaller in amplitude and are not picked up by the DMD. These results are quickly contaminated with pairs of complex-conjugate modes that are associated with the appearance of the second crossover point – the top of the slower soliton – in the observation window. Finally, towards the end of the later-time DMD calculations for window , DMD starts to recover the purely decaying Koopman eigenvalues associated with the expansion downstream of both solitons.
Similar behaviour is observed for observation window , which also shows evidence of three expansions. In this instance, the eigenvalues identified between the solitons are similar to those seen for window , but appear to be flipped about as the observation window is upstream of the faster solution and downstream of the slower wave. Therefore, while the upstream-of-both and downstream-of-both results are unchanged, the Koopman decomposition between the the two solitons involves the product of the unstable eigenvalues associated with the faster soliton and the stable eigenvalues of the slower pulse, i.e. the opposite of window .
These observations suggest that the use of a spatially-restricted observable is a sensible choice in nonlinear problems involving spatially-localised dynamics. This observable choice will allow individual Koopman eigenvalues and modes to be extracted by avoiding the inclusion of crossover points between multiple decompositions, for which DMD is unable to build a consistent linear operator. In order to demonstrate the utility of such an approach, we examine a solution of the sine-Gordon equation,
[TABLE]
which arises in a variety of physical situations, including the propagation of dislocations through a crystal and as a unitary theory for elementary particles (Scott et al., 1973). Though analytical solution of the sine-Gordon equation is possible via the inverse scattering method (Ablowitz et al., 1973), we do not attempt to analytically find Koopman decompositions. Instead, we will use the rules of thumb developed above for KdV to use DMD to identify Koopman eigenvalues.
As an example, we focus on the moving breather solution (Drazin and Johnson, 1989),
[TABLE]
where . This solution is shown in figure 6 for , and is a localised relative periodic orbit.
Based on our analysis of both the Burgers and KdV equations, we anticipate the existence of a pair of Koopman decompositions upstream/downstream of the breather in terms of exponentially decaying/growing eigenvalues respectively. In order to extract these representations, we conduct a pair of DMD computations with our observations restricted to windows upstream or downstream of the breather (marked in figure 6).
The output of these calculations is reported in figure 6. As anticipated, the calculations produce robust results both upstream and downstream of the oscillating pulse in terms of (temporal) exponential growth and decay. Note that, unlike the Burgers and KdV equations, the eigenvalues are complex. The upstream and downstream spectra are related via a reflection through .
Similarly to the one soliton solution of KdV, there is a natural interpretation of these results that is connected to the existence of crossover points along connecting orbits between simple invariant solutions in state space. In a co-moving coordinate, the moving breather may be interpreted as a homoclinic orbit about the trivial solution , and the DMD calculations identify the Koopman decompositions associated with the ‘repelling’ and ‘attracting’ halves of this trajectory.
IV.1 Periodic computational domains
All of the problems studied so far in this work have been classical analytical solutions of integrable nonlinear PDEs on infinite domains. However, studies of localised solutions to more complex systems (e.g. the Navier-Stokes equations (Schneider et al., 2010)) are conducted in large periodic computational domains. As pointed out by Sharma et al. (2016), Koopman decompositions for exact coherent structures in spatially-periodic problems naturally take the form of travelling waves and the (temporal) Koopman eigenvalues should all be purely imaginary. This should be contrasted with the Koopman decompositions presented in this paper, which have all involved Koopman eigenvalues with non-zero real part.
To examine the connection between the assertions of Sharma et al. (2016) and the analytical Koopman decompositions derived in this paper, we consider again the one-soliton solution to the KdV equation (see §III.1 and §III.4). Here, we supply the soliton as an initial condition in a numerical simulation where the KdV equation is solved numerically on a periodic domain of length . A Fourier transform is applied in ; the nonlinear terms are evaluated in physical space before the transform is applied. For time advancement, explicit Adams-Bashforth is used for the nonlinear terms and implicit Crank-Nicolson is used for the dispersive term. The domain is long enough such that the error between the periodic numerical simulation and the true one-soliton solution, , is about after flow-through times.
In figure 7 we report the results of two sets of DMD calculations on this one soliton KdV evolution. In the first, a single computation, we perform standard DMD on the full state vector (i.e. over the entire spatial domain) for a time window spanning many flow-through times. As anticipated, the DMD eigenvalues are all purely imaginary and are multiples of a fundamental harmonic (on this domain the flow-through time of the isolated soliton is ). The DMD modes (not shown) are Fourier modes.
In the second set of calculations, we adopt the approach we have advocated for the infinite domains. We perform DMD on a windowed observable , where , conducting a sequence of DMD calculations on short time windows . The real part of the eigenvalues obtained in each calculation are shown in the lower panel of figure 7. As the soliton repeatedly passes through the domain, the DMD calculations continually pick up the upstream/downstream eigenvalues associated with the solution on an unbounded domain (i.e. one of , ).
In this problem the “correct” decomposition is the one involving purely imaginary eigenvalues, regardless of domain length (as long as it remains finite). This can be demonstrated explicitly by considering the periodic ‘cnoidal’ solution of the KdV equation (Korteweg and de Vries, 1895),
[TABLE]
where is the Jacobi elliptic cosine function with modulus . Equation (45) is a right-moving travelling wave (phase speed ), and is spatially periodic with period , where is the complete elliptic integral of the first kind (Abramowitz and Stegun, 1965). As , (45) becomes the small-amplitude solution to the linearised KdV, a pure cosine. As however, the peaks become repeated copies of the one-soliton solution, very widely separated in : on any finite spatial interval at fixed , (45)(17) as .
The Fourier series for (45) can be calculated using the series for given by Oberhettinger (1973) and the identity , giving
[TABLE]
where is the complete elliptic integral of the second kind, and is the ‘nome’ (Abramowitz and Stegun, 1965).
Viewing (46) as a Koopman mode decomposition by writing the cosine in terms of exponentials, we identify Koopman eigenvalues for . These are purely imaginary (or zero), as anticipated from periodicity, and should be contrasted to the purely real Koopman eigenvalues found for the single soliton in isolation (17).
Despite the correspondence between the one-soliton solution to KdV and the limiting form of the periodic cnoidal wave, the isolated soliton Koopman decomposition is not obtained in the large-domain limit due to the fact that an infinite domain is required to obtain the scattering data that define the Koopman eigenfunctions. Furthermore, in contrast to Koopman decompositions constructed in §III for solitons on infinite domains, the Koopman modes and eigenvalues obtained in this periodic example are dependent on the domain length rather than being purely tied to the soliton itself. There are additional numerical issues too – the periodic Koopman decomposition can be difficult to obtain in the large-domain limit since very many Fourier modes are required to resolve the evolution (see Appendix).
The striking difference between the periodic Koopman decomposition and the decomposition for a truly localised structure is somewhat disconcerting, since simulations of localised structures are often conducted on large periodic domains under the assumption that the true isolated structure is well approximated. However, the windowed DMD results reported in figure 7 indicate that the Koopman decompositions for the localised structure can still be obtained in periodic computations by using a spatially localised observable. These results suggest that the two alternative strategies for DMD are both equally valid, depending on what the computation is designed to find: (i) the ‘standard’ approach using the full state vector which will identify purely imaginary, domain-dependent Koopman eigenvalues (if the structure is allowed to pass through the entire domain) and (ii) the windowed observable which can identify the growing/decaying Koopman eigenvalues associated with upstream/downstream expansions for a truly localised structure.
V Conclusions
In this paper, we have derived Koopman decompositions in a number of problems involving the propagation and interaction of isolated structures, namely a front in the Burgers equation and solitons in the KdV equation. The results indicate that isolated nonlinear waves require two Koopman decompositions to describe their evolution, which converge either upstream of downstream of the structure. In many-soliton interactions, multiple Koopman decompositions are required, and selecting the convergent expansion at any point requires knowledge of the relative positions of all solitons (i.e. whether they are upstream or downstream of the observation point).
We proposed a simple modification to the standard DMD methodology that allows allows the algorithm to identify the individual Koopman decompositions around the isolated structures. This approach was used to identify the various Koopman decompositions in a two-soliton interaction solution of KdV, before we applied it to the sine-Gordon equation where the analytical eigenvalues are at present unknown. The results suggest that the need for multiple Koopman decompositions to cover the full spatio-temporal domain may be a generic feature of nonlinear PDEs.
Further work is required to assess the extent to which these results extend to more complex systems, such as the full Navier-Stokes equations. As a starting point, the windowing approach could be applied to some of the known localised relative periodic solutions in pipe flow (Avila et al., 2013). In addition, our analysis of the KdV equation was restricted to pure soliton evolution – i.e. dispersive effects were absent. The inclusion of dispersion will introduce a continuous spectrum of purely imaginary Koopman eigenvalues. It would be of interest to know how the presence of these effects impacts the capability of DMD to identify the eigenvalues associated with the coherent structures, and whether some of the recent proposed modifications to the algorithm, such as augmenting the observable with other functionals, can help.
Appendix A Further details on the cnoidal wave
In this appendix we briefly discuss the behaviour of the Koopman decomposition for the cnoidal wave (equation 46) in the large-domain limit.
In the limit , the elliptic integral , so and
[TABLE]
Therefore the th Fourier coefficient from (46) obeys
[TABLE]
Since as , we expand with to give
[TABLE]
Since every Fourier coefficient approaches [math] as , but the cnoidal wave peaks tend to a fixed height of , an increasing number of Fourier modes (which are Koopman modes here) must be used to approximate the solution. This means that for very isolated solitons in a periodic domain, a large number of DMD modes will be required.
Acknowledgements.
The authors wish to thank C. P. Caulfield and R. R. Kerswell for much helpful advice. This work is supported by EPSRC Programme Grant EP/K034529/1 entitled ‘Mathematical Underpinnings of Stratified Turbulence’.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Mezić (2005) I. Mezić, Nonlinear Dynam. 41 , 309 (2005).
- 2Koopman (1931) B. O. Koopman, Proc. Nat. Acad. Sci. 17 , 315 (1931).
- 3Rowley et al. (2009) C. W. Rowley, I. Mezić, S. Bagheri, P. Schlatter, and D. S. Henningson, J. Fluid Mech. 641 , 115 (2009).
- 4Mezić (2013) I. Mezić, Ann. Rev. Fluid Mech. 45 , 357 (2013).
- 5Schmid (2010) P. J. Schmid, J. Fluid Mech. 656 , 5 (2010).
- 6Tu et al. (2014) J. H. Tu, C. W. Rowley, D. M. Luchtenburg, S. L. Brunton, and J. N. Kutz, J. Comput. Dynam. 1 , 391 (2014).
- 7Williams et al. (2015) M. O. Williams, I. G. Kevrekidis, and C. W. Rowley, J. Nonlinear Sci. 25 , 1307 (2015).
- 8Brunton et al. (2016 a) S. L. Brunton, B. W. Brunton, J. L. Proctor, and J. N. Kutz, P Lo S ONE 11 (2016 a).
