Geometric Exponential Integrators
Xuefeng Shen, Melvin Leok

TL;DR
This paper introduces geometric exponential integrators for semilinear Poisson systems that preserve structure or energy, offering improved long-term stability and computational efficiency over traditional methods.
Contribution
The paper constructs two new types of exponential integrators that preserve either Poisson structure or energy, enhancing stability and efficiency for Hamiltonian PDE discretizations.
Findings
Geometric exponential integrators outperform non-geometric ones in long-term stability.
They are more computationally efficient than symplectic and discrete gradient methods.
Numerical experiments confirm their effectiveness for semilinear Poisson systems.
Abstract
In this paper, we consider exponential integrators for semilinear Poisson systems. Two types of exponential integrators are constructed, one preserves the Poisson structure, and the other preserves energy. Numerical experiments for semilinear Possion systems obtained by semi-discretizing Hamiltonian PDEs are presented. These geometric exponential integrators exhibit better long time stability properties as compared to non-geometric integrators, and are computationally more efficient than traditional symplectic integrators and energy-preserving methods based on the discrete gradient method.
Click any figure to enlarge with its caption.
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11| 0 | 0 | 0 | 0 | ||
| 0 | 0 | 0 | |||
| 0 | 0 | ||||
| 0 | 0 | 0 | 0 | ||
| 0 | 0 | 0 | |||
| 0 | 0 | ||||
| midpoint | midpoint exp | discrete gradient | energy exp | ||
| fixed point | Newton | fixed point | fixed point | fixed point | |
| 11 | 0.02 | 0.1 | 0.1 | 0.02 | 0.1 |
| 21 | 0.01 | 0.1 | 0.08 | 0.01 | 0.1 |
| 41 | 0.1 | 0.06 | 0.1 | ||
| 61 | 0.1 | 0.04 | 0.1 | ||
| 81 | 0.1 | 0.04 | 0.1 | ||
| 121 | 0.1 | 0.04 | 0.1 | ||
| 161 | 0.1 | 0.01 | 0.1 | ||
| 201 | 0.1 | 0.1 | |||
| 401 | 0.1 | 0.1 | |||
| midpoint | midpoint exp | discrete gradient | energy exp | |
|---|---|---|---|---|
| 401 | 0.005 | |||
| 601 | 0.005 | |||
| 801 | 0.005 | |||
| 1001 | 0.005 | |||
| 1201 | 0.005 | |||
| 1401 | 0.005 |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNumerical methods for differential equations · Advanced Numerical Methods in Computational Mathematics · Computational Fluid Dynamics and Aerodynamics
Geometric Exponential Integrators
Xuefeng Shen
and
Melvin Leok
Abstract.
In this paper, we consider exponential integrators for semilinear Poisson systems. Two types of exponential integrators are constructed, one preserves the Poisson structure, and the other preserves energy. Numerical experiments for semilinear Possion systems obtained by semi-discretizing Hamiltonian PDEs are presented. These geometric exponential integrators exhibit better long time stability properties as compared to non-geometric integrators, and are computationally more efficient than traditional symplectic integrators and energy-preserving methods based on the discrete gradient method.
1. Introduction
Exponential integrators [4] are a class of numerical integrators for stiff systems whose vector field can be decomposed into a linear term and a nonlinear term,
[TABLE]
Usually, the coefficient matrix has a large spectral radius, and is responsible for the stiffness of the system of differential equations, while the nonlinear term is relatively smooth. There are various ways to construct an exponential integrator [7]. For example, we can perform a change of variables , and transform (1) to obtain
[TABLE]
Notice that the Jacobi matrix of (2) equals , which has a smaller spectral radius than the Jacobi matrix of (1). A natural idea is to apply a classical integrator for the mollified system (2) to obtain an approximation of , then invert the change of variables to obtain an approximation of the solution of (1). In Section 2, we shall demonstrate how to construct symplectic exponential integrators using this approach.
Another way of constructing exponential integrators starts from the variation-of-constants formula,
[TABLE]
which is the exact solution for (1) with initial condition . Then, a computable approximation can be obtained by approximating the term inside the integral. If we approximate by , we arrive at the exponential Euler method,
[TABLE]
An exponential Runge–Kutta method of collocation type [3] could also be constructed by approximating with polynomials. In Section 3, we shall show how to construct energy-preserving exponential integrators from (3).
In this paper, we consider a specific form of (1) which is a Poisson system. We assume , , where , and , thus the coefficient matrix is also skew-symmetric. Now, the semilinear system (1) can be written as,
[TABLE]
with Hamiltonian function . Equation (5) describes a constant Poisson system, and there are at least two quantities that are preserved by the flow: the Poisson structure and Hamiltonian . Geometric integrators that preserve the geometric structure and first integrals of the system typically exhibit superior qualitative properties when compared to non-geometric integrators, and they are an active area of research [2, 6, 5].
Here, we construct geometric exponential integrators that either preserve the Poisson structure or Hamiltonian of (5). They exhibit long time stability, allow for relatively larger timesteps for the stiff problem, and are computationally more efficient as they can be implemented using fixed point iterations as opposed to Newton type iterations. For the rest of the paper, Section 2 is devoted to developing symplectic exponential integrators that preserve the Poisson structure; Section 3 is devoted to developing energy preserving exponential integrators; numerical methods and experiments are presented in Section 4 and Section 5, respectively.
2. Symplectic Exponential Integrator
For constant Poisson systems (5), it was shown in [12] that the midpoint rule and diagonally implicit symplectic Runge–Kutta methods preserve the Poisson structure . We first start by constructing an exponential midpoint rule: apply the classical midpoint rule to the transformed system (2) to obtain
[TABLE]
where
[TABLE]
Transform (6) back to and , and we obtain the exponential midpoint rule,
[TABLE]
Theorem 1**.**
The exponential midpoint rule (7) preserves the Poisson structure when applied to the semilinear Poisson system (5).
Proof.
Recall that a map preserves Poisson structure iff
[TABLE]
Differentiating (7), we obtain,
[TABLE]
So the map has Jacobi matrix , where
[TABLE]
Then, we just need to verify (8), which is equivalent to ,
[TABLE]
In (9), we used the property that is symmetric, that is skew-symmetric which implies that , and the assumptions that and that and commute. ∎
The exponential midpoint rule is a second-order method, and we will now develop higher-order symplectic exponential integrators. Recall that a general diagonally implicit Symplectic Runge–Kutta method (DISRK) has a Butcher tableau of the following form,
It was shown in [12] that any DISRK method can be regarded as the composition of midpoint rules with timesteps . If we apply the DISRK method for the transformed system (2), and then convert back, we obtain the following diagonally implicit symplectic exponential (DISEX) integrator,
[TABLE]
where are the coefficients in Table 1. This integrator can be represented in terms of the following Butcher tableau,
The DISEX method preserves the Poisson structure, as demonstrated by the following theorem.
Theorem 2**.**
The DISEX method is equivalent to the composition of exponential midpoint rules with timesteps .
Proof.
The composition of exponential midpoint rules
[TABLE]
is represented as follows,
[TABLE]
Introduce in (M.1) as an intermediate variable. Then, on both sides of (M.1), multiply by , add , and divide by two, which yields an equivalent form of (M.1),
[TABLE]
For the Runge–Kutta method represented by the Butcher tableau in Table 1 to be consistent, the coefficients have to satisfy,
[TABLE]
So equation (S.2) coincides with the first line of the Butcher tableau of the DISEX method. Similarly, introduce . Then, on both sides of (M.2), multiply by , add , then divided by two, which yields an equivalent form of (M.2):
[TABLE]
So equation (S.2) coincides with the second line of the Butcher tableau of the DISEX method. Then, as before, we introduce , and apply the same technique to (M.i), which yields
[TABLE]
By induction,
[TABLE]
so
[TABLE]
which coincides with the -th row of the Butcher tableau of the DISEX method. Finally, we have
[TABLE]
which coincides with the last row of the Butcher tableau of the DISEX method. So the composition of exponential midpoint rules with timesteps is equivalent to the DISEX method of Table 2. ∎
3. Energy-preserving Exponential Integrator
Though classical symplectic methods exhibit superior long time stability, it was observed that symplectic schemes are less competitive for the numerical integration of stiff systems with high frequency. In sharp contrast, energy-preserving methods perform much better [9]. A general way to construct an energy-preserving method for a Poisson system is the discrete gradient method [8]. We design a discrete gradient that satisfies the following property,
[TABLE]
Then, the resulting discrete gradient method is given by,
[TABLE]
Multiplying on both sides of (12), we obtain
[TABLE]
The last equation of (13) holds simply due to the skew-symmetric property of matrix , which implies that discrete gradient method (12) preserves energy. We shall combine exponential integrators with the discrete gradient method to obtain an energy-preserving exponential integrator. This approach was initially proposed in [11] for separable Hamiltonian systems using the extended discrete gradient method, and we generalize this to semilinear Poisson systems. Replace the term in the exponential Euler method (4) by the discrete gradient , which yields
[TABLE]
Theorem 3**.**
Method (14) preserves the Hamiltonian .
Proof.
Let , , then , and we will show that the following properties hold:
- (1)
; 2. (2)
; 3. (3)
; 4. (4)
.
Property 1 follows from the fact that . Property 2 follows from
[TABLE]
Taking transposes on both sides of Property 2 and using the fact that and commute gives Property 3. Property 4 follow from
[TABLE]
Recall that the Hamiltonian of the constant Poisson system (5) is , so
[TABLE]
Applying the properties above yields the following,
[TABLE]
Substituting these into the expression for yields
[TABLE]
which proves that the Hamiltonian is preserved. ∎
One significant advantage of exponential integrators is they allow the numerical method to be implemented using fixed point iterations as opposed to the more computationally expensive Newton iterations. Recall that classical implicit Runge-Kutta methods
[TABLE]
have a form that naturally lends itself to fixed point iterations. However, when has a large spectral radius, the timestep is forced to be very small in order to guarantee that the fixed point iteration converges. The alternative is to use a Newton type iteration, which is time consuming since we need to perform LU decomposition ( complexity) during each iteration. This is the problem we face for the stiff semilinear system (1) when the coefficient matrix has a large spectral radius. In contrast, in both the exponential midpoint rule
[TABLE]
and the energy-preserving exponential integrator
[TABLE]
the matrix only appears in the exponential term . Since is skew-symmetric, this term is an orthogonal matrix, which has spectral radius 1. Thus, fixed point iterations can be used to implement the exponential integrator, regardless of the stiffness of .
4. Numerical Methods
We consider two Hamilton PDEs here, namely the nonlinear Schrödinger equation,
[TABLE]
in which is the wave function with real part and imaginary part , and has the following equivalent form,
[TABLE]
as well as the KdV equation,
[TABLE]
To discretize the two PDEs, we impose periodic boundary conditions. Given a smooth periodic function , on the interval , choose equispaced interpolation points , . Given nodal values , there exists a unique trigonometric polynomial with degree less or equal , such that, (see, for example, [1]).
[TABLE]
By substituting the expression for the coefficients , we obtain
[TABLE]
where
[TABLE]
From this, we see that and are equivalent orthogonal bases for the trigonometric polynomial function space, and each such function can be parametrized by either the nodal values or Fourier coefficients . They represent the same function, but with respect to two different bases. The transformation between and can be performed using the Fast Fourier transformation (FFT), which has complexity.
The first and second-order differentiation matrices [10] with respect to the representation in terms of nodal values are given by
[TABLE]
respectively. However, with respect to the representation in terms of Fourier coefficients , they are diagonal,
[TABLE]
Later, we will see that this observation is critical to a fast implementation of the product of matrix functions with vectors. We can also define a third-order differentiation matrix , which has the property , and it is diagonal with respect to the Fourier coefficients .
4.1. Nonlinear Schrödinger equation
We perform a semi-discretization of (18) by discretizing the solution , in space using their corresponding nodal values and . Applying the pseudospectral method, we obtain the following system of ODEs,
[TABLE]
where the nonlinear term is computed elementwise, and represents the vector consisting of entries. We adopt this notation throughout the rest of the paper for brevity. Then, (21) can be expressed as,
[TABLE]
where
[TABLE]
[TABLE]
and . It is easy to verify that is skew-symmetric, is symmetric, and . Thus, (22) is a semilinear Poisson system.
To apply the exponential midpoint rule, we need to compute the product of a matrix function and a vector, which has the form ,
[TABLE]
Theorem 4**.**
Suppose that , are the second and third-order differentiation matrices, respectively, is a vector with Fourier transform , and is an analytic function, then
[TABLE]
where is the inverse Fourier transform.
Proof.
Recall that matrix is diagonalizable with eigenvalues , and corresponding eigenvectors ,
[TABLE]
Notice is also diagonalizable with eigenvalues , and corresponding eigenvectors , so the property that can be verified in the same way. ∎
By Theorem 4, we have that
[TABLE]
In summary, the exponential midpoint rule for the nonlinear Schrödinger equation is given by
[TABLE]
where , , , and can be efficiently calculated using (23).
For the energy-preserving exponential integrator for the nonlinear Schrödinger equation,
[TABLE]
Here,
[TABLE]
and we can construct the discrete gradient
[TABLE]
where
[TABLE]
Notice that is symmetric with respect to and , and it can be verified that it satisfies (11). A classical discrete gradient method can be constructed as follows,
[TABLE]
where
[TABLE]
The method described by (26) is very similar to classical midpoint rule, the only difference is in , is used, while is used in the midpoint rule, so (26) can be viewed as a modified midpoint rule.
4.2. KdV equation
Rewrite (19) as
[TABLE]
then apply pseudospectral semi-discretization to obtain the following system,
[TABLE]
which has the form of a semilinear Poisson system (5),
[TABLE]
where , , , , . The exponential midpoint rule for KdV reads as follows,
[TABLE]
and the energy preserving exponential integrator is given by,
[TABLE]
with discrete gradient . A related classical discrete gradient method can be constructed as follows,
[TABLE]
By Theorem 4, in each iteration, the matrix function and vector product can be implemented as
[TABLE]
and
[TABLE]
5. Numerical Experiments
5.1. Nonlinear Schrödinger equation
In Table 3 below, denotes the number of nodes we discretize the spatial domain with, and the data in the table indicates the maximum timesteps for which the nonlinear solver converges. The first two columns correspond to midpoint rule, using fixed point iteration and Newton type iteration; the third column corresponds to the exponential midpoint rule, the fourth column is discrete gradient method (26), and the last column is the energy-preserving exponential integrator, all implemented using fixed point iterations.
We observe that when the midpoint rule is implemented using fixed point iterations, there is a significant decay in the allowable timestep as the spatial resolution is increased, whereas the Newton type iteration allows a relatively large timestep that is independent of the spatial resolution. In contrast, the midpoint exponential method exhibits a slower rate of decrease in allowable timestep when using fixed point iterations. When using fixed point iterations, the discrete gradient method, which is an energy preserving method, the allowable timestep behaves similarly to the midpoint rule, and in contrast, the energy preserving exponential integrator has an allowable timestep that is independent of the spatial resolution.
In Figure 1, we observe that the allowable timestep when using fixed point iteration scale like for the classical midpoint rule, and for the midpoint exponential rule.
As shown in Figure 2, the exponential midpoint rule exhibits an energy error that remains small and bounded, which is consistent with it being a symplectic integrator, and the trajectory error grows linearly.
The energy preserving exponential integrator is designed to preserve energy exactly, so even when the timestep is , we see in Figure 3 that the energy is still preserved approximately to within machine error.
We now consider the diagonally implicit symplectic exponential (DISEX) integrator with six stages:
[TABLE]
The energy and trajectory error is shown in Figure 4. Observe that the energy error is small and bounded, as expected of a symplectic integrator, and the trajectory error is small as well, as expected of a higher-order numerical integrator.
5.2. KdV
We simulate the KdV equation,
[TABLE]
where . As before, we explore how the maximum timestep for which the fixed point iteration converges depends on the choice of numerical integrator, and the spatial resolution of the semi-discretization. In Table 4, is the number of nodes we use to discretize the spatial domain, the data in the table indicates the maximum timestep for which fixed point iterations converge. For the midpoint rule, the timestep decreases like for fixed point iterations, and a comparable timestep is required for Newton iterations which is thereby too costly to implement. The classical discrete gradient method for the KdV equation is given by (27), and it exhibits the same timestep restrictions as the midpoint rule. In contrast, both the exponential midpoint and energy preserving exponential integrator allow rather large timesteps that are independent of the spatial resolution.
In Figure 5, we observe that the exponential midpoint rule has an energy error that is small and bounded, as is typical for a symplectic integrator, and the trajectory error grows linearly. In Figure 6, the energy preserving exponential integrator has an energy that is preserved to within machine precision, and the trajectory error grows linearly.
6. Summary
For semilinear Poisson system, we have developed two types of geometric exponential integrators, one that preserves the Poisson structure, and the other preserves the energy. They allow fixed point iteration methods to be used for significantly larger timesteps as compared to non-exponential integrators, such as the classical midpoint rule and the standard discrete gradient method, which require the use of Newton type iterations to converge with comparably large timesteps. This results in substantial computational savings, particularly when applied to the simulation of semi-discretized Hamiltonian PDEs. They also exhibit long time stability and conservation of the first integrals. We notice that in practice, energy preserving exponential integrators are more stable and allow for larger timesteps than symplectic exponential integrators. In future work, we will develop higher-order energy preserving exponential integrators.
Acknowledgements
This research has been supported in part by NSF under grants DMS-1010687, CMMI-1029445, DMS-1065972, CMMI-1334759, DMS-1411792, DMS-1345013.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Atkinson and Han [2009] K. Atkinson and W. Han. Theoretical numerical analysis , volume 39 of Texts in Applied Mathematics . Springer, Dordrecht, third edition, 2009. A functional analysis framework.
- 2Hairer et al. [2006] E. Hairer, C. Lubich, and G. Wanner. Geometric numerical integration , volume 31 of Springer Series in Computational Mathematics . Springer-Verlag, Berlin, second edition, 2006. Structure-preserving algorithms for ordinary differential equations.
- 3Hochbruck and Ostermann [2005] M. Hochbruck and A. Ostermann. Exponential Runge-Kutta methods for parabolic problems. Appl. Numer. Math. , 53(2-4):323–339, 2005.
- 4Hochbruck and Ostermann [2010] M. Hochbruck and A. Ostermann. Exponential integrators. Acta Numer. , 19:209–286, 2010.
- 5Leimkuhler and Reich [2004] B. Leimkuhler and S. Reich. Simulating Hamiltonian dynamics , volume 14 of Cambridge Monographs on Applied and Computational Mathematics . Cambridge University Press, Cambridge, 2004.
- 6Marsden and West [2001] J. E. Marsden and M. West. Discrete mechanics and variational integrators. Acta Numer. , 10:357–514, 2001.
- 7Minchev [2004] B. Minchev. Exponential integrators for semilinear problems . Ph D thesis, University of Bergen, 2004.
- 8Quispel and Turner [1996] G. R. W. Quispel and G. S. Turner. Discrete gradient methods for solving OD Es numerically while preserving a first integral. J. Phys. A , 29(13):L 341–L 349, 1996.
