The Monge-Ampere equation: various forms and numerical methods
V. Zheligovsky, O. Podvigina, U. Frisch

TL;DR
This paper introduces three new forms of the Monge-Ampere equation, emphasizing a Fourier integral form with proven positivity and bounds, leading to a novel numerical method for solving space-periodic problems with applications in cosmology.
Contribution
The paper develops a new Fourier integral form of the Monge-Ampere equation and a corresponding numerical method with proven properties, advancing computational approaches in this area.
Findings
Established positivity and bounds for the Fourier integral kernels.
Developed a convergent numerical method for space-periodic Monge-Ampere problems.
Demonstrated method effectiveness on a cosmological test problem.
Abstract
We present three novel forms of the Monge-Ampere equation, which is used, e.g., in image processing and in reconstruction of mass transportation in the primordial Universe. The central role in this paper is played by our Fourier integral form, for which we establish positivity and sharp bound properties of the kernels. This is the basis for the development of a new method for solving numerically the space-periodic Monge-Ampere problem in an odd-dimensional space. Convergence is illustrated for a test problem of cosmological type, in which a Gaussian distribution of matter is assumed in each localised object, and the right-hand side of the Monge-Ampere equation is a sum of such distributions.
| NE | 64 | 126 | 251 | 439 | 1 018 | 1 515 | 2 030 | 2 653 |
| DR | 3.38 | 4.69 | 11.17 | 42.7 | 81 | 203 | 435 | 774 |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
The Monge–Ampère equation: various forms and numerical solution
V. Zheligovsky
O. Podvigina
U. Frisch
International Institute of Earthquake Prediction Theory and Mathematical Geophysics,
84/32 Profsoyuznaya St, 117997 Moscow, Russian Federation
UNS, CNRS, Laboratoire Cassiopée, Observatoire de la Côte d’Azur
BP 4229, 06304 Nice Cedex 4, France
Abstract
We present three novel forms of the Monge–Ampère equation, which is used, e.g., in image processing and in reconstruction of mass transportation in the primordial Universe. The central role in this paper is played by our Fourier integral form, for which we establish positivity and sharp bound properties of the kernels. This is the basis for the development of a new method for solving numerically the space-periodic Monge–Ampère problem in an odd-dimensional space. Convergence is illustrated for a test problem of cosmological type, in which a Gaussian distribution of matter is assumed in each localised object, and the right-hand side of the Monge–Ampère equation is a sum of such distributions.
keywords:
Monge–Ampère equation, numerical solution, iterative methods
PACS:
02.60.Cb, 02.70.-c
1 Introduction
The Monge–Ampère equation (MAE)
[TABLE]
is encountered in many areas of numerical analysis and physics, ranging from image processing [1, 2, 3] to cosmology [4, 5, 6]. Here the subscripts denote derivatives in the respective spatial variables; is the Hessian of , i.e., the matrix comprised of second derivatives of . Existence and regularity of its solutions was considered in [7, 8, 9]. Various strategies were proposed for its numerical solution. A provably convergent method for solving the Dirichlet problem for the two-dimensional MAE in bounded convex domains was presented in [10]. It is directly linked to the geometric interpretation of the equation that had given an opportunity to demonstrate existence of weak solutions [13]. However, the actual numerical examples in [10] have just up to 25 grid points, which is clearly insufficient to establish the practical feasibility of the method.111More recently, a similar algorithm was used [11] to design a beam–shaping reflector; computations on a grid required about 15 minutes of a Pentium 4 processor. This problem of geometric optics can be recast as the Monge–Kantorovich mass transfer problem, reducing to a PDE of the MAE type, see [12]. The MAE can be recast as a minimisation problem; application of algorithms for saddle-point optimisation to a two-dimensional MAE was considered in [14, 15], and least-squares minimisation was advocated in [16]. Efficient methods for solution of the discrete optimal transportation problem were developed for application to cosmological problems [4, 5, 6]. It may be perceived that discrete methods correspond well to the physics of mass transportation in the Universe — after all, galaxies, as observed by astronomers, are clearly well-localised, discrete objects! This argument, however, becomes less persuading, when one recalls that visible matter constitutes only a very small fraction of different, “dark” kinds of matter, whose density distribution is supposed to be continuous (as opposed to a nearly discrete distribution in clusters of the visible matter).
In another group of methods the MAE is treated as a generic nonlinear partial differential equation. Application of Galerkin’s and finite element methods to a regularised MAE was considered in [17, 18]. A pseudospectral Newton’s algorithm was reported to perform well for a MAE in with a smooth r.h.s. [19]. However, when we implemented this algorithm for a three-dimensional MAE, we found that it failed to converge, unless the r.h.s. was a smooth slowly varying function. This is consistent with the observation [10] that Newton’s method, applied to equations equivalent to the MAE, is useful to improve an approximate solution only if the approximation is accurate enough, and easily fails otherwise. Two methods for numerical solution of a Dirichlet problem for an elliptic MAE in a two-dimensional convex region are examined in [20]. The first one employs a finite-difference discretisation of the equation; it is advocated for application to the MAE with a possibly singular solution. The second one is an iterative method for the MAE in the form of a fixed point problem
[TABLE]
(here denotes the inverse Laplacian); it is claimed to perform better, when the solution is regular (i.e., belongs to the Sobolev space ).
A so-called “inexact” iterative Newton–Krylov solver with preconditioning was applied for two- [21] and three-dimensional [22] grid generation with the properties of equidistribution and minimum distortion. The nature of the problem solved in [21, 22] required only a modest accuracy of solutions, discrepancies the order of being acceptable. Examples of computations of such moderately accurate solutions illustrating the scalability of the algorithm with respect to the employed spatial resolution were provided ibid.
In Sections 2-4 we derive three alternative forms of (1): the “second-order divergence” form, the Fourier integral form and the “convolution” form, which, to the best of our knowledge, were never presented in the literature before. The second form suggests two related methods for computation of space-periodic solutions to (1). The methods and results of their test applications are presented in Section 6; the Monge-Ampère problem of the cosmological type, which we use to test our algorithms, is presented in Section 5, after a short statement of the cosmological reconstruction problem. In the Concluding remarks we briefly discuss some open questions.
We note that the MAE’s of various kinds are considered in the literature. For the MAE arising in the mass transportation problem, typically the r.h.s. of (1) depends on the gradient of the unknown function (this form of the equation can be found in the original memoir by Ampère [24]). In the theory of PDE’s, usually one considers the MAE with a known r.h.s. (see [9, 23]). The MAE of this kind arises in the reconstruction of the early Universe (see discussion at the beginning of Section 5). Since this cosmological problem is the main original motivation for our work, we restrict our discussion to the case of the “mathematician’s” MAE. However, a straightforward reformulation of our algorithms makes them applicable for the case of the r.h.s. depending on the unknown function.
2 The “second-order divergence” form of the MAE
The divergence form of the MAE (1), in which the l.h.s. of the equation is represented as a sum of the first derivatives of certain quantities, is well known (see, e.g., [17]). In this section we derive a representation of the l.h.s. of the MAE as a sum of second derivatives, which we call the second-order divergence form of the MAE.
Consider a Fourier integral solution
[TABLE]
to the MAE in . Substituting the integral into (1) and using the identity for matrices
[TABLE]
where each of the indices takes the values and denotes the unit antisymmetric tensor of rank , we find
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
Here \left\|\mbox{\boldmath\omega\unboldmath}^{1},...,\mbox{\boldmath\omega\unboldmath}^{N}\right\| denotes a matrix comprised of columnar vectors \mbox{\boldmath\omega\unboldmath}^{1},...,\mbox{\boldmath\omega\unboldmath}^{N}. The first factor in the integrand of (3) is a quadratic function of , hinting that the l.h.s. of (1) can be transformed into a sum of second derivatives. Indeed, “reverse engineering” of (3) reveals an alternative, “second-order divergence” form of (1) in :
[TABLE]
Equivalence of (1) and (4) is now easily established directly: Using the standard rule for differentiation of the products in the l.h.s. of (4), we render it as a sum of products of derivatives of . Third-order derivatives enter such a product only in pairs of the form , and hence all products involving third-order derivatives cancel out due to antisymmetry of the tensors . Similarly, all terms involving fourth-order derivatives cancel out. Consequently, each term in the l.h.s. of (4) gives rise to a single term , and hence the sum is the determinant of the Hessian of , as required.
This form has an interesting consequence. Suppose, for the sake of simplicity, that a space-periodic solution is sought. Let be a smooth function with a finite support (in this context such are called test functions). Multiplying the MAE by and twice integrating by parts each term in the sum, we obtain by virtue of (4)
[TABLE]
As usual in the theory of partial differential equations, a weak solution to (1), , can be defined as a function satisfying the integral identity (5) for any test function . (Other definitions of weak solutions to the MAE are natural: generalised solutions obtained by geometric constructions [13] and the so-called viscosity solutions [9]; the two definitions are equivalent [23].) Commonly (e.g., see [17, 25]), only one integration by parts is performed in this integral identity. Our form is advantageous in that a lesser regularity of the weak solution is required for (5) to be well-defined. The following argument illustrates this for : For any from the Sobolev space the integrals in the l.h.s. of (5) are well-defined (because by the Sobolev embedding theorem this implies and hence ). By contrast, integrals in the similar identity obtained by just a single integration by parts are not well-defined for . (Note that a viscosity solution for fully nonlinear second-order equations is only required to be continuous [9].)
3 The Fourier integral form of the MAE; positivity and bounds of kernels
3.1 Derivation
In the Monge–Ampère–Kantorovich approach to the cosmological reconstruction problems [4, 5], the MAE arises for the potential of the inverse Lagrangian map, in which the function is a ratio between matter density at the current epoch and at the much earlier epoch of matter-radiation decoupling (at the earlier epoch, the distribution is very close to uniform); thus, .
Here, we consider a problem in which the spatial mean of is positive. Note that for odd , if , the change of the unknown function reverses the sign of and admits the desirable sign (here denotes space averaging:
[TABLE]
and is the volume of the ball of radius ). Suppose that and have the same spatial periodicity; integration of (4) over a periodicity cell then yields
[TABLE]
which is incompatible with . Thus we assume henceforth
[TABLE]
where has the periodicity of and a zero spatial mean (this being just a normalisation), and is a constant. Substitution of (7) into (1) and integration over a periodicity cell yields
[TABLE]
To derive this, note that , where is the Kronecker symbol, and hence the derivatives of in the l.h.s. of (1) are present only in and a linear combination of minors of smaller sizes of the Hessian of . By the algebraic transformation presented in the previous section each such minor can be converted into a sum of second derivatives of products of with its second derivatives. Thus the spatial mean of the l.h.s. of (1) over any periodicity cell, and hence the mean defined by (6), does not involve and is equal to .
In a more general formulation, we seek a solution (7) satisfying (8) and , assuming that and can be represented as Fourier integrals:
[TABLE]
[TABLE]
(If the problem, defined by (1), (7) and (8), is considered for space-periodic and , integrals in wave vectors in what follows are replaced by the respective Fourier sums.)
Eq. (2) is equivalent to
[TABLE]
[TABLE]
where denotes a unit vector in the direction of . Our immediate goal is to derive a similar expression for the terms in (1) of lower orders in . The term of order is
[TABLE]
(here the sum is over all subsets of cardinality )
[TABLE]
[TABLE]
[TABLE]
[TABLE]
where
[TABLE]
is the sum of squares of all minors of rank ,
[TABLE]
obtained by crossing out rows of numbers from the matrix
[TABLE]
comprised of columnar vectors .
Therefore, the problem (1) is reduced after the substitution (7) to the system of integral equations, which we call the Fourier integral form of the problem (1) and (7):
[TABLE]
[TABLE]
which is now stated in terms of the Fourier coefficients \widetilde{\eta}(\mbox{\boldmath\omega\unboldmath}) of the Laplacian of the unknown function . Equations (11) are valid for all \mbox{\boldmath\omega\unboldmath}\neq 0; the respective equation for \mbox{\boldmath\omega\unboldmath}=0 is (8).
If the r.h.s. of (1) is zero-mean (), the MAE admits the Fourier integral form (11) (where \widetilde{\eta}(\mbox{\boldmath\omega\unboldmath}) are now the Fourier coefficients of ), where the l.h.s. is reduced to a single term for in the sum .
3.2 Bounds for the kernels in the Fourier integral form
In this subsection we establish bounds
[TABLE]
provided all vectors have a unit norm. These bounds will play a crucial rôle for our numerical algorithm.
Addition to a column of any linear combination of columns for does not change the value of any minor . Using the Gram–Schmidt orthogonalisation process, we change all in to such that , for any , differs from by a linear combination of vectors for and thus remains unaltered, for any , is orthogonal to all for . Hence
[TABLE]
where is the angle between and the subspace spanned by . Consequently,
[TABLE]
We denote and the transpose of . The identity [26]
[TABLE]
(which does not require orthogonality of ) can be easily proved using the formula
[TABLE]
We enlarge the set by vectors for to a complete orthonormal basis in . Let be an orthogonal matrix comprised of the columnar vectors , and be the matrix, whose all entries are 0 except for for all . Then and hence
[TABLE]
where is the identity matrix of size . Consequently,
[TABLE]
This demonstrates that (12) are sharp bounds.
3.3 Solution of the MAE for a weakly fluctuating r.h.s.
If the fluctuating part of the r.h.s. in (1), , is small relative the mean , (11) suggests that \widetilde{\eta}(\mbox{\boldmath\omega\unboldmath})\approx\widetilde{f}(\mbox{\boldmath\omega\unboldmath}) and the nonlinear terms in (11) are small. Then the system can be solved by iteration:
[TABLE]
[TABLE]
Theorem
. Suppose positive constants and satisfy the inequality
[TABLE]
[TABLE]
and satisfies the inequality
[TABLE]
for . Then iterates (14) are globally bounded: (17) holds true for all .
. Under the same conditions, the following inequalities are satisfied for all :
[TABLE]
[TABLE]
where it is denoted
[TABLE]
Furthermore, if
[TABLE]
then iterations (14) converge to a solution to (11), which is unique in the ball (17).
The proof is elementary: Inequalities (17)–(19) stem from the bounds (12). By the contraction mapping principle, inequalities (18)–(20) imply convergence of iterations (14) in the norms of and in the space of Fourier coefficients, yielding a solution satisfying (17).
Evidently, equations (15) and (20), where equality is assumed instead of the inequalities, have positive solutions for any . (For instance, for .) If for the chosen values of and (15) holds true, and the inequality (16) is strict, then all conditions of the Theorem become satisfied for a slightly smaller value of .
Note that in view of (20) and hence (16) implies everywhere. Consequently, our Theorem is mostly of interest as a statement about convergence of iterations (14). Existence of weak solutions was proved by geometric methods in [13] for the MAE with an arbitrary positive r.h.s. in a compact convex domain. Although our Theorem is significantly weaker because of the strong restrictions on the r.h.s., we have proved it for a non-compact domain — the entire space.
4 The “convolution” form of the MAE
Following the same algebraic ideas, the MAE can be partially “integrated”. We again use the Fourier transform of :
[TABLE]
Let
[TABLE]
where
[TABLE]
[TABLE]
That these conditions can be enforced, is elementary for \mbox{\boldmath\omega\unboldmath}\neq 0; the case \mbox{\boldmath\omega\unboldmath}=0 is not problematic, because . Then
[TABLE]
is a real-valued function. (For a given it is not uniquely defined.)
Let us render the term of order in in the l.h.s. of (1) in the terms of employing the expression (9), (10), (13) and the “identity”
[TABLE]
(as usual understood in the sense of generalised functions):
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
In particular, the linear term () is .
Therefore, the problem (1) is equivalent, after the substitution (7) and (8), to
[TABLE]
We call this integral equation the “convolution” form of the MAE. Since it does not involve second-order derivatives, it may prove useful for development of an iterative algorithm for numerical solution of the problem defined by (1), (7) and (8), which involves suitable transformations of the spatial variable.
If the r.h.s. of (1) is zero-mean, the MAE also admits the convolution form (11), where , the l.h.s. is reduced to a single term for in the sum , and \widetilde{u}^{\prime}(\mbox{\boldmath\omega\unboldmath}) in the definition of \widetilde{\xi}(\mbox{\boldmath\omega\unboldmath}) denotes the Fourier transform of .
5 A test problem with a cosmological flavour
One important area of application of the MAE is the reconstruction of the dynamical history of the Universe from present observations of the spatial distribution of masses (galaxies, clusters, including their dark-matter components). Let us briefly recall the background. Peebles was the first to propose that, from the sole knowledge of the current positions of galaxies (from the Local Group which includes our own galaxy) without knowledge of their (proper) velocities, reconstruction of the full dynamical history is a meaningful goal [27]. Indeed, the very strong constraint on the distribution of masses at the epoch of decoupling — which has to be almost uniform — makes reconstruction a possibly well-posed two-point boundary problem that can then be solved by variational techniques. In fact, using convexity techniques, a theorem of uniqueness of reconstruction was proved in [5], using the Euler–Poisson equations, which describes the dynamics of matter on sufficiently large scales (of the order of a few million light years). In practice, reconstruction on such scales was done so far via the Monge–Ampère–Kantorovich (MAK) method [4] (see also [5, 6]) which assumes that the Lagrangian map from initial to current mass locations is the gradient of a convex potential. This holds exactly for the Zel’dovich approximation [28] (in which the equation for the velocity of matter reduces to the inviscid Burgers equation with a zero r.h.s., and hence the peculiar velocities remain constant along trajectories of point masses) and also for its refinement, the first-order Lagrangian perturbation approximation [29]. It is then easy, using mass conservation, to derive a MAE for the potential of the inverse Lagrangian map (the latter is the Legendre–Fenchel transform of the potential of the direct map). By a theorem of Brenier [30] the MAE becomes a Monge–Kantorovich mass transportation problem with quadratic cost which, after discretisation, can be solved by optimisation techniques (see [5] for details). The r.h.s. of the MAE is equal to the ratio of densities at the present and initial positions. Thus, if the initial density was not uniformly distributed, we would have to solve the MAE with the r.h.s. depending on the gradient of the unknown potential. However, at the epoch of decoupling (about 380 thousand years after the Big Bang) the density of matter was close to uniform, which implies a significant simplification of the MAE to be solved: its r.h.s. is known.
Here we explore for the first time the possibility of directly solving the three-dimensional MAE without discretisation on a toy model with a cosmological flavour.
We assume that the dimension of space is , and the r.h.s. of the MAE has the following structure:
[TABLE]
The function (22) describes mass distribution for “objects”, which are “localised”, if the value of the parameter is small compared to the distance between objects. In the cosmological context galaxies or clusters of galaxies can be regarded as such objects; then describes the total distribution of mass of both visible matter and dark matter, in which the galaxies are embedded. Although observations attest, that the distribution of visible matter in galaxies is clearly discontinuous, it is astrophysically sound to expect that the distribution of all types of matter is smooth due to the prevailing smoothness of the dark matter. We assume that objects have density distributions with a Gaussian shape:
[TABLE]
The -th object of mass is located at . All , and are independent of the small parameter .
We will be seeking a solution (7) with a space-periodic to the Monge–Ampère problem (1), where a space-periodic r.h.s. is the sum of “clones” of (22) over all periodicity cells. Without loss of generality we can assume that the total mass is normalised:
[TABLE]
It is instructive to consider particular solutions to this Monge–Ampère problem.
5.1 An exact solution to the MAE for a spherically symmetric mass distribution
In spherical coordinates centred at , (1) becomes, for spherically symmetric and ,
[TABLE]
where . This equation has an obvious solution
[TABLE]
whose first derivatives are uniformly bounded:
[TABLE]
the second derivatives are :
[TABLE]
This estimate follows from the following inequalities:
;
for , is uniformly bounded and
[TABLE]
for some positive constant and ;
for , is uniformly bounded and
[TABLE]
for some constant and .
Moreover, if is larger than a positive constant, , and hence all second derivatives of are uniformly bounded outside any sphere of a fixed radius.
The properties of the solution discussed in this subsection are implied just by a fast decay of at infinity and the spherical symmetry of the r.h.s.; the assumption that the profile is Gaussian is unnecessary.
5.2 A one-cell solution for spherically symmetric localised objects
A solution for objects can be expected to admit a power series expansion
[TABLE]
where (by analogy with (24)) each and its first derivatives are , and the second derivatives are .
Naively one could expect interaction of localised objects to be asymptotically unimportant, and hence to obtain in the leading order the sum of individual one-object solutions:
[TABLE]
Here is the one-object solution (24) for the -th object. Let us inspect, to what extent such a conjecture might be true.
Consider a neighbourhood of an object . In the leading order, the l.h.s. of (1) is . Substitution of (25) into the determinant yields a sum of triple products of second derivatives of various . As shown in the previous subsection, for each second derivative of is in this neighbourhood (the distance between the objects and is a fixed positive constant). Thus, only triple products of second derivatives of contribute terms of the leading order, , the one of the l.h.s. These products constitute and thus match the term in the r.h.s. Nonlinear interaction of pairs of solutions for individual objects is at a lower order, , and that of triplets of one-object solutions - still weaker, . Hence, after the finite sum (24) is substituted into the MAE, the highest order terms do cancel out, and in this respect the naive conjecture is confirmed.
Nevertheless, the one-cell solution (25) does not represent the leading order term of the solution to the problem at hand. To see this, note that at large distances (25) exhibits a linear growth in , and not a quadratic one, as the form of the solution (7) requires. Furthermore, after subtraction of the quadratic profile , the remaining part must be space-periodic, which is clearly not the case for (25). We cannot use (25) to construct a global solution conformant with this periodicity requirement by the procedure, used to obtain the periodic r.h.s. from the individual density profiles (22), because the sum of periodically distributed “clones” of one-cell solutions (25) is infinite. Moreover, for such hypothetical space-periodic sum there would be infinitely many pairwise interactions between objects yielding products of the order ; hence, even if the sum of such products is finite, it will not necessarily remain .
We observe that the pairwise interaction does not become weaker when the distance between the interacting objects grows. Thus, even in the high-contrast limit the solution that we are seeking does not reduce to individual interactions between objects; their interaction is essentially collective, which makes it hard to predict the structure of the solution.
6 Computation of a solution to the MAE with a space-periodic r.h.s.
In this section we present two iterative algorithms for numerical solution of the space-periodic Monge–Ampère problem. One version (AICDM), employing numerical improvement of convexity and discrepancy minimisation stabilising the iterative process, is suitable for computation of solutions for everywhere positive right-hand sides (see Subsection 6.4). Another one (ACPDM), involving continuation in parameter and discrepancy minimisation, does not require this condition to be satisfied (see Subsection 6.2). They both rely on the basic algorithm for iterative solution of a fixed point problem for the MAE (see Subsection 6.1). Test applications of the two algorithms are considered in Subsections 6.3 and 6.4 . We assume , however, reformulation of ACPDM for the case of a zero-mean space-periodic r.h.s. is straightforward.
6.1 A basic solver (FPAR)
If the amplitude of fluctuation of is small compared to the mean, — more precisely, if (16) is satisfied, — the Theorem (see Subsection 3.3) establishes existence of a solution to (1), that is a perturbation of . If, in addition, (20) holds true, the Theorem guarantees that iterations defined by (14) converge to the Laplacian of the perturbation; this offers an algorithm for numerical solution of the MAE. If either of the conditions (16) or (20) are violated (which is the practically interesting case), iterations (14) do not necessarily converge. Different algorithms are necessary, taking this into account.
Suppose the kernels in (11) are frozen and take constant values , respectively. Then the new system of equations (11) can be easily solved, since it is the Fourier form of the polynomial equation
[TABLE]
in the physical space. This observation suggests the following algorithm. We express (11) in the terms of as
[TABLE]
where
[TABLE]
and implement iterations
[TABLE]
in the physical space.
The applicability of this algorithm depends crucially on the choice of the coefficients . In view of the positivity and the bounds for the kernels (12), we impose
[TABLE]
Furthermore, it seems practical to set
[TABLE]
because for the linear in term is treated exactly,
[TABLE]
and the median values (28) of for minimise the ranges of the kernels
[TABLE]
in (29). Since for the coefficients (28)
[TABLE]
the l.h.s. of (27) “captures” the nonlinear behaviour of the l.h.s. of (11), the algorithm has chances to converge. However, for the extreme values of the values of the kernels in (29) are as large as the respective medians, and therefore convergence of iterations (27), (28) is not guaranteed.
At least two strategies can be proposed for setting the value of (which is a free parameter in the sense that (11) is not required to be satisfied for \mbox{\boldmath\omega\unboldmath}=0):
. At each iteration is tuned, so that (which holds true for ).
. We set .
Note that although in the subspace of space-periodic functions the inverse Laplacian is defined for zero-mean scalar fields only, is not required to vanish, because the mean is removed by differentiation in the Hessian before the inverse Laplacian is evaluated.
For any odd , the equation (27) in with the coefficients (28) has a unique root for any r.h.s. To check this, it is enough to establish that the derivative of the l.h.s. of (27) is positive for any . For the choice of coefficients (28),
[TABLE]
At a minimum and hence (30) implies that at the minimum , proving monotonicity of the l.h.s. of (27). It can be shown similarly, that for any even the number of roots is 0 or 2. Thus, the algorithm is guaranteed to be applicable for odd only.
It can be proved, that the Theorem also applies for iterations (27) (with the same constant bounding the same norm of solutions).
In an application to a test problem inspired by cosmology (see Subsection 6.3), this algorithm, which we call FPAR (Fixed Point Algorithm for the Regular part of the MAE) produces a sequence of iterations, initially converging, but subsequently blowing up: linear instability sets in, and hence the respective unstable mode must be removed.
6.2 A more advanced solver (ACPDM)
The behaviour of the basic algorithm FPAR suggests that it should be embedded as an engine within a more advanced algorithm. In this subsection we present such an advanced solver, ACPDM (Algorithm with Continuation in a Parameter and Discrepancy Minimisation).
Consider a generalisation of (26):
[TABLE]
where
[TABLE]
Here the coefficients (28) are assumed, and the new parameter is confined to the interval . For , (31) is just a set of polynomial equations of degree ; for it reduces to (26) which is equivalent to (1). Continuation in the parameter is implemented: (31) is solved for a set of values , increasing from 0 to 1, and an initial approximation of the solution for is obtained by polynomial extrapolation of solutions for all . (Numerical extrapolation requires performing quadruple precision computations, if the number of nodes exceeds roughly a dozen.) For any , solution of (31) involves iterations similar to (27):
[TABLE]
The r.m.s. discrepancy
[TABLE]
is used in the termination condition. Note that and hence
[TABLE]
for ; in particular, for , if and only if for and the normalisation (8) the field (7) is a solution to the MAE.
Let denote a scalar product and the induced norm of a scalar field: . In the test runs reported in the next subsection, the scalar product of the functional Lebesgue space has been assumed:
[TABLE]
Other products (with different weight functions introduced in the above integral) have been also considered (see Subsection 6.4).
If and are approximate solutions to the generalised MAE (31), then
[TABLE]
where is the linearisation of (31) around the solution. Consequently, the concept of minimisation of the residual in Krylov spaces and approaches for its realisation can be borrowed from solvers for linear problems (such as the Generalised Conjugate Gradients Method [31]). ACPDM involves sequences of stabilised iterations described below, which exploit this concept. To make such an iteration, the following data is required: an approximate solution , and two sets of scalar fields, and , , where (as well as some other quantities computed at the previous stabilised iteration), and is a parameter of the algorithm. It is supposed that all are mutually orthogonal with respect to the scalar product , and
[TABLE]
for small .
A sequence of stabilised iterations of ACPDM is initialised using the current approximation by computing as a solution to (32) for , and setting (i.e. the sets and are empty). For , a stabilised iteration of ACPDM consists of the following steps:
. At each grid point in the physical space solve equation (32):
[TABLE]
. Compute .
. Orthogonalise to all , , with respect to the scalar product , and set
[TABLE]
. Compute
[TABLE]
. If , increase by 1; otherwise (i.e., if ), discard and , and decrease by 1 the indices of the remaining fields and .
. Compute the r.h.s. of (32) for substituted in place of , the field and . If is less than a given small threshold, then is the desired approximate solution and computation for the present is finished. If , then the current sequence is terminated.
A few comments are in order. Clearly, and obtained in step , possess the required properties: is orthogonal to all for , and (35) holds for and by virtue of (34). The coefficients in the sum computed in step minimise the discrepancy , assuming all are small and hence their quadratic contributions are negligible. The minimisation plays a dual rôle: on the one hand, it stabilises basic iterations (32), removing the instability modes as soon as they become substantial; on the other, it significantly increases the efficiency of the algorithm (up to a factor 20 compared to other algorithms relying on iterations (32)). The assumption that nonlinear terms are small can be incorrect; also, as a result of accumulation of the neglected nonlinear terms after a number of steps, at some stage can cease to approximate accurately enough. If the inequality is found to hold true in step , we interpret this as an indication that the adverse effect of nonlinearity has become significant, and then the algorithm breaks the current sequence. In order to reduce the adverse influence of nonlinearity, a small number may be chosen; in our runs, .
Now we can assemble the algorithm from the building blocks, discussed above. ACPDM performs continuation in the parameter . For a given , it starts by carrying out basic iterations (32). As soon as convergence slows down (we have used the condition ), the algorithm switches to perform a sequence of stabilised iterations. If the sequence terminates in step because nonlinear effects became significant, the algorithm proceeds by performing basic iterations (32). Usually it takes a small number of them for the instability to set in, and as soon as ACPDM detects that the inequality holds true, it starts a new sequence. Here is a parameter, which can slightly exceed 1 (in order to allow the transients to die off and the dominant instability modes to set in, so that the latter could be efficiently removed in subsequent stabilised iterations); in our test runs we have used .
6.3 Application to a test problem inspired by cosmology
We have chosen to employ a problem of the kind discussed in Section 5 as a test-bed for our algorithm, because cosmological applications of the MAE are probably the most important ones. The positiveness of the r.h.s. (implying convexity of solutions [13]) is not required for application of the algorithm.
We are seeking a solution (7) with a space-periodic to the Monge–Ampère problem (1), where a space-periodic r.h.s. is a sum of “clones” of (22) over all periodicity cells. Our poor man’s Universe involves objects in the periodicity cell , centred at the origin: . They are described by the following parameter values in (23):
[TABLE]
[TABLE]
[TABLE]
Noting that achieves its maximum at and its minimum at , we can estimate the contrast number of the problem as
[TABLE]
(the factor 4 in the denominator accounts for the replicas of (23), located in the neighbour periodicity boxes at a distance ).
Iterations defined by (32) have been performed on a uniform grid comprised of points in the periodicity cell . We have evaluated by the pseudospectral method with dealiasing (for this requires computation of the derivatives in the physical space on the twice finer grid involving points). Apparently dealiasing does not play any important rôle in these computations; this is consistent with the fast decay of the energy spectrum of by 11 orders of magnitude.
We have tested both strategies for choosing (see Subsection 6.1), as well as a hybrid strategy, in which , but after solving (27) we reset . It turns out that the hybrid strategy and are very close in the number of iterations necessary to obtain a solution to the MAE to the same accuracy . However, this implies that the hybrid strategy is several times more efficient in the terms of CPU time, since it requires just one evaluation of solutions to (27), while evaluation of following strategy requires several such evaluations. The strategy has proved to be the most efficient one, both in the terms of CPU time and the number of required iterations. (The same nodes were used in all the test runs.) In the remaining part of the subsection we discuss convergence of the advanced method with .
ACPDM performs a combination of basic iterations (32) and stabilised iterations, which have different computational costs. The most time-consuming operation, determining the cost, is computation of the determinant of the Hessian in . There are two such operations in a stabilised iteration, and a single one in a basic iteration. Consequently, the former is approximately twice longer than the latter. To enable an accurate comparison of performance of various versions of our code, we report the number of evaluations of determinant in each run (a run is terminated when the obtained approximate solution satisfies the accuracy requirement ). Note however, that the main bulk of computations is performed by doing stabilised iterations; the number of basic iterations is usually below 1% of the number of stabilised ones.
In all runs, the initial iteration is a solution to (31) for . If ACPDM is applied to this field for , iterations quickly become chaotic and cease to converge (this has necessitated to include into the algorithm continuation in the parameter ). Initially, ACPDM has been applied for uniformly distributed nodes , for , for which the algorithm has shown a remarkably fast convergence (see Fig. 1). A polynomial 20-node extrapolation yields an approximate solution to our test problem to the accuracy and , where
[TABLE]
When it is used as an initial approximation for a run for , convergence is slow and the pattern of convergence is erratic. It takes 38 685 evaluations of the determinant of the Hessian for the two discrepancy norms to decrease to and , respectively. At this stage convergence stalls. We have therefore got into a local minimum of , out of which no exit can be found; we will refer to it as a spurious minimum solution.
A better approximation to the solution (7) to our test problem is obtained by adding more nodes near the right endpoint . We have chosen to add nodes, the complete -mesh being
[TABLE]
(information on convergence at the new nodes is also included in Fig. 1). Initial approximations at each new become more and more accurate in the interval (), then the discrepancy of the initial approximations starts growing and admits the maximum for (), and subsequently decreases again. The rate of convergence progressively falls down as approaches 1: the number of evaluations of the determinant of the Hessian yielding solutions of the desired accuracy , markedly increases. However, ACPDM does not stall any more. A polynomial extrapolation involving the 33 nodes delivers an approximate solution for to the accuracy and , and after further 1 885 evaluations of the determinant ACPDM yields an approximate solution with the two discrepancy norms down to and , respectively. In total, 9 814 evaluations of the determinant of the Hessian are involved in computations on the mesh (37) providing the solution to the MAE.
The geometry of the obtained solution — isosurfaces of and — is shown in Figs. 2 and 3, respectively. The structures disclosed by the isosurfaces of (Fig. 3) are clearly associated with the three objects incorporated into the r.h.s. (22) of the test problem. The figures also reveal a subtle interaction of the objects along the lines connecting their centres (see in Fig. 3 the tube-like structures, which connect the regions of higher values of encompassing the centres of objects).
Figures 4 and 5 display the structure of the field , determining the displacement of mass in the test Universe. It turns out that possesses hidden symmetries, namely, mirror reflection symmetries about any plane that is parallel to a coordinate plane and contains a pair of objects. (Deliberately, our computations are not sped up by exploiting these symmetries.) Because of the symmetries, the component of normal to such a plane vanishes on this plane. To illustrate the behaviour of the components of the gradient not shown in Fig. 4, we present in Fig. 5 their isolines on coordinate planes, which pass through the centre of the periodicity cube and hence are displaced from the planes shown in Fig. 4 by a quarter of period.
6.4 A solver for MAE with an everywhere positive r.h.s. (AICDM)
Clearly, it is desirable to avoid the refinement of solutions for nodes , which has proved necessary in application of ACPDM to our test problem. Comparison of the spurious minimum solution, obtained with the 20 nodes , and the more accurate one is instructive. The maximum discrepancy between the two approximations of for these solutions, equal to 0.132, is attained at the minimum of the r.h.s., , and all points, where the discrepancy is larger than 0.02 are located within the distance 1/16 from this point. The Hessian of (7) computed for the spurious minimum solution is negative at this point, i.e. this solution (7) is not a convex function, as it has to be [13]. This has suggested to develop a modification of ACPDM, presented here, which we call AICDM (Algorithm with Improvement of Convexity and Discrepancy Minimisation).
The algorithm proceeds as an extension of the ACPDM operating with a single node ; computation of a good initial approximation by extrapolation in is unnecessary. AICDM involves an additional procedure: improvement of convexity of an approximate solution, which is performed once the condition is satisfied. Here is the number of the current iteration, is the number of the iteration, at which the last previous improvement of convexity was performed, and is a constant factor (we have chosen in the test computation reported in this subsection).
Improvement of convexity in AICDM could be performed by computation of a convex hull of the iterate, but we prefer to apply a numerically simpler procedure. At each grid point in the physical space, we compute the eigenvalues of the Hessian of (they are all real, since the Hessian is a symmetric matrix). If they are all larger than , then the approximate solution given by (7) for the current iterate is locally convex at the point under consideration (in this discussion we assume that, after normalisation, ). Accordingly, if the minimum eigenvalue exceeds , no action is taken. Suppose now the contrary, i.e. . The minimum eigenvalue would become , if at this point each second derivative is increased by , and hence the Laplacian is increased by . Following this observation, at the points where we increase by (by choosing the factor 6 instead of 3 we are “overimproving” ). It is not guaranteed, of course, that is convex for the resultant , since this procedure changes all mixed derivatives at each point and does not guarantee that each second derivative at the points of local non-convexity is increased by the same amount, or that non-convexity does not appear at new grid points. Hence we proceed, repeating the procedure till each eigenvalue at each grid point becomes larger than . In our experience, only a small number of such iterations is necessary to enforce this condition. The quantities are small, being at most comparable with the global discrepancy ; although the discrepancy for the “improved” approximation can exceed the discrepancy for the original approximation , it thus turns out that the increase (compared to ) is usually modest.
An approximate solution to the test problem (formulated in Subsection 6.3), satisfying and , has been obtained by the AICDM. This has required 2 653 evaluations of the determinant of the Hessian. Table 1 illustrates the deterioration of convergence in this run, as better accuracy numerical solutions are successively found. Note that computational cost of each iteration in improvement of convexity of an approximate solution slightly exceeds that of computation of the determinant of the Hessian, and each iteration is included into evaluation counts (one evaluation per a convexity improving iteration) presented in Tables 1 and 2.
In this run, as in runs reported in Subsection 6.3, the Lebesgue space scalar product (33) has been assumed. We have also inspected convergence of AICDM employing scalar products
[TABLE]
with weight functions
[TABLE]
(see Table 2). For , more prominence is given to discrepancy in the regions, where the r.h.s. of the MAE, , admits relatively high values; for , the opposite happens, i.e. discrepancy in the regions, where the values of are relatively low, is given more weight. Duration of the shortest run, for , with a sequential code on a 3.16 GHz Intel Core Duo processor is 25 min. 19 sec. The computations do not reveal any clear dependence of the efficiency of AICDM on the power — in a large interval of the variation of the number of iterations is just several per cent. The low sensitivity to the value of is probably linked to the relative smallness of the region where .
6.5 An enhanced version of AICDM
The efficiency of AICDM can be further improved without employing new mathematical ideas. For instance, we have explored the possibility of gradual refinement of approximate solutions with increasing spatial resolution. The test problem, considered in the two previous subsections, was solved with the resolution of Fourier harmonics, where the integer is successively increased from 1 to 4. When seeking a solution with the resolution harmonics, which satisfies the accuracy requirement , the intermediate-stage computations with the resolution of harmonics are terminated as soon as AICDM finds a solution to the accuracy
[TABLE]
We call this algorithm enhanced AICDM, or EAICDM. Durations of runs for integer are shown in Table 2 (we do not present total numbers of evaluations of the determinant of the Hessian in runs by EAICDM, since the times of their computations vary significantly with the resolution).
A further acceleration is likely to be achieved by avoiding dealiasing, but we did not explore this possibility.
7 Concluding remarks
We have presented new forms of the Monge–Ampère equation in : the second-order divergence (4), Fourier integral (11) and convolution (21) forms. They have been derived under the assumption that the MAE (1) has a r.h.s. with a non-vanishing spatial mean, and hence (1) admits solutions (7). The first form gives an opportunity to relax the regularity requirements for weak solutions to the MAE, such that the integral in the l.h.s. of the identity (5) is well-defined. The third form is an integro-differential equation of the first order, which might be useful for development of an algorithm for computation of a solution (7) using transformations of spatial variables. This paper is mostly concerned with the Fourier integral form of the MAE used to prove existence of a small-amplitude solution of the form (7) for a weakly varying r.h.s. in (1) and to formulate an algorithm for computation of a solution (7) to (1) in an odd-dimensional space. In a test application to a three-dimensional MAE with the r.h.s. reminiscent of mass transportation problems considered in cosmology, we have demonstrated that a solution to the MAE with a smooth positive r.h.s. can be efficiently obtained by two versions of this algorithm, ACPDM (the algorithm with continuation in a parameter and discrepancy minimisation) and AICDM (the algorithm with improvement of convexity and discrepancy minimisation). While the latter is suitable for computation of a convex solution for an everywhere positive r.h.s. , the former requires only . However, modification of ACPDM for the case of a zero-mean space-periodic r.h.s. is straightforward.
There are some analogies between our method and the inexact Newton–Krylov solver with preconditioning, used in [21]. In our algorithms, solving (27) or (32), where the easily invertible polynomial part of the MAE is separated out, can be regarded as preconditioning; we believe that it is optimal. Indeed, its design is based on the algebraic nature of the MAE and primarily on the positivity and bounds of the kernels in the Fourier integral form, a very special — and so far not reported — property of the MAE. Furthermore, our algorithms are of the Krylov type. However, we do not rely on Newton iterations: instead of solving a succession of Newton problems, each with a complexity comparable to that of the MAE, we tackle the MAE directly.
In this paper, space periodicity and Fourier decompositions play an important rôle in two respects: First, we rely on the Fourier methods to find the optimal coefficients (28) in the equations (27) or (32). Note that space periodicity is not required for the derivations — we consider Fourier integrals, and not Fourier sums, and the algorithms do not require computation of these integrals. Second, our algorithms are realised in the spectral form, because we seek space-periodic solutions. In a periodicity domain the required computations of the inverse Laplacian, as well as numerical differentiation become trivial, when spectral methods are applied. Recall that Fourier methods have also the advantage of being more accurate: when the resolution is increased, Fourier series converge to a solution together with all the derivatives that the solution possesses, whilst finite differences do not approximate derivatives beyond their fixed order. We would also use the spectral approach, for instance, to solve numerically Dirichlet or Neumann boundary value problems for (see (7)) in a rectangular box.
However, the geometry of the domain, where the solution is sought, may prohibit the use of spectral methods. What happens when the MAE must be solved for more complicated boundary conditions in regions whose geometry is not rectangular (parallelepiped-shaped)? Our algorithms do not inherently rely on spectral methods and will remain applicable. Since we are solving the MAE in terms of the Laplacian of the unknown function, we would have to invert the Laplacian with suitable regular boundary conditions. Finite differences can be applied in conjunction with our method to carry out this task and for computation of derivatives involved in the function appearing in the r.h.s. of (32) and (32). Key equations for our algorithms, (27) and (32), are formulated in the physical space and can be used in conjunction with our method for a variety of boundary conditions. Their convergence properties remain of course to be investigated — for instance, whether the theoretically predicted values (28) will still be the optimal choice for the coefficients of the polynomial in the l.h.s. of (32).
An attractive feature of our algorithm is its simplicity: our Fortran-95 source code realising EAICDM is below 18 KB (672 lines long, not including the source for the Fast Fourier Transform).
Hereafter we list some open questions. Under which conditions does the generalised MAE
[TABLE]
with the coefficients (28), which is solved for a set of by ACPDM, possess zero-mean space-periodic solutions for all ? Does its discretisation always have a solution, as long as the generalised MAE itself does? Does the solution of (39) depend analytically on the parameter , and hence polynomial extrapolation for , that we employ, is mathematically sensible, or should another asymptotics near be assumed? What is the optimal choice of the sequence of values of to be used by ACPDM? Which scalar product is optimal for acceleration of convergence of stabilised iterations? Can Chebyshev techniques [32] be used to improve efficiency of the iterative processes?
Additional questions emerging outside the main topic of this paper — numerical methods for solution of the MAE — also cannot be avoided, since any information concerning the structure of solutions to Monge–Ampère problems of the cosmological type with a high-contrast r.h.s., formulated in Section 5, can be incorporated into specialised solvers in order to improve their performance (like it has proved possible to accelerate computations about 4 times just by taking into account in AICDM convexity of solutions to the MAE with a positive r.h.s.). The questions are: What is the asymptotics of solutions in the small parameter determining the width of the localised objects? Figures 4 and 5 show that the space is divided into regions of dominant influence of each object. Also, notable are almost axisymmetric structures in the Laplacian of the solution around the lines connecting centres of objects, seen on Figure 3. Can these geometric features be identified by performing the asymptotic analysis of the problem? How does the contrast number measure numerical complexity of the MAE and, in particular, the condition number of the linearisation near the solution (for a given spatial discretisation)?
Acknowledgments. We are grateful to S. Colombi and A. Sobolevskii for discussions. Computations have been carried out on the computer “Mésocentre SIGAMM (Simulations Interactives et Visualisation en Géophysique, Astronomie, Mathématique et Mécanique)” hosted by Observatoire de la Côte d’Azur, France. Research visits of VZ and OP to the Observatoire de la Côte d’Azur in the autumns of 2007 and 2008 were supported by the French Ministry of Education. The authors were partially financed by the grant ANR-07-BLAN-0235 OTARIE from Agence nationale de la recherche (France). VZ and OP were also partially supported by the grant 07-01-92217-CNRSL_a from the Russian foundation for basic research.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] S. Haker, A. Tannenbaum, R. Kikinis. Mass preserving mappings and image registration. Proc. of the 4th International Conference on Medical Image Computing and Computer-Assisted Intervention. Lect. Notes in Comput. Sci., vol. 2208. Springer-Verlag, London (2001) 120–127.
- 2[2] S. Haker, L. Zhu, A. Tannenbaum, S. Angement. Optimal mass transport for registration and warping. Int. J. Comput. Vision, 60 (2004) 225-240.
- 3[3] T. Hurtut, Y. Gousseau, F. Schmitt. Adaptive image retrieval based on the spatial organization of colors. Computer vision and image understanding, 112 (2008) 101–113.
- 4[4] U. Frisch, S. Matarrese, R. Mohayaee, A. Sobolevski. A reconstruction of the initial conditions of the Universe by optimal mass transportation. Nature, 417 (2002) 260–262 (ar Xiv:astro-ph/0109483).
- 5[5] Y. Brenier, U. Frisch, M. Hénon, G. Loeper, S. Matarrese, R. Mohayaee, A. Sobolevskii. Reconstruction of the early Universe as a convex optimization problem. Mon. Not. R. Astron. Soc., 346 (2003) 501–524 (ar Xiv:astro-ph/0304214).
- 6[6] R. Mohayaee, A. Sobolevskii, The Monge–Ampère–Kantorovich approach to reconstruction in cosmology. Physica D, 237 (2008) 2145–2150 (ar Xiv:0712.2561).
- 7[7] D. Gilbarg, N.S. Trudinger. Elliptic partial differential equations of second order. Springer-Verlag, Berlin, 1983.
- 8[8] I.J. Bakelman. Convex analysis and nonlinear geometric elliptic equations. Springer-Verlag, 1994.
