Optimal subsets in the stability regions of multistep methods
Lajos L\'oczi

TL;DR
This paper develops computational techniques to precisely analyze and optimize the stability regions of multistep numerical methods for differential equations, including exact calculations of stability angles and radii.
Contribution
It introduces straightforward methods for exact stability region analysis and optimization within parametric families of multistep methods using algebraic and recursive techniques.
Findings
Exact stability angles for BDF and second-derivative methods computed.
Largest stability radius determined for BDF methods.
Optimal methods identified within parametric families for stability angle and region.
Abstract
In this work we study the stability regions of linear multistep or multiderivative multistep methods for initial-value problems by using techniques that are straightforward to implement in modern computer algebra systems. In many applications, one is interested in (i) checking whether a given subset of the complex plane (e.g. a sector, disk, or parabola) is included in the stability region of the numerical method, (ii) finding the largest subset of a certain shape contained in the stability region of a given method, or (iii) finding the numerical method in a parametric family of multistep methods whose stability region contains the largest subset of a given shape. First we describe a simple procedure to exactly calculate the stability angle in the definition of -stability. As an illustration, we consider two finite families of implicit multistep methods: we exactly…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Optimal subsets in the stability regions of multistep methods
Lajos Lóczi [email protected], Department of Numerical Analysis, Eötvös Loránd University, and Department of Differential Equations, Budapest University of Technology and Economics, Hungary
Abstract
In this work we study the stability regions of linear multistep or multiderivative multistep methods for initial-value problems by using techniques that are straightforward to implement in modern computer algebra systems. In many applications, one is interested in (i) checking whether a given subset of the complex plane (e.g. a sector, disk, or parabola) is included in the stability region of the numerical method, (ii) finding the largest subset of a certain shape contained in the stability region of a given method, or (iii) finding the numerical method in a parametric family of multistep methods whose stability region contains the largest subset of a given shape.
First we describe a simple procedure to exactly calculate the stability angle in the definition of -stability by representing the root locus curve (RLC) of the multistep method as an implicit algebraic curve. As an illustration, we consider two finite families of implicit multistep methods. We exactly compute the stability angles for the -step BDF methods () and discover that the values of are surprisingly simple algebraic numbers of degree 2, 2, 4 and 2, respectively. In contrast, the corresponding values of for the -step second-derivative multistep methods of Enright () are much more complicated; the smallest algebraic degree here is 22.
Next we determine the exact value of the stability radius in the BDF family for each , that is, the radius of the largest disk in the left half of the complex plane, symmetric with respect to the real axis, touching the imaginary axis and lying in the stability region of the corresponding method. These radii turn out to be algebraic numbers of degree 2, 3, 5 and 5, respectively.
Finally, we demonstrate how some Schur–Cohn-type theorems of recursive nature and not relying on the RLC method can be used to exactly solve some optimization problems within infinite parametric families of multistep methods. As an example, we choose a two-parameter family of implicit-explicit (IMEX) methods: we identify the unique method having the largest stability angle in the family, then we find the unique method in the same family whose stability region contains the largest parabola.
1 Introduction
In the stability theory of one-step or multistep methods for initial-value problems, one is often interested in various geometric properties of the stability region of the method. In this work we study the shape of the stability region of linear multistep methods (LMMs) or multiderivative multistep methods (also known as generalized LMMs) as follows.
Suppose we are given
- a)
a stability region , or
- b)
a family of stability regions parametrized by some ,
and a family of subsets of , denoted by . Due to their relevance in applications, we will consider the following three classes:
- •
is the family of infinite sectors in the left half of , with vertex at the origin, symmetric about the negative real axis, and parametrized by the sector angle ;
- •
is the family of disks in the left half of , symmetric with respect to the real axis, touching the imaginary axis, and parametrized by the disk radius ;
- •
is the family of parabolas in the left half of , symmetric with respect to the real axis, touching the imaginary axis, and parametrized by some .
Our goal is to find the set with the largest parameter (, , or ) such that
- •
in case a);
- •
for some stability region in the family in case b), but for .
We will present some tools to handle these shape optimization questions, and, as an illustration, exactly solve some of them by using Mathematica version 11 in the BDF and Enright families (as LMMs and multiderivative multistep methods, respectively), and in an infinite family of IMEX methods with parameters.
1.1 Motivation and main results
** A ** When solving stiff ordinary differential equations, one desirable property of the numerical method is -stability: a method is -stable if the closed left half-plane belongs to . Many useful methods are not -stable, still, contains a sufficiently large infinite sector in the left half-plane with vertex at the origin and symmetric about the negative real axis. This leads to the notion of -stability: a method is -stable with some if
[TABLE]
where the argument of a non-zero complex number satisfies . The largest such that (1) holds is referred to as the stability angle of the method [17]. Various other stability concepts—such as -stability, -stability, -stability, stiff stability, or asymptotic -stability—have also been defined, and theorems devised to test whether a given multistep method is stable in one of the above senses; see, for example, [34, 9, 20, 21, 22, 23, 26, 11, 3, 40]. There are various techniques to test -stability for a given value. In [3], for example, the sector on the left-hand side of (1) is decomposed into an infinite union of disks, and a bijection between each disk and the left half-plane is established via fractional linear transformations to employ a Routh–Hurwitz-type criterion. Another way of studying -stability is to consider the root locus curve (RLC) of the multistep method [17]. Based on the RLC and some theorems from complex analysis, [38] presents a criterion for a LMM to be -stable for a given ; the stability angle is then obtained as the solution of an optimization problem involving Chebyshev polynomials. The procedure in [38] is formulated only for LMMs but not for multiderivative multistep methods.
The first goal of the present work is to describe an elementary approach to exactly determine the stability angle of a LMM or multiderivative multistep method: by eliminating the complex exponential function from the RLC and using a tangency condition, a system of polynomial equations in two variables is set up whose solution yields the stability angle. This process is easily implemented in computer algebra systems. As an illustration, we consider two finite families: the BDF methods [13, 17, 38] as LMMs, and the second-derivative multistep methods of Enright [10, 6, 17]. With denoting the stability angle of the -step BDF method for , we show that is an unexpectedly simple algebraic number, having degree 2 for , and degree 4 for ; see Table 1. For the -step Enright methods with , the corresponding constants (with approximate values listed in Table 2) are much more complicated algebraic numbers of increasing degree (starting with 22). As far as we know, exact values for the stability angles of multistep methods were not presented earlier in the literature.
Remark 1.1**.**
The -step BDF methods for are -stable. For they are not zero-stable [8, 7, 16], therefore not interesting from a practical point of view.
Remark 1.2**.**
*In [38, Table 1] one finds some approximate values for the BDF stability angles, however, some of these values are not correct. The value is wrong because the polynomial is not computed properly. The approximate values for and given in [38, Table 1] are correct (up to the given precision). The value for is again incorrect because an error was committed in the minimization process. If the optimization in [38, Section 3] is carried out exactly with the correct polynomials, we recover the stability angle values in our Table 1. The errors in [38, Table 1] propagated in the literature, see, for example, [33, p. 242]. As a consequence, some works that appeared in the current millennium also contain the erroneous angles. In [17, Chapter V.2, (2.7)] the correct approximate values are presented. *
Remark 1.3**.**
At the time of writing this document, we learned (through personal communication) that [1] also contains the exact stability angles for the BDF methods with steps: although they use a different technique to derive the results and the function to express the final constants, the values given in [1] and our Table 1 are the same. Notice, however, that the stability angle for given in [1] has a slightly more complicated structure than the value in our Table 1.
Remark 1.4**.**
The -step Enright methods are -stable again for , see [17], and unstable for . More precisely, [11] proves that these methods are not -stable for , hence they cannot be stiffly stable either, see [23, Theorem 3] (cf. [22, 26]). However, in [17, Chapter V.3, p. 276, Exercise 2] the stiff instability of the Enright formulas for is still mentioned as an open problem.
** B ** The stability radius of a multistep method is the largest number such that the inclusion
[TABLE]
holds. The stability radius plays an important role when analyzing boundedness properties of multistep methods. For example, it has been proved [42, Theorem 3.1] that this radius is the largest step-size coefficient for linear boundedness of a LMM satisfying some natural assumptions.
Remark 1.5**.**
For LMMs (and for more general methods as well), various other step-size coefficients have been introduced in the context of linear or non-linear problems. These coefficients govern the largest allowable step-size guaranteeing certain monotonicity or boundedness properties of the LMM, including the TVD and SSP properties [15]. These properties are relevant, for example, in the time integration of method-of-lines semi-discretizations of hyperbolic conservation laws [41, 19, 35].
Remark 1.6**.**
In [31] the largest inscribed and smallest circumscribed (semi)disks are computed for certain one-step methods.
The second goal of the present work is to compute the stability radius for some multistep methods. We will achieve this by using again the algebraic form of the RLCs. Table 3 contains the exact values in the BDF family for .
** C ** The RLC, as the graph of a function (or a union of such functions for generalized LMMs), yields information about the boundary of the stability region, . It is known, however, that in general the RLC does not coincide with (see Figure 3). This does not pose a problem when a fixed multistep method is considered—one can evaluate the roots of the characteristic polynomial at finitely many test points sampled from different components of determined by the RLC to see which component belongs to and which one to . But when working with parametric families of multistep methods, the precise identification of the stability region boundaries or components can become challenging with the RLC method. One can overcome this difficulty for example by invoking a reduction process, the Schur–Cohn reduction, formulated in e.g. [37]. Instead of using auxiliary fractional linear transformations and applying Routh–Hurwitz-type criteria [36, 28] as mentioned above, these Schur–Cohn-type theorems in [37] are directly tailored to the context of multistep methods to locate the roots of the characteristic polynomials with respect to the unit disk.
The third goal of the present work is to demonstrate the effectiveness of the Schur–Cohn reduction when we solve two optimization case studies in a family of implicit-explicit (IMEX) multistep methods taken from [18]. On the one hand, we find the method in the IMEX family that has the largest stability angle, that is, the method whose stability region contains the largest sector (see our Theorem 5.3). On the other hand, we illustrate the versatility of the reduction technique by also finding the method whose stability region contains the largest parabola (see Theorem 6.1); the inclusion of a parabola-shaped region in is relevant when studying semi-discretizations of certain partial differential equations (PDEs) of advection-reaction-diffusion type [28, 5, 18]. The chosen IMEX family is described by two real parameters, and the corresponding characteristic polynomial is cubic. The Schur–Cohn reduction process recursively decreases the degree of the characteristic polynomial, so instead of analyzing the roots of high-degree polynomials, we finally need to check polynomial inequalities in the parameters present in the coefficients of the original polynomial. Besides the two real parameters, two complex variables are involved in our calculations—the non-trivial interplay between these six real variables determines the optimum in both cases. We emphasize that we solve the optimization problem exactly, and RLCs are not relied on in the rigorous part of the proofs (only when setting up conjectures about the optimal values).
Remark 1.7**.**
The Schur–Cohn reduction is also used in [25] to explore certain properties of a discrete parametric family of multistep methods. Conditions for disk or segment inclusions in the stability regions of a two-parameter family of multistep methods are formulated in [39]. Optimality questions about the size and shape of the stability regions of one-step or multistep methods are investigated in detail in [27]. Properties of optimal stability polynomials and stability region optimization in parametric families of one-step methods are discussed, for example, in [29, 30].
1.2 Structure of the paper
In Section 2.1, we introduce some notation. In Sctions 2.2–2.3, we review the Schur–Cohn reduction and the definition of the stability region of a multistep method. In Sections 2.4–2.5, the definition of the root locus curve is recalled in two special cases: for linear multistep methods and for second-derivative multistep methods. Here we consider the BDF and Enright families as concrete examples.
Regarding the new results, a simple algebraic technique is described in Section 3.1 to exactly compute the stability angle of a linear multistep or multiderivative multistep method. Stability angles for the BDF and Enright families are tabulated in Sections 3.2–3.3. In Section 4, we exactly compute the stability radii in the BDF family by using the same approach. In Section 5, we first describe a two-parameter family of IMEX multistep methods, in which we determine the unique method with the largest stability angle, then, in Section 6, the unique method whose stability region contains the largest parabola. The techniques in Sections 5–6 do not rely on root locus curves but use the Schur–Cohn reduction instead; the full proofs are deferred to Appendices A and B.
2 Preliminaries
2.1 Notation
The set of natural numbers is denoted by . For , , , and denote the real and imaginary parts, and the conjugate of , respectively, and is the imaginary unit. The boundary of a (possibly unbounded) set is . When describing certain algebraic numbers of higher degree, a polynomial with , and will be represented simply by its coefficient list . For a polynomial with , () and , we denote its degree, leading coefficient and constant coefficient by , and . The acronyms RLC and LMM stand for root locus curve and linear multistep method, respectively.
2.2 The Schur–Cohn reduction
In the rest of this section we assume that is a univariate polynomial with , and follow the terminology of [37]—we have explicitly added the condition, being implicit in [37]. We say that
- •
is a Schur polynomial, , if its roots lie in the open unit disk;
- •
is a von Neumann polynomial, , if its roots lie in the closed unit disk;
- •
is a simple von Neumann polynomial, , if and roots with modulus 1 are simple.
Remark 2.1**.**
The class is referred to as strongly stable polynomials in [4, p. 345].
Remark 2.2**.**
The property is often expressed by saying that satisfies the root condition.
The reduced polynomial of is defined as
[TABLE]
[TABLE]
so we have . When this reduction process is iterated, we write for , for example. The following theorems from [37] use the notion of the reduced polynomial and the derivative to formulate necessary and sufficient conditions for a polynomial to be in the above classes. In all three theorems below it is assumed that and .
Theorem 2.3**.**
.
Theorem 2.4**.**
.
Theorem 2.5**.**
.
Remark 2.6**.**
Let us consider the following example when applying the theorems above, e.g. Theorem 2.4. For any , we set . Then the roots of satisfy , so , and . This shows that it can happen that the degree of the original polynomial is , but its reduced polynomial is a non-zero constant, so the relation is undefined. In these cases, when is a non-zero constant, notice that neither , nor , nor can help us in general to determine whether or not (of course, the other condition is violated now); cf. the sentence above [37, Theorem 5.1].
2.3 The stability region of a multistep method
Stability properties of a broad class of numerical methods (including Runge–Kutta methods, linear multistep methods, or multiderivative multistep methods) for solving initial value problems of the form
[TABLE]
can be analyzed by studying the stability region of the method. When an -stage -step method (, fixed positive integers; for we have a one-step method, while for a multistep method) with constant step size is applied to the linear test equation ( fixed, given), the method yields a numerical solution that approximates the exact solution at time and satisfies a recurrence relation of the form [27]
[TABLE]
The characteristic polynomial associated with the method takes the form
[TABLE]
With abbreviating the polynomial , the stability region of the method is defined as
[TABLE]
Remark 2.7**.**
Some other variations of the above definition of the stability region of a multistep method have also been proposed in the literature, see, e.g. [24]. In [4, p. 344], the “open stability region” is defined as the set
[TABLE]
see also [44, p. 348], [12, p. 452] or [33]. In e.g. [17, 32], the stability region of the method (3) is defined as
[TABLE]
that is, essentially, . In [27, Formula (2.5)] the stability region is given by
[TABLE]
with denoting the extended complex plane.
We can regroup the terms in (4) as with some suitable polynomials . The inequality condition in (3) implies that the leading coefficient does not vanish identically; it may happen that for some exceptional values the leading coefficient is zero:
[TABLE]
For example, for the implicit Euler (IE) method with and , so . For the -step BDF method (BDF2), , hence . If definition (6) (or (7)) is interpreted formally, we have for the IE method that (because (6) is satisfied vacuously). Similarly, for the BDF2 method, (because then the unique root of is ).
*However, elements of or can be problematic.
(i) For , the order of the recursion (3) decreases, thus, in general, the starting values of the numerical method cannot be chosen arbitrarily.
(ii) Some exceptional values can be located in the interior of the corresponding region of instability of the method—this is the case for example for both the IE and BDF2 methods. When the step size is chosen in a way that is such an isolated value, the recursion (3) generated by the numerical method becomes practically useless (it quickly “blows up” for arbitrarily small perturbations of ).
(iii) RLCs are often used to identify the boundary of the stability region (see Sections 2.4–2.5 below). In [27, Definition (2.21)], the RLC is given by*
[TABLE]
It can happen that is a proper subset of the corresponding RLC (see, for example, our Figure 3), but in [27, Corollary 2.6] it is shown that for a numerical method satisfying Property C (see [27, Formula (2.9)] or [17, Definition 4.7]), the RLC coincides with . According to [17, Section V.4], all one-step methods have Property C, so the IE method also has. And indeed, applying [27, Proposition 2.7] to the IE method we now have that and have no common root and is univalent on the set , so has Property C. Thus for the IE method . As we have seen above, , so . On the other hand, , so . This apparent contradiction seems to indicate that the authors of [27] interpreted definition (7) intuitively: a root is tacitly introduced as soon as the leading coefficient becomes zero. So [27, Corollary 2.6], for example, actually relies on definition (5) rather than on definition (7) (or (6)).
The problem of vanishing leading coefficient is implicitly avoided in [33, p. 66], or in [40], because they impose a requirement on “all the roots ()”. Definition (5) above with the non-vanishing leading coefficient essentially appears, for example, in [41, Section 2.1] (where it is formulated for LMMs, that is, for in (3)), or in [42, Section 2].
Notice that, with the theorems cited in our Section 2.2, one can directly investigate the stability region of a numerical method, without constructing the corresponding RLC or without analyzing the relation between and the RLC (see Sections 5–6 below).
Finally we remark that the above considerations also play an important role, e.g. in control theory [2, Chapter 1], where a “degree invariance” (i.e., “no degree loss”) condition is incorporated in the Boundary Crossing Theorem. [2, Chapter 1] also recalls several stability results for polynomials, e.g. the Routh–Hurwitz, Jury, or the recursive Schur(–Cohn) stability tests.
2.4 The RLC of a LMM
A linear multistep method for (2) has the form
[TABLE]
where , and the numbers and () are the suitably chosen method coefficients with . The method is implicit, if . By setting
[TABLE]
the associated characteristic polynomial (4) becomes
[TABLE]
One way to study the stability region (5), or its boundary in the complex plane is to depict the RLC corresponding to the method [17]: observe that is linear in , so implies (for . The RLC is then the image of the parametric curve
[TABLE]
2.4.1 RLCs for the BDF methods
Each member of the BDF family is a special case of (8). The -step BDF method (having order ) is given by
[TABLE]
where denotes the backward difference operator , and (for ). It is known [17] that the corresponding RLC is
[TABLE]
Figures 1–3 show the RLCs for some BDF methods.
2.5 The RLC of a multiderivative multistep method
A second-derivative multistep method is more general than (8) and can be written as
[TABLE]
where with , and the method is determined by the coefficients , and , see [17]. Now the associated characteristic polynomial (4) becomes
[TABLE]
This time we have two RLCs:
[TABLE]
where are the two solutions of . For any choice of the method coefficients , and , one can construct explicitly, since is only quadratic in .
2.5.1 RLCs for the Enright methods
The Enright methods are special cases of (12), and for they are defined [17] as
[TABLE]
where
[TABLE]
with the usual extension of the binomial coefficients. From (14) one obtains the RLCs of the Enright methods, see Figures 4 and 5. The order of the -step Enright method is .
3 Optimal sector inclusions
3.1 The RLC in implicit algebraic form
Computing the stability angle of a method with stability region is equivalent to finding the slope of the unique line that passes through the origin, touches at some point in the open upper left half-plane such that lies on the right-hand side of (viewed from the origin) in this quadrant. This last requirement is necessary since can consist of more points, even in the open upper left half-plane, see Figure 7.
Assume now that can be represented by the RLC of the method (cf. Remark 2.7). As we have seen, the RLC is the image of the function in (10) for LMMs, or the union of the images of the functions in (13) for second-derivative multistep methods. The function is given as a simple ratio, but to get the explicit forms of , one should solve a quadratic equation. As the value of gets larger, these explicit formulae for corresponding to a -step second-derivative multistep method become more and more complicated. Moreover, obtaining explicit and practically useful parametrized formulae for the RLCs associated with multistep methods based on higher-than-second order derivatives would almost be impossible.
To avoid these difficulties, we now describe a more general and effective technique which reduces the determination of the stability angles to the solution of a suitable system of polynomial equations. Let us consider the equation (see (4)). By using the well-known Weierstrass substitution [43, pp. 382-383]
[TABLE]
we have ; so instead of solving for , we can solve
[TABLE]
without trigonometric functions. Notice that originally we have in , or equivalently, , but is not in the range of the function , therefore we define
[TABLE]
to restore the missing value(s) due to the reparametrization. Then, clearly, (15) can be brought to the form with some (complex) polynomials and . By writing () we get that there exist two real polynomials and such that the solutions of for any fixed are obtained as the solutions of the system
[TABLE]
Now we eliminate by taking the resultant [14] of and with respect to this parameter, and get that there exists a real polynomial such that if (16) holds for some , then should hold with some . Hence, after identifying with , we see that the RLC can be represented as the implicit algebraic curve with . Assuming that the set is finite (it has at most two elements in the case of the BDF and Enright methods we are interested in), we ignore this component and focus only on . Suppose now that a line passes through the origin and touches in the open upper left half-plane at some with . By assuming that can be represented locally as the graph of an implicit function near , we easily get, by differentiating , that satisfies
[TABLE]
By taking again the resultant of the first two polynomial equations, one of the variables, say , is eliminated. The resulting univariate polynomial yields in the general case finitely many possible values to choose from. With denoting the angle (in radians) between and the negative half of the real axis, we get that . To select the appropriate solution (and hence the appropriate tangent line ), we verify in the concrete case that , and determine whether lies on the right-hand side of . The appropriately chosen angle then yields the desired stability angle.
3.2 Results for the BDF methods
The simplest non-trivial case illustrating the steps in Section 3.1 is the determination of the stability angle for the -step BDF method. Formula (11) with yields the following trigonometric parametrization of the RLC in after a simplification:
[TABLE]
[TABLE]
After eliminating the trigonometric functions, (15) can be written as
[TABLE]
Then and in (16) become
[TABLE]
We eliminate from this system and obtain
[TABLE]
[TABLE]
Now is eliminated from the first two equations of (17), and we get that the possible choices for are the negative real roots of
[TABLE]
yielding the unique value . Substituting this into (17) we get the unique value , hence is the only possible value for the tangent of the stability angle. Finally, we verify that the corresponding tangent line passing through the origin has no other intersection point with in the open upper left quadrant, and lies on the right side of .
Remark 3.1**.**
The above RLC for the -step BDF method can also be parametrized as
[TABLE]
Here , corresponding to the limiting value of the parametrization.
The remaining stability angle values for can be computed analogously, so Table 1 shows only the final exact results.
Remark 3.2**.**
For , the BDF stability region includes an interval along the imaginary axis and containing the origin if and only if or . For and the two intervals are
[TABLE]
and
[TABLE]
respectively.
Remark 3.3**.**
The boundary curve of the stability region of the -step BDF method contains two cusp singularities, see Figure 6 (and compare with Figure 3). No other curve has this type of degeneracy in the BDF family for or . Since the cusp points for are not part of , the stability region in this case is not closed (nor open).
3.3 Results for the Enright methods
By applying the algorithm described in Section 3.1, we can exactly determine the stability angles for the Enright methods, see Table 2. But since the values are much more complicated algebraic numbers than the corresponding constants in Table 1, Table 2 contains only a numerical approximation to the exact stability angles.
Remark 3.4**.**
By rounding the values of given in Table 2 to two decimal places, we recover the approximate values of these stability angles in [17, Chapter V.3, Table 3.1].
It turns out that is an algebraic number of degree 22, being the unique positive root of the following even polynomial with coefficients
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
[TABLE]
Remark 3.5**.**
Besides the stability angle, there are other measures of stability for -stable methods. One of these characteristics is the stiff stability abscissa, being the smallest constant such that . For example, for the -step Enright method, Table 3.1 in [17, Chapter V.3] contains the approximate value . By using our implicit representation of , it is straightforward to determine the exact value of ; it is an algebraic number of degree 12, and the total number of digits in the coefficients of its defining integer polynomial is 529.
As for the case, the algebraic degree of is 28. The constants , and can be given as roots of increasingly more involved integer polynomials, so we do not reproduce these polynomials here. During the computations in the case, for example, we had to manipulate intermediate polynomials of degree of a few hundred, or polynomials with a total number of coefficient digits of approximately 470000. We could describe the final defining polynomial for by characters in Mathematica.
Remark 3.6**.**
Let us consider the Enright stability region corresponding to . As we already remarked earlier, there are exactly two lines that pass through the origin and are locally tangent to the boundary curve at some point in the open upper left half-plane, see Figure 7. Within the BDF family for or in the Enright family for , this phenomenon occurs only in the present case.
4 Optimal disk inclusions
As for the largest inscribed disk in the stability region , we again expect—similarly to Section 3.1—that (or the RLC) and the optimal disk possess a common tangent line (with point of tangency different from the origin). By using
- •
the implicit algebraic form of the RLC,
- •
the implicit equation for the boundary of the inscribed disk,
- •
and the condition for a common tangent line
[TABLE]
we obtain a system of 3 polynomial equations in 3 unknowns . By taking resultants and successively eliminating the variables (), we obtain a univariate polynomial in whose positive root will yield the optimum value of the stability radius. The exact optimal stability radii for the -step BDF methods () are found in Table 3; see Figure 8 also. The degree of the algebraic number is for , respectively.
Remark 4.1**.**
It is quite surprising that the algebraic numbers listed in Table 3 have such a low degree for the following reasons. For the 3-step BDF method, the univariate polynomial mentioned above has degree 28, but it can be split into several factors of lower degree, and has a unique positive root . For the 4-step BDF method, the corresponding -polynomial has degree 52 and a unique positive root . The -polynomial for the 5-step BDF method has degree 88 and a unique positive root . Finally, the -polynomial for the 6-step BDF method has degree 128, and a unique positive root .
5 Optimal stability angle in a family of multistep methods
In [18], ODEs of the form , are considered, with and representing non-stiff and stiff parts of the equation, respectively. To solve these equations numerically, the authors construct several implicit-explicit (IMEX) LMMs, and thoroughly analyze them from the viewpoint of numerical monotonicity, boundedness and stability. Their analysis involves finding optimal methods with respect to various criteria in certain families.
Here we take their simplest case study from [18, Section 3.2.1], a 2nd-order, 3-step explicit method augmented by an implicit method (note that we changed their notation from to ):
[TABLE]
The values of and are determined from the order conditions, so (18) becomes a 2-parameter family of methods, with real parameters and . The three figures in [18, Figure 1] then depict the -stability angles, the “damping factors” and the “absolute error constants”, respectively, of members of the family (18). In what follows, we do not consider these last two categories but focus only on the leftmost figure in [18, Figure 1]—as the authors conclude in [18, Section 3.2.1], a method with large stability angle does not necessarily have a good damping factor or a small error constant, and vice versa; the different optimization criteria are often conflicting. In other words, our goal in this section is to find the IMEX method in the family (18) with the largest stability angle.
To begin the -stability investigation, the authors of [18] define the usual linear test functions and . They then assume that and with and : this choice is relevant “for example, for advection-diffusion equations if central finite differences or spectral approximations are used in space”. These assumptions lead to the following characteristic polynomial of the IMEX multistep family, see [18, (2.4)–(2.7)]:
[TABLE]
To create the leftmost figure in [18, Figure 1] approximately indicating the optimal stability angle within the family, the authors use (19) to construct the RLCs and study these curves “for ” to estimate the stability angles111When the stability angle of a method is defined in [18, Sections 2.3 and 3.2.1] notice that we should require that the sector
be included in the stability region in the -plane (with the and cases interpreted appropriately). In other words, in [18] is to be replaced by , otherwise the sector would not “open wide enough” and -stability would not be recovered in the limit. See also Footnote 2..
In the rest of this section we confirm their numerical findings, but we solve the optimization problem rigorously and exactly. We have selected this family (18) because the final result—the optimal stability angle—has a particularly simple form (see our Theorem 5.3 below), and, at the same time, our straightforward approach based on the theorems cited in Section 2.2 is readily illustrated. We emphasize that our analysis avoids the construction of the RLCs: as we have seen (for example, in Figure 3), they may have complicated self-intersections, and it is often not obvious a priori whether a particular segment of the RLC coincides with the stability region boundary or not.
5.1 Summary of the main steps and results
By rearranging (19) and inserting the values of and given below (18), we define
[TABLE]
[TABLE]
where , , and . Our goal is to find the parameters such that the stability region
[TABLE]
contains the infinite sector
[TABLE]
with the largest in the definition of -stability. In other words, we are to find such that
[TABLE]
holds with the largest possible . Note that for convenience we have identified with , hence stability regions in this section are subsets of .
As a first step, Lemma 5.1 below yields a necessary condition for the inclusion (22). In its proof—presented in Appendix A.1—we use the argument proposed in [18] and consider the , limiting values. At this point it is convenient to recall the notion of -stability [17, Chapter V.2]: a method is -stable, if its stability region includes the non-positive reals . Clearly,
[TABLE]
Lemma 5.1**.**
Let us define
[TABLE]
Then a method of the form (18) is not -stable for .
As a consequence, from now on we can assume , see Figure 9. Note that the orientation of the axes in Figure 9 and in the leftmost figure in [18, Figure 1] is the same: the -axis is horizontal, while the -axis is vertical. Lemma 5.1 thus also proves that the wedge-like object in the parameter space in the leftmost figure in [18, Figure 1] is indeed a perfect (infinite) wedge given by .
Remark 5.2**.**
The assumption implies , so due to , the leading coefficient of (20), , cannot vanish (cf. Remark 2.7).
Then in Appendix A.2 we prove the main result of Section 5.
Theorem 5.3**.**
Suppose that . Then the largest such that (22) holds is .
In the proof we show that finding the optimal is equivalent to finding the largest positive real root of a suitable polynomial in with coefficients depending on and . We verify that this optimal root is located at , corresponding to the unique method with and represented as a red dot in the parameter space in Figure 9. The black curve in the left half-plane in Figure 12 is the boundary of the optimal stability region, and the dashed red lines bound the largest inscribed infinite sector : the optimal stability angle satisfies . As a conclusion, the highest value in the scale adjacent to the leftmost figure in [18, Figure 1] should be exactly , that is, .
Remark 5.4**.**
Unlike in Section 6 (see Remark B.2), the boundary of the optimal sector does not touch (or intersect) the boundary of the optimal stability region in the open left half-plane.
Remark 5.5**.**
In [18, Section 3.2.1, (3.4)–(3.5)], the stability angles for two particular schemes from the family (18) are also approximated. For the IMEX-Shu(3,2) scheme
[TABLE]
[TABLE]
they obtain , and for the IMEX-SG(3,2) scheme
[TABLE]
they get . Our technique easily yields the exact values
[TABLE]
and
[TABLE]
6 Optimal parabola inclusion in a family of multistep methods
In the previous section we demonstrated how one can find the optimal sector in a family of stability regions of multistep methods. Here we show that the same algebraic approach allows us to replace the sector with more general shapes: we use again the multistep family (18) as a test example and determine the optimal stability region that contains the largest parabola. The motivation for considering the shape of a parabola comes from [18] (“for advection-diffusion equations, stability within a parabola222 Similarly to Footnote 1, an analogous typo is present in [18, Section 2.3] when the notion of “stability within a parabola” is defined. There we should have again instead of , that is,
can be more relevant than for a wedge”), or from [5, Sections 3–4] (where linearly implicit Runge–Kutta methods are developed for the numerical integration of semidiscrete equations originating from spatial discretizations of PDEs of advection-reaction-diffusion type).
With and defined in (20)–(21), we are now looking for the largest possible such that the stability region of a suitable member of the family (18) contains the parabola
[TABLE]
that is, the inclusion
[TABLE]
holds. Clearly, we need -stability again to have (25) with some , so from now on, by Lemma 5.1, we can assume that (see Figure 9).
In Appendix B.1 we apply a simple geometric argument: we first formulate the RLCs for the members of the multistep family as implicit curves , then invoke the notion of discriminant [14] to construct a polynomial in (and depending on the parameters and ) whose suitable root can yield the optimal value in (25). The simple observation is the same as the one used in Section 3.1 (or in Section 4): the optimal inscribed object (now a parabola) touches the boundary of the optimal stability region.
Based on this technique and by using Mathematica, we conjecture that the parameter values and give . In Appendix B.2 we use a uniqueness argument to rigorously prove this conjecture. We emphasize that, similarly to Appendix A.2, no RLCs are involved in this uniqueness proof; the RLCs are used only as auxiliary objects to conjecture the optimum. Given the complexity of intermediate calculations, it is again surprising that the final result is a simple rational number. In summary, we have the following theorem.
Theorem 6.1**.**
Suppose that . Then the largest such that (25) holds is .
Remark 6.2**.**
The authors of [18] observe that “for the methods considered in this paper, a large angle will correspond to a large ” (with and interpreted in our Footnotes 1 and 2). According to our results, the optimal parameter pairs and —determining the stability regions with the largest inscribed sector and parabola, respectively—do not coincide, although they are both located on the right boundary of in Figure 9 (see also Remark B.1).
Appendix A Appendix
A.1 The proof of Lemma 5.1
Proof.
Let us fix some . For , is equivalent to with
[TABLE]
and . Clearly, if is large enough, the coefficients of the RHS polynomial can be arbitrarily close to [math]. So by the fact that the roots of a polynomial are continuous functions of its coefficients, we get that “the roots of can be made arbitrarily close to those of by choosing large”. To make the previous “statement” precise, we distinguish two cases according to whether the leading coefficient of LHS vanishes or not: for , the LHS polynomial has at most two roots, whereas the difference has three.
Case I: . By the above statement we easily see that if , then for large enough. We now show that
[TABLE]
So let us suppose in the rest of Case I that and .
Case I. First we check the case when . Then
[TABLE]
and, since now , we can apply Theorem 2.4 to the above polynomial in : due to we have that if and only if . But we directly see that this last linear polynomial , because and imply .
Case I. The conditions mean that we can apply Theorem 2.4 to . It is easy to verify that does not vanish identically, so if and only if
[TABLE]
We show in Cases I and I below that (27) never occurs. First we observe that the inequality constraint in (27) yields that .
Case I. If , then the polynomial has exactly two roots: and
[TABLE]
One directly checks that and imply .
Case I. If , we apply Theorem 2.4 to get that the quadratic polynomial if and only if either Case I or I below occurs.
Case I: when and . In this case, however, the unique root of the polynomial ,
[TABLE]
has absolute value .
Case I: when and . But then the unique root of is
[TABLE]
for which we again have , completing Case I.
Case II: . Then
[TABLE]
and the leading coefficient of this cubic polynomial is 1. For each fixed we see that at least one of its coefficients is unbounded as , so (by Vieta’s formulae) at least one of its roots is unbounded as . Hence cannot hold. ∎
A.2 The proof of Theorem 5.3
Proof.
In the proof we suppose and, due to Lemma 5.1, that .
Step 1. Let us apply the same ideas as in Section A.1 but along the ray . For we consider the roots of , and get that
[TABLE]
for some large enough, where the corresponding “modified left-hand side” is defined as
[TABLE]
and we have also taken into account that . (The corresponding “modified right-hand side” would be the same as in Section A.1.) Hence if the inclusion (22) holds with some , then .
Step 2. In this step we derive a necessary condition for . First, one simply checks via Theorem 2.4 that , and cannot be simultaneously true. So we can suppose
[TABLE]
We check that does not vanish identically, and that
[TABLE]
Then by Theorem 2.4 we have that
[TABLE]
Now we see that
[TABLE]
and does not vanish identically. Thus Theorem 2.4 yields that
[TABLE]
if and only if
[TABLE]
and
[TABLE]
Clearly, , and we directly confirm that (28) implies that the degree is exactly 1. From this we obtain that (28) and (29) hold if and only if (28) and
[TABLE]
[TABLE]
hold. In particular, (28) guarantees that the denominators appearing in (30) are non-zero, hence from now on we can restrict the parameters to the set with
[TABLE]
being the left edge of the wedge ; see Figure 10.
By defining
[TABLE]
[TABLE]
[TABLE]
[TABLE]
and
[TABLE]
it is easily verified after some factorization and simplification that
[TABLE]
In particular, implies .
Step 3. We see that and for , hence we can denote the largest real root of the polynomial by . Consequently, if , then . We now conjecture (by using Mathematica’s Maximize command, for example) that
[TABLE]
and occurs precisely for , see Figure 11. With this conjectured optimal value, we can prove (32) and the uniqueness property in an elementary way.
By introducing the shifted variable , we rewrite as
[TABLE]
Then we check that
[TABLE]
Moreover, we have
[TABLE]
[TABLE]
[TABLE]
and
[TABLE]
On the one hand, these mean that (33) is negative for and . On the other hand, for the polynomial (33) is zero if and only if .
Therefore we have proved that if (22) holds with some , then ; and if is possible at all, then .
Step 4. In this final step we show that in (22) can be achieved, by showing that , that is,
[TABLE]
Let us fix such a pair . One sees that
[TABLE]
and in the case (34) is easily verified to hold. Otherwise, if , we check that does not vanish identically, so by Theorem 2.5 we have that if and only if
[TABLE]
We have that . Moreover, for or , in which cases (35) holds. So we can suppose from now on that . Then one proves that
[TABLE]
[TABLE]
so . Hence, by using Theorem 2.5 again, we get that (35) holds if and only if
[TABLE]
hold. Finally, we check that these last two conditions are satisfied for any pair not excluded earlier during the case separations. ∎
Remark A.1**.**
By defining
[TABLE]
[TABLE]
and applying Theorem 2.5, it is straightforward to show (cf. Step 4 in the above proof) that
[TABLE]
see Figure 12 and cf. Remark B.1.
Appendix B Appendix
B.1 Locating the candidate optimum for Theorem 6.1
For a given pair, we can represent the RLC of the corresponding multistep method of the family (18) as an implicit curve of the form
[TABLE]
by using the transformations in Section 3.1 as follows. First we perform the substitution in the polynomial (20), then eliminate by taking the resultant of the real and imaginary parts of . The resulting polynomial can be factored to get ; the normalization with has been used to make this polynomial unique. The term (cf. the leading coefficient of ) does not vanish now due to and , hence (36) is obtained. We are not going to display the polynomial explicitly: it contains 82 terms in its expanded form and its degree in the variables/parameters is .
Now supposing that the RLC (36) describes the boundary of the stability region of the multistep method determined by the given pair , it is reasonable to expect that, say, the upper branch of the largest parabola inscribed in , , touches the RLC (36) at some finite point. In this case, the polynomial
[TABLE]
has a multiple root there—it is indeed a polynomial, because in our situation contains only even powers of (namely, and ). Moreover, we now have
[TABLE]
where is a quartic polynomial. The existence of a multiple root of implies that the discriminant of this polynomial (with respect to ), denoted by , vanishes. Mathematica yields that
[TABLE]
[TABLE]
where the “” symbols contain 57 and 228 terms, respectively. We see that the factor above is always positive in . In this way we can determine the parameter of the largest parabola within the region bounded by the RLC for any fixed .
Remark B.1**.**
By setting for example (corresponding to the “sector-optimal” method in Section A.2), we have that the RLC in (36) is identical to in Remark A.1, implying that the RLC in the left half-plane represents the boundary of the stability region . Now can be written as
[TABLE]
from which we can prove that the largest parabola contained in has (being the unique positive root of the polynomial ).
By studying the positive roots of as is varied within , we can conjecture that the value of in (25) cannot be greater than for the family (18). Moreover, occurs only for and , and in this case the RLC and the upper parabola branch touch each other at . Since the polynomial is much more complicated than the corresponding polynomial in Appendix A.2, this time Mathematica could not confirm in a reasonable amount of computing time that the value is indeed the optimal one.
B.2 The proof of optimality in Theorem 6.1
However, once the unique optimum has been conjectured properly, the proof of optimality becomes straightforward to complete.
Step 1. By assuming throughout the step, we show that the point belongs to precisely one stability region in the family, by verifying that
[TABLE]
To see this, first we check that . Moreover, it is easily seen that vanishes exactly for and , and in this case the polynomial has but , as a recursive application of Theorem 2.5 shows. Then we can also prove that does not vanish identically, and that
[TABLE]
Thus, according to Theorem 2.5,
[TABLE]
Now we repeat the above process with . We prove that
[TABLE]
and that does not vanish identically, so by Theorem 2.5 we have that
[TABLE]
But is a linear polynomial (it is easily checked that it cannot be a constant polynomial), so its unique (non-real complex) root can be directly expressed: one sees that the absolute value of this root is if and only if
[TABLE]
[TABLE]
[TABLE]
[TABLE]
The product of the first two factors is strictly negative in , and a standard constrained optimization computation shows that the third factor is in if and only if , completing Step 1.
Step 2. Since is equivalent to (see (24)), and now , the uniqueness property in the previous step implies that in (25) can hold only for . In this step we verify that (25) indeed holds with and , that is, we show that for any .
Let us pick and fix an arbitrary point . Then we easily see that
[TABLE]
and this if and only if ; in this case Theorem 2.5 tells us that . So for , again by Theorem 2.5 we get that
[TABLE]
provided that does not vanish identically. But this non-vanishing condition is true because
[TABLE]
Moreover, since is also positive, the above with Theorem 2.5 imply that
[TABLE]
The positivity of yields that , a polynomial, has a unique root. The absolute value of this (real or complex) root is if and only if , where
[TABLE]
[TABLE]
Now , and one checks that for , completing Step 2.
Step 3. To complete the optimality proof, we finally show that
[TABLE]
that is, we cannot have in (25). We repeat the same two-step reduction process as above and get that guarantees that
[TABLE]
But this last condition is equivalent to
[TABLE]
so it cannot hold for any .
Remark B.2**.**
In addition to the inequality in Step 2, we have that for if and only if . Moreover, (see (36)). On the other hand, by using the reduction process one can actually prove that
[TABLE]
These mean that the stability region boundary in the optimal case coincides with the corresponding RLC (in the left half-plane), and the boundary of the optimal inscribed parabola touches the stability region boundary in the open upper left half-plane at exactly one point, see Figure 13 (and cf. Remarks 5.4 and B.1).
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] G. Akrivis, E. Katsoprinakis, Maximum angles of A ( ϑ ) 𝐴 italic-ϑ A(\vartheta) -stability of backward difference formulae, submitted for publication
- 2[2] S. P. Bhattacharyya, H. Chapellat, L. H. Keel, Robust Control: The Parametric Approach. Prentice Hall PTR (1995)
- 3[3] T. A. Bickart, E. I. Jury, Arithmetic tests for A 𝐴 A -stability, A [ α ] 𝐴 delimited-[] 𝛼 A[\alpha] -stability, and stiff-stability, BIT, Vol. 18, No. 1, 9–21 (1978)
- 4[4] J. C. Butcher, Numerical methods for ordinary differential equations. John Wiley & Sons, Chichester (2008)
- 5[5] M. P. Calvo, J. de Frutos, J. Novo, Linearly implicit Runge–Kutta methods for advection-reaction-diffusion equations, Appl. Numer. Math., Vol. 37, No. 4, 535–549 (2001)
- 6[6] P. C. Chakravarti, M. S. Kamel, Stiffly stable second derivative multistep methods with higher order and improved stability regions, BIT, Vol. 23, No. 1, 75–83 (1983)
- 7[7] D. M. Creedon, J, J. H. Miller, The stability properties of q 𝑞 q -step backward difference schemes, BIT, Vol. 15, No. 3, 244–249 (1975)
- 8[8] C. W. Cryer, On the instability of high order backward-difference multistep methods, BIT, Vol. 12, 17–25 (1972)
