Two-step General Linear Methods for Retarded Functional Differential Equations
Anton Tuzov

TL;DR
This paper introduces a new class of two-step general linear methods specifically designed for efficiently solving retarded functional differential equations, including explicit methods up to fifth order, with considerations for stiff problems.
Contribution
The paper develops a novel class of two-step general linear methods tailored for retarded functional differential equations, achieving high order and addressing stiffness issues.
Findings
Explicit methods up to order five constructed
Methods designed to prevent order reduction in mildly stiff problems
Stage order close to uniform order for stability
Abstract
This paper presents a class of Two-Step General Linear Methods for the numerical solution of Retarded Functional Differential Equations. Explicit methods up to order five are constructed. To avoid order reduction for mildly stiff problems the uniform stage order of the methods is chosen to be close to uniform order.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNumerical methods for differential equations · Differential Equations and Numerical Methods · Electromagnetic Simulation and Numerical Methods
Two-step Runge-Kutta methods for
Retarded Functional Differential Equations
A. Tuzov 111Department of Control systems, Siberian State Aerospace University, Krasnoyarsk, Russia, e-mail: e-mail: [email protected]
Abstract
This paper presents a class of two-step Runge-Kutta (TSRK) methods for the numerical solution of Retarded Functional Differential Equations (RFDEs). A convergence theorem is formulated and proved. Explicit methods up to order five are constructed. To avoid order reduction for mildly stiff problems the uniform stage order of the methods is chosen to be closed to uniform order.
Keywords: Functional differential equations; two-step Runge-Kutta methods; A-methods; order conditions.
AMS Subject Classification: 65Q05
**Two-step Runge-Kutta methods for
Retarded Functional Differential Equations**
Anton Tuzov †††Department of Control systems, Siberian State Aerospace University, Krasnoyarsk, Russia, e-mail: [email protected]
1 Two-step Runge-Kutta methods for
Ordinary Differential Equations
For the numerical approximation of the solution of a system of Ordinary Differential Equations
[TABLE]
where ,
we consider the class of General Linear Methods[5, 9]
[TABLE]
where — input vectors, available at step number , — stage values, — derivative values, — coefficients of the method, — integration stepsize.
Let us restrict ourselves to two-step methods and choose
[TABLE]
and (1) takes the form
[TABLE]
In the construction of GLMs it is assumed that and 'preconsistensy conditions' holds
[TABLE]
For (1) we have . It follows from (4) that
[TABLE]
Let us denote
[TABLE]
then the method (1) satisfying 'preconsistensy conditions' (4) takes the form
[TABLE]
2 Two-step Runge-Kutta methods for
Retarded Functional Differential Equations
We begin with notations introduced in [10] (see also [3]).
Let , and be the space of continuous functions , equipped with the uniform norm \bigl{\|}\varphi\bigr{\|}_{\mathcal{C}}=\max\limits_{\theta\in[-r,0]}\bigl{\|}\varphi(\theta)\bigr{\|}_{\mathbb{R}^{d}}\ ,\quad\varphi\in\mathcal{C}, where \bigl{\|}\cdot\bigr{\|}_{\mathbb{R}^{d}} is an arbitrary norm on . Let be a continuous function , where . Then shift function is defined by and .
Let be stage number of the method, be the norm on defined as the maximum of the norms of subvectors in :
[TABLE]
and be the space of continuous functions , equipped with the uniform norm:
[TABLE]
Consider a system of Retarded Functional Differential Equations (RFDEs)
[TABLE]
where .
It is assumed that the function is continuous and has the first derivative with respect to the second argument , which is bounded and continuous with respect to the second argument. Then for each there exists an unique non-continuable solution of (6) through , where , , i.e. satisfies (6) for and for .
We next consider the system (6) through on the , where
[TABLE]
The first derivative of with respect to the second argument is bounded, hence satisfies the Lipschitz condition with respect to the second argument
[TABLE]
where L=\sup\limits_{(t,\,\varphi_{t})\,\in\,\Omega}\bigl{\|}f\,^{\prime}(t,\varphi_{\,t})\bigr{\|}_{\mathcal{L}(\mathcal{C},\mathbb{R}^{d})}.
We introduce the class of two-step Runge-Kutta (TSRK) methods for RFDEs on the basis of approach proposed in [3, 10]. We can reformulate the method (1) for RFDEs (7) with the equispaced mesh , as follows
[TABLE]
[TABLE]
Thus , , hence on , where .
It is assumed that coefficients (a_{ij}(\cdot),b_{j}(\cdot),c_{i},\widetilde{a}_{ij}(\cdot),\widetilde{b}_{j}(\cdot),u_{i}(\cdot),v(\cdot))_{\,i,\,j=1,\dots,s}\ of TSRK methods satisfy the following conditions:
[TABLE]
The last two conditions correspondingly guarantee continuity of the stage functions and the approximate solution provided that approximate solution computed in the previous step is continuous function
Remark 2.1**.**
If the conditions
[TABLE]
hold, the two-step method (9) becomes the one-step RK method for RFDEs introduced in [3, 10], where initial function .
Definition 2.2**.**
The TSRK method with coefficients (a_{ij}(\cdot),b_{j}(\cdot),c_{i},\widetilde{a}_{ij}(\cdot),\widetilde{b}_{j}(\cdot),u_{i}(\cdot),v(\cdot))_{i,j=1,\dots,s}\ is called explicit if a_{ij}(\cdot)=0\text{ for all j such that}j\geq i,\quad i,j=1,\dots,s.
Make the change of the independent variables: and introduce the shifted coefficient functions:
[TABLE]
Then (9c) can be rewritten in the form:
[TABLE]
Let us introduce the following notation:
[TABLE]
This notation allows us to rewrite (9a) like (2):
[TABLE]
Denote
Then the method (9) can be reformulated as follows:
[TABLE]
Denote {\overline{\Omega}}_{h}=\Bigl{\{}(\sigma,\varphi)\in\mathbb{R}\times{\overline{\mathcal{C}}}\;\Big{|}\bigl{(}\sigma+(c_{j}-1)h,\varphi_{j}\bigr{)}\in\Omega,\quad j=1,\dots,s+1\Bigr{\}}.
When one step of the method (2) is applied with stepsize to (7) for the computation of the solution through on , it yields a continuous function in , where . Note that , since . The approximation is defined for stepsizes , where , moreover .
Let be computed by some starting method . When several steps of the method (2) are applied to (7) for the computation of the solution through on , they yield the finite sequence of continuous functions in . These sequence is defined for stepsizes , where , moreover for all .
Rewrite the method (2) in matrix-vector form. For this purpose we define
[TABLE]
where e=\Bigl{(}1,\dots,1\Bigr{)}^{T},\quad\overline{u\vphantom{\widetilde{a}}}\,\Bigl{(}\dfrac{\omega}{h}\Bigr{)}=\Bigl{(}\overline{u\vphantom{\widetilde{a}}}_{1}\Bigl{(}\dfrac{\omega}{h}\Bigr{)},\dots,\overline{u\vphantom{\widetilde{a}}}_{s+1}\Bigl{(}\dfrac{\omega}{h}\Bigr{)}\Bigr{)}^{T},\quad
O is - dimensional zero matrix.
Then the method (2) can be represented in the form of -method [1, 2]:
[TABLE]
[TABLE]
Denote the exact value function of the method (17) by and the global error function by
[TABLE]
Definition 2.3**.**
The method (17) has uniform order of convergence if
[TABLE]
and discrete order of convergence if
[TABLE]
where and are positive integers.
Denote by the local discretization error function obtained as the residual function by replacing in (17) by the exact value functions correspondingly:
[TABLE]
Definition 2.4**.**
The method (17) has uniform order of consistency if
[TABLE]
and discrete order of consistency if
[TABLE]
It follows from (18b) that for . Subtracting (17) from (18) we have
[TABLE]
where .
We further extend the shifted coefficient functions \overline{u\vphantom{\widetilde{a}}}_{i}\Bigl{(}\dfrac{\omega}{h}\Bigr{)},\;\overline{\widetilde{a}\vphantom{\widetilde{a}}}_{ij}\Bigl{(}\dfrac{\omega}{h}\Bigr{)},\;\overline{a\vphantom{\widetilde{a}}}_{ij}\Bigl{(}\dfrac{\omega}{h}\Bigr{)} to by
[TABLE]
This extension is continuous, since \overline{u\vphantom{\widetilde{a}}}_{i}\Bigl{(}\dfrac{\omega}{h}\Bigr{)}\Bigr{|}_{\omega=-c_{i}h}=u_{i}(0)=1,\quad\overline{\widetilde{a}\vphantom{\widetilde{a}}}_{ij}\Bigl{(}\dfrac{\omega}{h}\Bigr{)}\Bigr{|}_{\omega=-c_{i}h}=\widetilde{a}_{ij}(0)=0,\quad \overline{a\vphantom{\widetilde{a}}}_{ij}\Bigl{(}\dfrac{\omega}{h}\Bigr{)}\Bigr{|}_{\omega=-c_{i}h}=a_{ij}(0)=0,\qquad i=1,\dots,s+1,\ j=1,\dots,s. Thus, the elements of , , are continuous functions . From (19a) we have
[TABLE]
It follows from (19a) for that
[TABLE]
Definition 2.5**.**
The TSRK method (17) is called zero-stable if is power bounded, i.e.
[TABLE]
Lemma 2.6**.**
The method (17) is zero-stable iff .
Proof.
The condition (22) holds iff [5]
- i)
the minimal polynomial of has all its zeros in the closed unit disc and 2. ii)
all its multiple zeros in the open unit disc.
Denote by and the minimal and characteristic polynomials of correspondingly. Then where is the greatest common divisor of - t order minors of the characteristic matrix .
[TABLE]
Hence and zeros of the minimal polynomial are
[TABLE]
The condition (i) holds iff ; (ii) holds iff . Thus, (22) holds iff . ∎
Theorem 2.7**.**
Assume that the method (17) is zero-stable and the starting procedure for it, which specifies the starting value , such that \bigl{\vvvert}q^{[0]}\bigr{\vvvert}=O(h^{p-1}), \bigl{\|}q^{[0]}(0)\bigr{\|}=O(h^{p}) as .
If the method has uniform order of consistency p-1:\;\max\limits_{n=1,\dots,N}\bigl{\vvvert}d^{[n]}\bigr{\vvvert}=O(h^{p-1}) and discrete order of consistency p:\;\max\limits_{n=1,\dots,N-1}\bigl{\|}d^{[n]}(0)\bigr{\|}=O(h^{p}) as , then it has uniform order of convergence \max\limits_{n=1,\dots,N}\bigl{\vvvert}q^{[n]}\bigr{\vvvert}=O(h^{p}),\quad h\rightarrow 0.
Proof.
Since the function satisfies the Lipschitz condition (8) with respect to the second argument with constant , we have
[TABLE]
Hence
[TABLE]
The method (17) is zero-stable, i.e. (22) holds, where it can be assumed without loss of generality that . Denote . It follows from (21), (22) and (23) that
[TABLE]
where we assume that the sum is zero if the lower summation index exceeds the upper one.
By (20) and (23) it follows that
[TABLE]
Consider (2) for . Since h\,\sum\limits_{l=1}^{n-1}\bigl{\|}d^{[l]}(0)\bigr{\|}\leq h\,(n-1)\max\limits_{l=1,\dots,N-1}\bigl{\|}d^{[l]}(0)\bigr{\|} and we obtain h\sum\limits_{l=1}^{n-1}\bigl{\|}d^{[l]}(0)\bigr{\|}=O(h^{p}) as .
Moreover,
[TABLE]
where .
By hypothesis, we have that \bigl{\vvvert}q^{[0]}\bigr{\vvvert}\leq\widetilde{\widetilde{C}}_{0}\,h^{p} for some and sufficiently small . Denote {C}_{0}=\max\Bigl{\{}\widetilde{C}_{0},\widetilde{\widetilde{C}}_{0}\Bigr{\}}. Then
[TABLE]
Let be defined by
[TABLE]
Using (25), (26) and (19b) it is easy to prove by induction that
[TABLE]
Finally, it follows from (26) that , where
(1-Dh)^{-n}=\Bigl{(}1+\dfrac{Dh}{1-Dh}\Bigr{)}^{n}\leq\exp\Bigl{(}\dfrac{Dnh}{1-Dh}\Bigr{)}\leq\exp\Bigl{(}\dfrac{D(T-t_{0})}{1-D\overline{h}}\Bigr{)}. Hence
[TABLE]
which concludes the proof. ∎
3 Order conditions
Assume that is of class with respect to the second argument for a sufficiently large and solution of (7) is of piecewise class for a sufficiently large . Let such that and , i.e. are distinct in increasing order.
Observe that convergence and consistency of the method (17) in Definitions 2.3 and 2.4 means stage convergence and consistency of the corresponding method (9). Now we consider weaker definitions.
Definition 3.1**.**
The method (9) has uniform order of consistency if
[TABLE]
and discrete order of consistency if
[TABLE]
Definition 3.2**.**
The method (9) has uniform order of convergence if for the corresponding method (17) the following condition holds:
[TABLE]
and discrete order of convergence if
[TABLE]
Lemma 3.3**.**
Let be a positive integer. If is of piecewise class then the local discretization error function satisfy
[TABLE]
[TABLE]
Proof.
Consider defined by (18a) for , make the change of the independent variable: and use (12). The proof follows by Taylor series expansion about . ∎
For convenience we denote . Using (14) and (30) we obtain
[TABLE]
Remark 3.4**.**
If the conditions (11) hold the
are the same as for the one-step RK method [3, 10].
In the following we assume that the TSRK method satisfies the conditions and that is
[TABLE]
The above condition is an equivalent form of uniform stage order one condition.
The proofs of the Theorems 3.5, 3.6, 3.7 are not difficult but rather technical. We omit them for the sake of brevity.
Theorem 3.5**.**
The TSRK method satisfying (3) has uniform order two iff .
Theorem 3.6**.**
Let the TSRK method satisfy (3) and have uniform order two.
If \ \Gamma_{3}=0\ and
then the method has uniform order three.
Theorem 3.7**.**
Let the TSRK method satisfy (3) and have uniform order three.
[TABLE]
then the method has uniform order four.
Theorem 3.8**.**
*The TSRK method has uniform stage order iff
*
Proof.
It follows from (29). ∎
The following results can be obtained as corollaries of Theorems 3.8 and 3.6, 3.7.
Corollary 3.9**.**
Let the TSRK method have uniform stage order two.
If \ \Gamma_{3}=0\ then the method has uniform order three.
Corollary 3.10**.**
Let the TSRK method have uniform stage order three.
If then the method has uniform order four.
The results of Corollary 3.9 and 3.10 can be easily generalized as follows.
Theorem 3.11**.**
Let the TSRK method have uniform stage order . It has uniform order iff .
4 Construction of explicit TSRK methods of
uniform stage order four and five
Consider a two-stage explicit TSRK method satisfying (3). Its Butcher tableau is
[TABLE]
A natural choice will be to space out the abscissae uniformly in the interval so that [6] . In the case of we have .
Since conditions reduce to that follows from (10c). It also follows that .
For the sake of brevity we omit the argument of the method coefficient functions. By Theorem 3.11, the method has uniform order four and uniform stage order three if
and that is
[TABLE]
where .
The coefficients are defined by
[TABLE]
where remain free. The relation implies that it is impossible to attain discrete order five.
The uniform order and the uniform stage order can be increased by finding a suitable value for . Assume that (in general case ). By theorem (3.11), the method has uniform order five and uniform stage order four if and that is
[TABLE]
where in the first five equations (4) and in other ones.
The coefficients are defined by
[TABLE]
To attain the discrete stage order five, we determine from . We have
[TABLE]
The relation \Gamma_{6}(1)=-{\dfrac{16\ \ \bigl{(}17-2\sqrt{41}\,\bigr{)}}{75\,\bigl{(}71-11\sqrt{41}\,\bigr{)}}\neq 0} implies that it is impossible to attain discrete order six.
So we construct the explicit TSRK method of uniform order five, uniform stage order four and discrete stage order five.
Remark 4.1**.**
There is not a method of uniform stage order two in a class of explicit one-step RK methods for RFDEs.
Indeed, for explicit one-step RK methods and , hence
It is known [8] that methods with low stage order suffer from the order reduction phenomenon when applied to stiff ODEs. Hence, the explicit TSRK methods may be more appropriate for some mildly stiff RFDEs.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] P. Albrecht, Numerical treatment of OD Es: the theory of A-methods, Numer. Math. , 47 (1985), 59–87.
- 2[2] P. Albrecht, A new theoretical approach to Runge-Kutta methods, Numer. Math. , 24 (1987), 391–406.
- 3[3] A. Bellen, N. Guglielmi, S. Maset, M. Zennaro, Recent trends in the numerical solution of retarded functional differential equations, Acta Numerica , 18 (2009), 1-110.
- 4[4] A. Bellen and M. Zennaro, Numerical Methods for Delay Differential Equations, Oxford Univ. Press 2003.
- 5[5] J.C. Butcher, Numerical Methods for Ordinary Differential Equations, John Wiley&Sons, Chichester 2003.
- 6[6] J.C. Butcher and Z. Jackiewicz, Construction of diagonally implicit general linear methods of type 1 and 2 for ordinary differential equations, Applied Numerical Mathematics , 21 (1996), 385–415.
- 7[7] C. Cryer and L. Tavernini, The numerical solution of Volterra functional differential equations by Euler’s method, SIAM J. Numer. Anal. , 9 (1972), 105–129.
- 8[8] K. Dekker and J.G. Verwer, Stability of Runge-Kutta methods for stiff nonlinear differential equations, North-Holland, Amsterdam-New-York-Oxford 1984.
