Necessary optimality conditions for the calculus of variations on time scales
Rui A. C. Ferreira, Delfim F. M. Torres

TL;DR
This paper extends the calculus of variations on time scales by establishing necessary optimality conditions for higher-order delta derivatives and problems with delta-differential constraints, broadening the theoretical framework.
Contribution
It generalizes previous results by deriving necessary conditions for higher-order variational problems and those with delta-differential side conditions on time scales.
Findings
Derived necessary optimality conditions for higher-order delta derivatives.
Established conditions for variational problems with delta-differential constraints.
Extended the calculus of variations framework on time scales.
Abstract
We study more general variational problems on time scales. Previous results are generalized by proving necessary optimality conditions for (i) variational problems involving delta derivatives of more than the first order, and (ii) problems of the calculus of variations with delta-differential side conditions (Lagrange problem of the calculus of variations on time scales).
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNonlinear Differential Equations Analysis · Stability and Controllability of Differential Equations · Differential Equations and Numerical Methods
Necessary optimality conditions
for the calculus of variations on time scales111This work is part of the first author’s PhD project.
Rui A. C. Ferreira
Delfim F. M. Torres
(Department of Mathematics
University of Aveiro
3810-193 Aveiro, Portugal)
Abstract
We study more general variational problems on time scales. Previous results are generalized by proving necessary optimality conditions for (i) variational problems involving delta derivatives of more than the first order, and (ii) problems of the calculus of variations with delta-differential side conditions (Lagrange problem of the calculus of variations on time scales).
Keywords: time scales, -variational calculus, higher-order -derivatives, higher-order Euler-Lagrange -equations, Lagrange problem on time scales, normal and abnormal -extremals.
2000 Mathematics Subject Classification: 49K05, 39A12.
1 Introduction
The theory of time scales is a relatively new area, that unify and generalize difference and differential equations [5]. It was initiated by Stefan Hilger in the nineties of the XX century [7, 8], and is now subject of strong current research in many different fields in which dynamic processes can be described with discrete or continuous models [1].
The calculus of variations on time scales was introduced by Bohner [4] and by Hilscher and Zeidan [9], and appears to have many opportunities for application in economics [2]. In all those works, necessary optimality conditions are only obtained for the basic (simplest) problem of the calculus of variations on time scales: in [2, 4] for the basic problem with fixed endpoints, in [9] for the basic problem with general (jointly varying) endpoints. Having in mind the classical setting (situation when the time scale is either or – see e.g. [6, 14] and [10, 11], respectively), one suspects that the Euler-Lagrange equations in [2, 4, 9] are easily generalized for problems with higher-order delta derivatives. This is not exactly the case, even beginning with the formulation of the problem.
The basic problem of the calculus of variations on time scales is defined (cf. [4, 9], see §2 below for the meaning of the -derivative and -integral) as
[TABLE]
with , a -function for each , and where we are using parentheses around the endpoint conditions as a notation to mean that the conditions may or may not be present: the case with fixed boundary conditions and is studied in [4], for admissible functions belonging to (-continuously -differentiable functions); general boundary conditions of the type , which include the case or free, and over admissible functions in the wider class (piecewise -continuously -differentiable functions), are considered in [9]. One question immediately comes to mind. Why is the basic problem on time scales defined as (1) and not as
[TABLE]
The answer is simple: compared with (2), definition (1) simplifies the Euler-Lagrange equation, in the sense that makes it similar to the classical context. The reader is invited to compare the Euler-Lagrange condition (6) of problem (1) and the Euler-Lagrange condition (13) of problem (2), with the classical expression (on the time scale ):
[TABLE]
It turns out that problems (1) and (2) are equivalent: as far as we are assuming to be -differentiable, then and (i) any problem (1) can be written in the form (2), (ii) any problem (2) can be written in the form (1). We claim, however, that the formulation (2) we are promoting here is more natural and convenient. An advantage of our formulation (2) with respect to (1) is that it makes clear how to generalize the basic problem on time scales to the case of a Lagrangian containing delta derivatives of up to an order , . The higher-order problem will be naturally defined as
[TABLE]
[TABLE]
where , , and (assumptions on the data of the problem will be specified later, in Section 3). One of the new results in this paper is a necessary optimality condition in delta integral form for problem (3) (Theorem 4). It is obtained using the interplay of problems (1) and (2) in order to deal with more general optimal control problems (16).
The paper is organized as follows. In Section 2 we give a brief introduction to time scales and recall the main results of the calculus of variations on this general setting. Our contributions are found in Section 3. We start in §3.1 by proving the Euler-Lagrange equation and transversality conditions (natural boundary conditions – or/and free) for the basic problem (2) (Theorem 2). As a corollary, the Euler-Lagrange equation in [4] and [9] for (1) is obtained. Regarding the natural boundary conditions, the one which appears when is free turns out to be simpler and more close in aspect to the classical condition for problem (1) than to (2)—compare condition (9) for problem (2) with the correspondent condition (14) for problem (1); but the inverse situation happens when is free—compare condition (15) for problem (1) with the correspondent condition (10) for (2), this last being simpler and more close in aspect to the classical expression valid on the time scale . In §3.2 we formulate a more general optimal control problem (16) on time scales, proving respective necessary optimality conditions in Hamiltonian form (Theorem 3). As corollaries, we obtain a Lagrange multiplier rule on time-scales (Corollary 2), and in §3.3 the Euler-Lagrange equation for the problem of the calculus of variations with higher order delta derivatives (Theorem 4). Finally, as an illustrative example, we consider in §4 a discrete time scale and obtain the well-known Euler-Lagrange equation in delta differentiated form.
All the results obtained in this paper can be extended: (i) to nabla derivatives (see [5, §8.4]) with the appropriate modifications and as done in [2] for the simplest functional; (ii) to more general classes of admissible functions and to problems with more general boundary conditions, as done in [9] for the simplest functional of the calculus of variations on time scales.
2 Time scales and previous results
We begin by recalling the main definitions and properties of time scales (cf. [1, 5, 7, 8] and references therein).
A nonempty closed subset of is called a Time Scale and is denoted by .
The forward jump operator is defined by
[TABLE]
while the backward jump operator is defined by
[TABLE]
with (i.e., if has a maximum ) and (i.e., if has a minimum ).
A point is called right-dense, right-scattered, left-dense and left-scattered if , , and , respectively.
Throughout the text we let with and a time scale. We define , and more generally , for . The following standard notation is used for (and ): , , .
The graininess function is defined by
[TABLE]
We say that a function is delta differentiable at if there is a number such that for all there exists a neighborhood of (i.e., for some ) such that
[TABLE]
We call the delta derivative of at .
Now, we define the delta derivative () of to be the function , provided is delta differentiable on .
For delta differentiable and , the next formulas hold:
[TABLE]
where we abbreviate by .
Next, a function is called rd-continuous if it is continuous at right-dense points and if its left-sided limit exists at left-dense points. We denote the set of all rd-continuous functions by C or C and the set of all delta differentiable functions with rd-continuous derivative by C or C.
It is known that rd-continuous functions possess an antiderivative, i.e., there exists a function with , and in this case an integral is defined by . It satisfies
[TABLE]
We now present some useful properties of the delta integral:
Lemma 1**.**
If and C, then
. 2. 2.
.
The main result of the calculus of variations on time scales is given by the following necessary optimality condition for problem (1).
Theorem 1** ([4]).**
If is a weak local minimizer (cf. §3) of the problem
[TABLE]
then the Euler-Lagrange equation
[TABLE]
holds.
Main ingredients to prove Theorem 1 are item 1 of Lemma 1 and the Dubois-Reymond lemma:
Lemma 2** ([4]).**
Let , . Then,
[TABLE]
if and only if
[TABLE]
3 Main results
Assume that the Lagrangian () is a function of for each . Let , where
[TABLE]
We want to minimize the functional of problem (3). For this, we say that is a weak local minimizer for the variational problem (3) provided there exists such that for all satisfying the constraints in (3) and , where
[TABLE]
with and .
3.1 The basic problem on time scales
We start by proving the necessary optimality condition for the simplest variational problem ():
[TABLE]
Remark 1*.*
We are assuming in problem (7) that the time scale has at least 3 points. Indeed, for the delta-integral to be defined we need at least 2 points. Assume that the time scale has only two points: , with . Then, . In the case both and are fixed, since , then would be a constant for every admissible function (there would be nothing to minimize and problem (7) would be trivial). Similarly, for (3) we assume the time scale to have at least points (see Remark 15).
Theorem 2**.**
If is a weak local minimizer of (7) (problem (3) with ), then the Euler-Lagrange equation in -integral form
[TABLE]
holds and some . Moreover, if the initial condition is not present ( is free), then the supplementary condition
[TABLE]
holds; if is not present ( is free), then
[TABLE]
Remark 2*.*
For the time scale equalities (9) and (10) give, respectively, the well-known natural boundary conditions and .
Proof.
Suppose that is a weak local minimizer of . Let C and define by
[TABLE]
This function has a minimum at , so we must have . Applying the delta-integral properties and the integration by parts formula 2 (second item in Lemma 1), we have
[TABLE]
Let us limit the set of all delta-differentiable functions with -continuous derivatives to those which satisfy the condition (this condition is satisfied by all the admissible variations in the case both and are fixed). For these functions we have
[TABLE]
Therefore, by the lemma of Dubois-Reymond (Lemma 2), there exists a constant such that (8) holds:
[TABLE]
for all . Because of (12), condition (11) simplifies to
[TABLE]
for any admissible . If is not present in problem (7) (so that need not to be zero), taking we find that ; if is not present, taking we find that . Applying these two conditions to (12) and having in mind formula (5), we may state that
[TABLE]
and (note that )
[TABLE]
∎
Remark 3*.*
Since , we must have
[TABLE]
by formula (5). Delta differentiating both sides, we obtain
[TABLE]
Note that we can’t expand the left hand side of this last equation, because we are not assuming that is delta differentiable. In fact, generally is not delta differentiable (see example 1.55, page 21 of [5]). We say that (13) is the Euler-Lagrange equation for problem (7) in the delta differentiated form.
As mentioned in the introduction, the formulations of the problems of the calculus of variations on time scales with “” and with “” are equivalent. It is trivial to derive previous Euler-Lagrange equation (6) from our equation (13) and the other way around (one can derive (13) directly from (6)).
Corollary 1**.**
If is a weak local minimizer of
[TABLE]
then the Euler-Lagrange equation (6) holds. If is free, then the extra transversality condition (natural boundary condition)
[TABLE]
holds; if is free, then
[TABLE]
Proof.
Since is delta differentiable, then (4) holds. This permits us to write
[TABLE]
Applying equation (13) to the functional we obtain
[TABLE]
But
[TABLE]
and the result follows. ∎
3.2 The Lagrange problem on time scales
Now we consider a more general variational problem with delta-differential side conditions:
[TABLE]
where , , and for all , and . We assume and to be -functions of and for each ; and that for each control function there exists a correspondent solution of the -differential equation . We remark that conditions for existence or uniqueness are available for OE’s from the very beginning of the theory of time scales (see [8, Theorem 8]). Roughly speaking, forward solutions exist, while existence of backward solutions needs extra assumptions (e.g. regressivity). In control theory, however, one usually needs only forward solutions, so we do not need to impose such extra assumptions [3].
We are interested to find necessary conditions for a pair to be a weak local minimizer of .
Definition 1**.**
Take an admissible pair . We say that is a weak local minimizer for (16) if there exist such that for all admissible pairs satisfying .
Remark 4*.*
Problem (16) is very general and includes: (i) problem (7) (this is the particular case where and ), (ii) the problem of the calculus of variations with higher-order delta derivatives (3) (such problem receive special attention in Section 3.3 below), (iii) isoperimetric problems on time scales. Suppose that the isoperimetric condition
[TABLE]
a given constant, is prescribed. We can introduce a new state variable defined by
[TABLE]
with boundary conditions and . Then
[TABLE]
and we can always recast an isoperimetric problem as a Lagrange problem (16).
To establish necessary optimality conditions for (16) is more complicated than for the basic problem of the calculus of variations on time scales (1) or (2), owing to the possibility of existence of abnormal extremals (Definition 2). The abnormal case never occurs for the basic problem (Proposition 2).
Theorem 3** (The weak maximum principle on time scales).**
If is a weak local minimizer of problem (16), then there exists a set of multipliers , where is a nonnegative constant and is a delta differentiable function on , such that satisfy
[TABLE]
for all , where the Hamiltonian function is defined by
[TABLE]
If is free in (16), then
[TABLE]
if is free in (16), then
[TABLE]
Remark 5*.*
From the definition (20) of , it follows immediately that (17) holds true for any admissible pair of problem (16). Indeed, condition (17) is nothing more than the control system .
Remark 6*.*
For the time scale , (17)-(19) reduce to well-known conditions in discrete time (see e.g. [13, Ch. 8]): the -dynamic equation for takes the form ; the -dynamic equation for gives ; and the -stationary condition reads as ; with the Hamiltonian . For , Theorem 3 is known in the literature as Hestenes necessary condition, which is a particular case of the Pontryagin Maximum Principle [12].
Corollary 2** (Lagrange multiplier rule on time scales).**
If is a weak local minimizer of problem (16), then there exists a collection of multipliers , a nonnegative constant and a delta differentiable function on , not all vanishing, such that satisfy the Euler-Lagrange equation of the augmented functional :
[TABLE]
Proof.
The Euler-Lagrange equations (13) and (6) applied to (23) give
[TABLE]
that is,
[TABLE]
where the partial derivatives of are evaluated at . Obviously, from (19) we obtain (25). It remains to prove that (18) implies (24) along . Indeed, from (18) we can write , which is equivalent to . ∎
Remark 7*.*
Condition (18) or (24) imply that along the minimizer
[TABLE]
for some .
Remark 8*.*
The assertion in Theorem 3 that the multipliers cannot be all zero is crucial. Indeed, without this requirement, for any admissible pair of (16) there would always exist a set of multipliers satisfying (18)-(19) (namely, and ).
Remark 9*.*
Along all the work we consider as a row-vector.
Remark 10*.*
If the multipliers satisfy the conditions of Theorem 3, then also do, for any . This simple observation allow us to conclude that it is enough to consider two cases: or .
Definition 2**.**
An admissible quadruple satisfying conditions (17)-(19) (also (21) or (22) if or are, respectively, free) is called an extremal for problem (16). An extremal is said to be normal if and abnormal if .
So, Theorem 3 asserts that every minimizer is an extremal.
Proposition 1**.**
The Lagrange problem on time scales (16) has no abnormal extremals (in particular, all the minimizers are normal) when at least one of the boundary conditions or is absent (when or is free).
Proof.
Without loss of generality, let us consider free. We want to prove that the nonnegative constant is nonzero. The fact that follows from Theorem 3. Indeed, the multipliers and cannot vanish simultaneously at any point of . As far as is free, the solution to the problem must satisfy the condition . The condition requires a nonzero value for at . But since is a nonnegative constant, we conclude that is positive, and we can normalize it (Remark 10) to unity. ∎
Remark 11*.*
In the general situation abnormal extremals may occur. More precisely (see proof of Theorem 3), abnormality is characterized by the existence of a nontrivial solution for the system .
Proposition 2**.**
There are no abnormal extremals for problem (7), even in the case and are both fixed (, ).
Proof.
Problem (7) is the particular case of (16) with . If , then the Hamiltonian (20) takes the form . From Theorem 3, and , for all . Since , this means that and would be both zero, which is not a possibility. ∎
Corollary 3**.**
For problem (7), Theorem 3 gives Theorem 2.
Proof.
For problem (7) we have . From Proposition 2, the Hamiltonian becomes . By the -stationary condition (19) we may write . Now apply (26) and the result follows. ∎
To prove Theorem 3 we need the following result:
Lemma 3** (Fundamental lemma of the calculus of variations on time scales).**
Let , . Then,
[TABLE]
if and only if
[TABLE]
Proof.
If on , then obviously , for all .
Now, suppose (without loss of generality) that for some . We will divide the proof in two steps:
Step 1: Assume that is right scattered. Define in
[TABLE]
Then is rd-continuous and
[TABLE]
which is a contradiction.
Step 2: Suppose that is right dense. Since is rd-continuous, then it is continuous at . So there exist such that for all we have .
If is left-dense, define in
[TABLE]
It follows that is rd-continuous and
[TABLE]
which is a contradiction.
If is left-scattered, define in
[TABLE]
where . We have: is rd-continuous and
[TABLE]
that again leads us to a contradiction. ∎
Proof.
(of Theorem 3) We begin by noting that in problem (16), , are arbitrarily specified functions (controls). Once fixed , then , , is determined from the system of delta-differential equations (and boundary conditions, if present). As far as is an arbitrary function, variations for can also be considered arbitrary. This is not true, however, for the variations C of . Suppose that is a weak local minimizer of . Let be a small real parameter and (with if is given; if is given) be the trajectory generated by the control , :
[TABLE]
, , . We define the following function:
[TABLE]
It follows that has a minimum for , so we must have . From this condition we can write that
[TABLE]
for any real constant . Differentiating (27) with respect to , we get
[TABLE]
In particular, with ,
[TABLE]
Let C be (yet) an unspecified function. Multiplying (29) by , and delta-integrating the result with respect to from to , we get that
[TABLE]
for any . Integrating by parts (see Lemma 1, formula 1),
[TABLE]
and we can write from (28), (30) and (31) that
[TABLE]
hold for any . Using the definition (20) of , we can rewrite (32) as
[TABLE]
It is, however, not possible to employ (yet) Lemma 3 due to the fact that the variations are not arbitrary. Now choose so that the coefficient of in (33) vanishes: (and if is free, i.e. ; if is free, i.e. ). In the normal case is determined by , and we choose . The abnormal case is characterized by the existence of a non-trivial solution for the system : in that case we choose in order to the first coefficient of in (32) or (33) to vanish. Given this choice of the multipliers, the necessary optimality condition (33) takes the form
[TABLE]
Since can be arbitrarily assigned for all , it follows from Lemma 3 that . ∎
3.3 The higher-order problem on time scales
As a corollary of Theorem 3 we obtain the Euler-Lagrange equation for problem (3). We first introduce some notation:
[TABLE]
Theorem 4**.**
If is a weak local minimizer for the higher-order problem (3), then
[TABLE]
holds for all , where and is defined recursively by
[TABLE]
with , , constants. If is free in (3) for some , , then the correspondent condition holds.
Remark 12*.*
From (34), (35) and (36) it follows that
[TABLE]
where means that the constant is free from the composition of the integrals when (for simplicity, we have omitted the arguments in and ).
Remark 13*.*
If we delta differentiate (37) times, we obtain the delta differentiated equation for the problem of the calculus of variations with higher order delta derivatives. However, as observed in Remark 3, one can only expand formula (37) under suitable conditions of delta differentiability of .
Remark 14*.*
For the particular case with , equation (8) is (37) with .
Proposition 3**.**
The higher-order problem on time scales (3) does not admit abnormal extremals, even when the boundary conditions and , , are all fixed.
Remark 15*.*
We require the time scale to have at least points. Let us consider problem (3) with all the boundary conditions fixed. Due to the fact that we have delta derivatives, the boundary conditions and for all , imply that we must have at least points in order to have the problem well defined. If we had only this number of points, then the time scale could be written as and
[TABLE]
where we have used the fact that . Now, having in mind the boundary conditions and the formula
[TABLE]
we can conclude that the sum in (38) would be constant for every admissible function and we wouldn’t have nothing to minimize.
The following technical result is used in the proof of Proposition 3.
Lemma 4**.**
Suppose that a function is such that for all . Then, for all if is right-scattered.
Proof.
First note that, since , then is delta differentiable, hence continuous for all . Now, if is right-dense, the result is obvious. Suppose that is right-scattered. We will analyze two cases: (i) if is left-scattered, then and by hypothesis ; (ii) if is left-dense, then , by the continuity of . The proof is done. ∎
Proof.
(of Proposition 3) Suppose that . With the notation (40) introduced below, the higher order problem (3) would have the abnormal Hamiltonian given by
[TABLE]
(compare with the normal Hamiltonian (41)). From Theorem 3, we can write the system of equations:
[TABLE]
for all , where we are using the notation , . From the last equation, and in view of Lemma 4, we have , if is right-scattered. This implies that , and consequently , . Like we did before, , if is right-scattered. Repeating this procedure, we will finally have , if is right-scattered for all . Now, the first and second equations in the system (39) imply that
[TABLE]
We pick again the first equation to point out that , and some constant . Since the time scale has at least points (Remark 15), the set is nonempty and therefore . Substituting this in the second equation, we get . As before, it follows that , and some constant . But we have seen that there exists some such that , hence , . Repeating this procedure, we conclude that for all , at . This is in contradiction with Theorem 3 and we conclude that . ∎
Proof.
(of Theorem 4) Denoting , then problem (3) takes the following form:
[TABLE]
[TABLE]
System (40) can be written in the form , where
[TABLE]
and the matrices ( by ) and ( by ) are
[TABLE]
in which denotes the by identity matrix, and [math] the by zero matrix. From Proposition 3 we can fix : problem (40) is a particular case of (16) with the Hamiltonian given by
[TABLE]
[TABLE]
respectively. Equation (43) is equivalent to (34), and from (42) we get (35)-(36). ∎
4 An example
We end with an application of our higher-order Euler-Lagrange equation (37) to the time scale , that leads us to the usual and well-known discrete-time Euler-Lagrange equation (in delta differentiated form) – see e.g. [11]. Note that we have and . In particular, we conclude immediately that is times delta differentiable. Also for any function , exists (see Theorem 1.16 (ii) of [5]) and is the usual forward difference operator (obviously exists and more generally exists , ).
Now, for any function and for any we have
[TABLE]
where stands for . To see this we proceed by induction. For
[TABLE]
and then . Assuming that (44) is true for all , then
[TABLE]
Delta differentiating times both sides of equation (37) and in view of (44), we obtain the Euler-Lagrange equation in delta differentiated form (remember that , , , ):
[TABLE]
5 Conclusion
We introduce a new perspective to the calculus of variations on time scales. In all the previous works [2, 4, 9] on the subject, it is not mentioned the motivation for having (or ) in the formulation of problem (1). We claim the formulation (2) without (or ) to be more natural and convenient. One advantage of the approach we are promoting is that it becomes clear how to generalize the simplest functional of the calculus of variations on time scales to problems with higher-order delta derivatives. We also note that the Euler-Lagrange equation in -integral form (8), for a Lagrangian with instead of , follows close the classical condition. Main results of the paper include: necessary optimality conditions for the Lagrange problem of the calculus of variations on time scales, covering both normal and abnormal minimizers; necessary optimality conditions for problems with higher-order delta derivatives. Much remains to be done in the calculus of variations and optimal control on time scales. We trust that our perspective provides interesting insights and opens new possibilities for further investigations.
Acknowledgments
This work was partially supported by the Portuguese Foundation for Science and Technology (FCT), through the Control Theory Group (cotg) of the Centre for Research on Optimization and Control (CEOC – http://ceoc.mat.ua.pt). The authors are grateful to M. Bohner and S. Hilger for useful and stimulating comments, and for them to have shared their expertise on time scales.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] R. Agarwal, M. Bohner, D. O’Regan, A. Peterson. Dynamic equations on time scales: a survey , J. Comput. Appl. Math. 141 (2002), no. 1-2, 1–26.
- 2[2] F. M. Atici, D. C. Biles, A. Lebedinsky. An application of time scales to economics , Math. Comput. Modelling 43 (2006), no. 7-8, 718–726.
- 3[3] Z. Bartosiewicz, E. Pawłuszewicz. Realizations of linear control systems on time scales , Control Cybernet. 35 (2006), no. 4 (in press)
- 4[4] M. Bohner. Calculus of variations on time scales , Dynam. Systems Appl. 13 (2004), no. 3-4, 339–349.
- 5[5] M. Bohner, A. C. Peterson. Dynamic equations on time scales: an introduction with applications , Birkhäuser Boston, Inc., Boston, MA, 2001.
- 6[6] I. M. Gelfand, S. V. Fomin. Calculus of variations , Dover, New York, 2000.
- 7[7] S. Hilger. Analysis on measure chains—a unified approach to continuous and discrete calculus , Results Math. 35 (1990), 18–56.
- 8[8] S. Hilger. Differential and difference calculus—unified! , Proceedings of the Second World Congress of Nonlinear Analysts, Part 5 (Athens, 1996). Nonlinear Anal. 30 (1997), no. 5, 2683–2694.
