Interval optimization problems on Hadamard manifolds:Solvability and Duality
Le Tram Nguyen, Yu-Lin Chang, Chu-Chin Hu, Jein-Shan Chen

TL;DR
This paper investigates the solvability and duality properties of interval optimization problems on Hadamard manifolds, providing conditions and dual formulations that extend understanding in non-Euclidean optimization contexts.
Contribution
It introduces new solvability criteria and duality results, including KKT conditions and Wolfe duality, for interval optimization on Hadamard manifolds.
Findings
KKT conditions established for interval optimization on Hadamard manifolds
Wolfe dual problem formulated with weak and strong duality
Results extend the solvability theory in non-Euclidean spaces
Abstract
In this paper, we will study about the solvability and duality of interval optimization problems on Hadamard manifolds. It includes the KKT conditions, and Wofle dual problem with weak duality and strong duality. These results are the complement for the solvability of interval optimization problems on Hadamard manifolds.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNumerical Methods and Algorithms · Polynomial and algebraic computation
Interval optimization problems on Hadamard manifolds: Solvability and Duality
Le Tram Nguyen 111E-mail: [email protected].
Faculty of Mathemactics,
The University of Da Nang
- University of Science and Education
and
Department of Mathematics
National Taiwan Normal University
Taipei 11677, Taiwan
Yu-Lin Chang 222E-mail: [email protected].
Department of Mathematics
National Taiwan Normal University
Taipei 11677, Taiwan
Chu-Chin Hu 333E-mail: [email protected].
Department of Mathematics
National Taiwan Normal University
Taipei 11677, Taiwan
Jein-Shan Chen 444Corresponding author. E-mail: [email protected]. The research is supported by Ministry of Science and Technology, Taiwan.
Department of Mathematics
National Taiwan Normal University
Taipei 11677, Taiwan
October 12, 2022.
Abstract. In this paper, we will study about the solvability and duality for interval optimization problems on Hadamard manifolds. It include the KKT conditions, Wofle dual problem with weak duality and strong duality. These results are the complement for the solvability of interval optimization problems on Hadamard manifolds.
Keywords. Hadamard manifold, interval valued function, duality, set valued function on manifold, -directional derivative, KKT condition.
1 Introduction
Optimization problems have a lot applications in many research fields. Due to the image of objective functions, we have different types of problems: desterministic problems, stochastic problems, or interval problems. The last type of problem mean the value of objective functions are closed interval in . In addition, because the variation bound of the uncertain variables can be obtained only through small amount of uncertainly information, the interval programming can easily handle some optimization problems. See [19, 11] for more information.
A Riemannian manifold has no linear structure, in fact, it is locally identified with Euclidean space. In this setting, the Euclidean metric is replaced by Riemannian metric and the line segments are replaced by minimal geodesics. Then, the Riemannian optimization problem is, at least locally, equivalent to the smoothly constrained optimization problem on Euclidean space. And solving nonconvex constrained problem on may be equivalent to solving the convex uncostrained problem on Riemannian manifold.
There are so many optimization problems, which can not be solved on Euclidean space and require the Hadamard manifolds structure. For example, in engineering (see [3]), in controlles themornuclear fusion research (see [11]). Recently, there are some types and methods of optimization problem have been extended from to Riemannian manifolds, particularly to Hadamard manifolds [1, 8, 4, 5, 9, 17, 7].
Consider the primal problem as
[TABLE]
where are given functions.
The Lagrange function is defined as .
And the dual function , we have the Lagrange dual problem
[TABLE]
However, in the case of interval valued function, does not exist.
Suppose are convex, diffirentiable functions. We have the Wolfe dual problem
[TABLE]
Wu (see [29]) presented about Wofle duality for interval valued optimization problems (IOPs) based on -difference and -derivative. However, -difference does not exist for all pair of intervals. It means the class of -differentiable interval valued function is very small. In this paper, besides the extendtion of IOPs to Riemannian interval valued optimization problems (RIOPs), we also use the general Hukuhara difference (-difference) and -diffirentibility of interval valued functions on Hadamard manifolds to study about RIOPs and its dual problems. The KKT conditions of RIOPs will be studied. It is more general then the concept in [9] since the constraint is defined by the interval valued functions.
2 Premilinaries
In this section, we will recall some knowlege about interval, computing and the oder on the set of all intervals. The basic information about Riemannian manifolds, particularly the Hadamard manifolds, is necessary for the convinience of reader. Riemannian interval value functions (RIVF) and their properties are also important for the next sections.
Following the notations used in [11], let be the set of all closed, bounded interval in , i.e.,
[TABLE]
The Hausdorff metric on is defined by
[TABLE]
Then, is a complete metric space, see [20]. The Minkowski sum and scalar multiplications is given respectively by
[TABLE]
where , . Note that, . A crucial concept in achieving a useful working definition of derivative for interval valued functions is trying to derive a suitable difference between two intervals.
Definition 2.1** (-difference of intervals [24]).**
Let . The -difference between and is defined as the interval such that
[TABLE]
Proposition 2.1**.**
[24]** For any two intervals , , the -difference always exists and
[TABLE]
Proposition 2.2**.**
[20]** Suppose that . Then, the following properties hold.
(a)
* if and only if .*
(b)
, for all .
(c)
.
(d)
.
(e)
.
(f)
.
Notice that, for all , we define , then is a norm on and .
There is no natural ordering on , therefore we need to define it.
Definition 2.2**.**
[29] Let and be two elements of . We write if and . We write if and . Equivalently, if and only if one of the following cases holds:
- •
and .
- •
and .
- •
and .
We write, if none of the above three cases hold. If neither nor , we say that none of and dominates the other.
Let and be two sets of closed intervals. We write if and only if for any and .
Lemma 2.1**.**
For any elements and of , there hold
(a)
.
(b)
.
(c)
.
(d)
If then .
(e)
.
Proof. The proofs of (a), (b), (c) can be found in [22]
(d) We have , and
[TABLE]
[TABLE]
Then, .
(e), Assume , we will proof that
[TABLE]
Infact,
[TABLE]
Otherwise, we can easily to see that
[TABLE]
Hence, we have
[TABLE]
Before study about Riemannian interval valued functions, we need some basic knowlege about Riemannian manifold, which can be found in some textbooks about Riemannian geometry, such as [23, 12, 18] and the reference therein. Let be a Riemannian manifold, we denote by the tangent space of at , and the tangent bundle of is denoted by . For every , the Riemannian distance on is defined by the minimal length over the set of all piecewise smooth curves joining to . Let is the Levi-Civita connection on Riemannian manifold , is a smooth curve on , a vector field is called parallel along if , where . We say that is a geodesic if is parallel along itself, in this cases is constant. When is said to be normalized. A geodesic joining to in is called minimal if its length equals .
For any , let be a neighborhood of , the exponential mapping is defined by where is the geodesic such that and . It is known that the derivative of at is the identity map; furthermore, by the Inverse Theorem, it is a local diffeomorphism. The inverse map of is denoted by . A Riemannian manifold is complete if for any , the exponential map is defined on . A simply connected, complete Riemannian manifold of nonpositive sectional curvature is called a Hadamard manifold. If is a Hadamard manifold, for all , by the Hopf-Rinow Theorem and Cartan-Hadamard Theorem (see [18]), is a diffeomorphism and there exists a unique normalized geodesic joining to , which is indeed a minimal geodesic.
Let be a nonempty set, a mapping is called a Riemannian interval valued function (RIVF). We write where are real valued functions satisfy , for all . Since is a Hadamard manifold, an interval valued function (IVF) is also a RIVF. Furthermore, since , then a Riemannian real valued function is also a RIVF.
Definition 2.3**.**
[28] Let be a convex set. An IVF is said to be convex on if
[TABLE]
for all and .
Definition 2.4**.**
[15] Let be a nonempty set. An IVF is said to be monotonically increasing if for all there has
[TABLE]
The function is said to be monotonically decreasing if for all there has
[TABLE]
It is clear to see that if an IVF is monotonically increasing (or monotonically decreasing), if and only if both the real valued functions and are monotonically increasing (or monotonically decreasing).
Definition 2.5**.**
[15] Let be a nonempty set. A RIVF is said to be bounded below on if there exists an interval such that
[TABLE]
The function is said to be bounded above on if there exists an interval such that
[TABLE]
The function is said to be bounded if it is both bounded below and above.
It is easy to verify that if a RIVF is bounded below (or bounded above) if and only if both the real-valued functions and are bounded below (or bounded above).
Definition 2.6**.**
[22] Let be a geodesically convex set and be a RIVF. is called geodesically convex on if
[TABLE]
where is the minimal geodesic joining and .
Definition 2.7**.**
A RIVF is called geodesically concave if is geodesically convex.
Proposition 2.3**.**
[22]** Let be a geodesically convex subset of and be a RIVF on . Then, is geodesically convex on if and only if and are geodesically convex on .
Proposition 2.4**.**
[22]** The RIVF is geodesically convex if and only if for all and is the minimal geodesic joining and , the IVF is convex on .
Lemma 2.2**.**
[22]** If is a geodesically convex RIVF on and is an interval, then the sublevel set
[TABLE]
is a geodesically convex subset of .
Definition 2.8**.**
[22] Let be a RIVF, . We say if for every , there exists such that, for all and , there holds .
Lemma 2.3**.**
[22]** Let be a RIVF, . Then,
[TABLE]
Definition 2.9** (-continuity).**
[22] Let be a RIVF on a nonempty open subset of , . The function is said to be -continuous at if for all with , there has
[TABLE]
We call is -continuous on if is -continuous at every .
Remark 2.1**.**
We point out couple remarks regarding -continuity.
When , become an IVF and . In other words, Definition 2.9 generalizes the concept of the -continuity of the IVF setting, see [14]. 2. 2.
By Lemma 3.1 and Remark 3.1, we can see that is -continuous if and only if and are continuous.
Theorem 2.1**.**
[22]** Let be a geodesically convex set with nonempty interior and be a geodesically convex RIVF. Then, is -continuous on .
Definition 2.10**.**
[21] Let be a nonempty open set and consider a function . We say that has directional derivative at in the direction if the limit
[TABLE]
exists, where is called the directional derivative of at in the direction . If has directional derivative at in every direction , we say that is directional differentiable at .
Definition 2.11** (-directional differentiability [9]).**
Let be a RIVF on a nonempty open subset of . The function is said to have -directional derivative at in direction , if there exists a closed bounded interval such that the limits
[TABLE]
exists, where is called the -directional derivative of at in the direction of . If has -directional derivative at in every direction , we say that is -directional differentiable at .
Lemma 2.4**.**
[9]** Let be a nonempty open set and consider a RIVF . Then, has -directional derivative at in the direction if and only if and have directional derivative at in the direction . Furthermore, we have
[TABLE]
where and are the directional derivatives of and at in the direction , respectively.
Remark 2.2**.**
Let be a nonempty open set and consider RIVFs . If, and have -directional derivative at in the direction then
. 2. 2.
In general, .
Theorem 2.2**.**
[22]** Let be a nonempty open geodesically convex set. If is a geodesically convex RIVF, then at any , -directional derivative exists for every direction .
Theorem 2.3**.**
[22]** Let be a -directional differentiable RIVF. If is geodesically convex on , then
[TABLE]
Corollary 2.1**.**
[22]** Let be nonempty open geodesically convex set and suppose that the RIVF is -directional differentiable on . If is geodesically convex on , then
[TABLE]
Corollary 2.2**.**
Let be a -directional differentiable RIVF. If is geodesically concave on , then
[TABLE]
Proof.
Since is geodesically concave on , then is geodesically convex on , for all
[TABLE]
Hence, by Lemma 2.1(e), we have
[TABLE]
3 Sovability
Consider the Riemannian interval optimization problem (RIOP)
[TABLE]
where are RIVF. We denote by
[TABLE]
the feasible set of RIOP (1). We also denote by
[TABLE]
the set of all objective value of RIOP (1).
Definition 3.1**.**
[22] Consider problem (1). A feasible point is said to be an efficient point of RIOP (1) if for all feasible point . In this case, is called efficient objective value of RIOP (1). We denote by the set of all efficient objective values of RIOP (1).
Proposition 3.1**.**
[22]** Consider the RIOP (1) with and is the feasible set. Given any , if is an optimal solution of the following problem
[TABLE]
then, is an efficient point of RIOP (1).
The constraint eqivalent to . Since the objective function , we can consider two corresponding scalar problem for (1) as follows:
[TABLE]
and
[TABLE]
Proposition 3.2**.**
[22]** Consider problem (1) and the corresponding scalar problems (2) and (3). The followings hold:
(a)
If is an optimal solution of problems (2) and (3) simultaneously , then is an efficient point of the RIOP (1).
(b)
If is an unique optimal solution of problems (2) or (3) , then is an efficient point of the RIOP (1).
One of impotant conditions for optimization problems is Karush–Kuhn–Tucker (KKT) condition. The next part of this section, we will derive the KKT condition for RIOP (1). At first, we will give the KKT condition for the following real valued optimization on Hadamard manifolds (ROP)
[TABLE]
where . Let be the set of feasible point to ROP (4).
Theorem 3.1**.**
[9]** Consider the ROP (4). Let . Suppose are geodesically convex on and directional differentiable at . Furthermore, for every feasible point , there exist scalars , such that
[TABLE]
Then is an optimal solution of ROP (4).
Theorem 3.2**.**
Consider the RIOP (1). Let . Suppose are geodesically convex on . Furthermore, for any feasible point , there exist scalars , such that
[TABLE]
Then, is an efficient point of RIPO (1).
Proof. Follow Proposition (2.3) and Lemma (2.4), the geodesically convex and -directional differentiable properties of are eqivalent with the geodesically convex and directional differentiable properties of , respectively. Then, by the assumption of Theorem 3.2, the assumption of Theorem 3.1 are hold for the URIOP (3) and LRIOP (2). It mean is an optimal solution of problems (2) and (3) simultaneously. By Proposition 3.2, we have is an efficient point of RIOP (1).
Example 3.1**.**
Let be endowed with the Riemannian metric given by
[TABLE]
Then, it is known that is a Hadamard manifold. For all , , the geodesic such that is described by
[TABLE]
We consider the RIOP as below
[TABLE]
where is defined by
[TABLE]
We have then the feasible set of above problem is .
By the Cauchy-Schwarz inequality, for all , we have
and ,
then
.
We also have , then is an efficient point of the RIOP.
Other hand we have
[TABLE]
[TABLE]
for all .
Therefore
By Example 3.1, we see that, Theorem 3.2 is only the sufficient condition.
Theorem 3.3**.**
Under the same assumption of Theorem 3.2. If for any feasible point , there exist scalar and , such that
[TABLE]
Then, is an efficient point of RIOP (1).
Proof. Consider the Riemannian real valued problem
[TABLE]
Then, by the condition (5) and Theorem (3.1), is an efficient point of the above problem. Since , then and . This implies that . By Proposition (3.1), we have is an efficient point of RIOP (1).
Theorem 3.4**.**
Under the same assumption of Theorem 3.2. If for any feasible point , there exist scalar , such that
[TABLE]
Then, is an efficient point of RIOP (1).
Proof. By the assumption of Theorem, we have
[TABLE]
Hence, by Theorem (3.2) we have, is an efficient point of RIOP (1).
Example 3.2**.**
Let with standard metric. Then is a flat Hadamard manifold. We consider the RIOP as below
[TABLE]
where .
It is easy to see that the feasible point set is . At , for all , we have
[TABLE]
[TABLE]
Therefore, with , we have
[TABLE]
Hence, is a feasible point of this problem.
We refer to the RIOP (1) as the primal problem and we denote by the set of optimal values of (1). We define the interval valued Langrangian function for the primal problem RIOP (1) as follows:
[TABLE]
for all and for all .
Definition 3.2**.**
A vector is said to be a Lagrange multiplier for the primal problem RIOP (1) if
[TABLE]
and
[TABLE]
Proposition 3.3**.**
Let be a Lagrange multiplier of the primal problem RIOP (1). Then, is an efficient of the primal problem (1) if and only if is feasible and
[TABLE]
Proof. If is an efficient of the primal problem (1) then is feasible. Since is a Lagrange multiplier then
[TABLE]
Hence
[TABLE]
It implies that
[TABLE]
Since and then .
Conversely, if is feasible and (6) holds then
[TABLE]
then is an efficient of the primal problem (1).
4 Wolfe duality for interval optimization problems on Hadamard manifolds
Consider the primal problem (1). In this section, we assume further that are geodesically convex and -directional differentiable on . Then, we write
[TABLE]
Note that, in general.
We consider the Wolfe dual problem (WRIOPD) of primal problem (1) as follows:
[TABLE]
Denote by
[TABLE]
the set of all feasible points of WRIOPD. We also denote by
[TABLE]
the set of all objective values of Wolfe dual problem (7).
Definition 4.1**.**
is said to be an efficient point of WRIOPD (7) if
[TABLE]
Proposition 4.1**.**
Let be an open geodesically convex set. Assume be the feasible point of RIOP (1) and WRIOPD (7), respectively. If are geodesically convex on then .
Proof. Let , we will proof that if then . Indeed
[TABLE]
If there exists such that then, . Which is contradict with (8). Hence, .
Since is a feasible point of WRIOPD (7) then for some we have
[TABLE]
is geodesically convex RIVF on then by Proposition 2.3 are geodesically convex RIFs on , we have
[TABLE]
Since is geodesically convex and then
[TABLE]
Hence, from (4)-(10), we obtained
[TABLE]
Similar, we also have
[TABLE]
Hence, .
Corollary 4.1** (Solvability).**
Let be a nonempty open geodesically convex set. Let be geodesically convex and -differentiable on . Assume that is a feasible point of primal problem (1) and is a feasible point of dual problem (7). If , then are efficient points of primal problem (1) and dual problem (7), respectively.
Proof. By Proposition 4.1, we have
[TABLE]
for all feasible point of primal problem (1), which says that is an efficient point of (1).
On the other hand, for all feasible point of dual problem (7), we have
[TABLE]
or is an efficient point of (7).
Corollary 4.2** (Weak Duality ).**
Consider the primal problem (1), and the Duality problem (7). Assume that be an nonempty open geodesically convex set and be geodesically convex and -differentiable on . Then, we have
[TABLE]
Proof. The result follows immediately from Proposition 4.1.
Similar as [29], we have the definition of the no duality gap.
Definition 4.2**.**
We say that the primal problem (1) and the dual problem (7) have no duality gap in the weak sense if and only if . 2. 2.
We say that the primal problem (1) and the dual problem (7) have no duality gap in the strong sense if and only if there exist such that , and .
From definition 4.2 and Proposition 4.1 we have some results.
Theorem 4.1** (Strong Duality 1).**
Let be a nonempty open geodesically convex set and be geodesically convex and -differentiable interval valued functions on . If one of the following conditions is satisfied
- •
there exist a feasible point of the primal problem (1) such that ,
- •
there exist a feasible point of the dual problem (7) such that .
Then the primal problem (1) and the dual problem (7) have no gap in the weak sence.
Theorem 4.2** (Strong Duality 2).**
Let be a nonempty open geodesically convex set and be geodesically convex and -differentiable interval valued functions on . Suppose that, there exist such that are feasible points of the primal problem (1) and the dual problem (7), respectively. Futhermore,
**
Then the primal problem (1) and the dual problem (7) have no gap in the strong sence.
5 Conclusions
In this paper, we have considered the Wofle duality for interval optimization problems on Hadamard manifolds, for which we establish the weak duality and strong duality, include the case have no gap in weak sence and thecase have no gap in strong sence. The constraint functions are interval valued, which is more general then the previous papers. The Lagrange multiplier was considered together with some KKT conditions.
For more general, in the future, we may either study the theory for Riemannian interval optimization problems (RIOPs) and their duality problems on the general Riemannian manifolds.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] P. A. Absil, R. Mahony, and R. Sepulchre , Optimization Algorithms on Matrix Manifolds , Princeton University Press, Princeton, NJ, 2008.
- 2[2] I. Aguirre-Cipe, R. Lopez, E. Mallea, and L. Vásquez , A study of interval optimization problems , Optimization Letters, 15(3), 859-877, 2021.
- 3[3] M. Bacak , Convex Analysis and Optimization in Hadamard Spaces , De Gruyter, 2014.
- 4[4] G.C. Bento, O.P. Ferreira, and P.R. Oliveira , Local convergence of the proximal point method for a special class of nonconvex functions on Hadamard manifolds , Nonlinear Analysis: Theory, Methods and Applications, 74(2), 564-572, 2010.
- 5[5] G.C. Bento and J. Melo , Subgradient method for convex feasibility on Riemannian manifolds , Journal of Optimization Theory and Applications, 152(3), 773-785, 2012.
- 6[6] A. Bhurjee and G. Panda , Efficient solution of interval optimization problem , Mathematical Method of Operations Research, 76(3), 273-288, 2013.
- 7[7] N. Boumal , An Introduction to Optimization on Smooth Manifolds , Cambridge University Press., November, 2020.
- 8[8] S.I. Chen and N.J. Huang , Generalized invexity and generalized invariant monotone vector fields on Riemannian manifolds with applications , Journal of Nonlinear and Convex Analysis, 16(7), 1305-1320, 2015.
