Characterization of the norm-based robust solutions in vector optimization
Morteza Rahimi, Majid Soleimani-damaneh

TL;DR
This paper investigates the properties of norm-based robust solutions in vector optimization, introducing new directional concepts and extending characterizations to constrained problems, with implications for nonsmooth analysis.
Contribution
It defines new non-ascent directions using Clarke's gradient and characterizes robustness in vector optimization, including constrained cases, under basic qualification conditions.
Findings
Characterization of robustness via new directions
Extension to conic constrained problems
Necessary conditions using nonsmooth gap functions
Abstract
In this paper, we study the norm-based robust (efficient) solutions of a Vector Optimization Problem (VOP). We define two kinds of non-ascent directions in terms of Clarke's generalized gradient and characterize norm-based robustness by means of the newly-defined directions. This is done under a basic Constraint Qualification (CQ). We extend the provided characterization to VOPs with conic constraints. Moreover, we derive a necessary condition for norm-based robustness utilizing a nonsmooth gap function.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
∎
11institutetext: Morteza Rahimi22institutetext: School of Mathematics, Statistics and Computer Science, College of Science, University of Tehran, Tehran, Iran; E-mail: [email protected] 33institutetext: Majid Soleimani-damaneh (Corresponding author)44institutetext: School of Mathematics, Statistics and Computer Science, College of Science, University of Tehran, Tehran, Iran; E-mail: [email protected]
Characterization of the norm-based robust solutions in vector optimization
Morteza Rahimi
Majid Soleimani-damaneh
(
Received: date / Accepted: date)
Abstract
In this paper, we study the norm-based robust (efficient) solutions of a Vector Optimization Problem (VOP). We define two kinds of non-ascent directions in terms of Clarke’s generalized gradient and characterize norm-based robustness by means of the newly-defined directions. This is done under a basic Constraint Qualification (CQ). We extend the provided characterization to VOPs with conic constraints. Moreover, we derive a necessary condition for norm-based robustness utilizing a nonsmooth gap function.
Keywords:
Multiple objective programmingVector optimizationNonsmooth optimizationRobust optimizationClarke’s generalized gradient.
MSC:
90C29 90C31 49J52
1 Introduction
In optimization models arisen in practice, the Decision Maker (DM)/manager/ user is often faced with uncertainty. Robust optimization, as one of the leading tools for dealing with uncertainty, has been the subject of many publications in recent decades; see, e.g., ben-1 ; ben-2 ; ber ; ehr-2 ; fli-2 ; geo ; gob-1 ; ide-1 ; ide-3 ; kur ; zam among others.
In the current work, we concentrate on robustness in Vector Optimization Problems (VOPs). We are going to investigate the efficient solutions which are insensitive against small perturbation in objective function data. In the following, we briefly review some relevant works. To this end, we classify the existing robustness notions to three classes: worst-case, set-based, and norm-based.
Worst-case robustness in multi-objective programming has been studied by Ehrgott et al. ehr-2 , Fliege and Werner fli-2 , and Kuroiwa and Lee kur . This kind of robustness deals with a conservative over-estimator of the function on the whole uncertainty set fli-2 .
Set-based robustness has been appearing in some recent works by Ehrgott et al. ehr-2 , Ide and Kbis ide-1 , and Ide and Schbel ide-3 . The main idea behind set-based robustness is to compare the objective function values, taking the whole uncertainty set into account, by means of the set relations.
Norm-based robustness has been introduced by Georgiev et al. geo and then has been developed by Goberna et al. gob-1 and Zamani et al. zam . This notion, which is useful for modelling in an unbalanced situation, refers to the efficient solutions which remain efficient under small perturbations.
In a very recent work, Rahimi and Soleimani-damaneh our-new have defined and investigated robust efficient solutions of a nonlinear VOP. To the best of our knowledge, this is the only work in the literature dealing with robustness in vector optimization. In our-new , we have defined, compared and characterized robust solutions from various standpoints. Furthermore, we have studied the connections between norm-based robust efficiency, strict efficiency, isolated efficiency, and proper efficiency.
In the current work, we are going to define two kinds of non-ascent directions in terms of Clarke’s generalized gradient and then characterize norm-based robustness with respect to the newly-defined directions. To this end, we apply an appropriate Constraint Qualification (CQ). We derive various necessary and sufficient conditions for norm-based robustness.
The rest of the paper is organized as follows. In Section 2, we provide the required preliminaries. In Section 3, a characterization of the norm-based robust efficient solutions, in terms of tangent/normal cone and aforementioned directions, is given. Section 4 is devoted to investigation of the problem for VOPs with conic constraints. Section 5 concludes the paper by studying robustness invoking a new nonsmooth gap function.
2 Preliminaries
This section contains some preliminaries which are used in the rest of the work. Given , two notations and stand for the transpose of and the inner product of , respectively. We denote the convex hull, the interior, and the closure of a nonempty set by , , and , respectively.
Given is said to be a cone if and imply . A cone is called pointed if ; and it is said to be an ordering cone if it is nontrivial, closed, pointed and convex. For instance,
[TABLE]
is called the natural ordering cone.
Given an infinite index set , we set
[TABLE]
The cone and the convex cone generated by are denoted by and , respectively. Indeed,
[TABLE]
[TABLE]
Given an infinite index set and a collection of nonempty convex sets , we have pos\bigg{(}\displaystyle\bigcup_{t\in T}\Omega_{t}\bigg{)}=\bigcup_{\hat{T}\in\Sigma}pos\bigg{(}\displaystyle\bigcup_{t\in\hat{T}}\Omega_{t}\bigg{)}, where is the set of all nonempty finite subsets of ; see (roc, , Theorem 3.3).
The polar cone and the strict polar cone of a set , denoted by and , respectively, are defined as
[TABLE]
[TABLE]
The tangent cone to at , denoted by , is defined as
[TABLE]
The normal cone to at , denoted by , is defined as polar of the tangent cone, i.e.,
[TABLE]
We use the Euclidean norm, i.e., , and set
[TABLE]
Let be an ordering cone. A vector-valued function is called -convex if for any and ,
[TABLE]
The classic and Clarke’s generalized directional derivatives cla are used in the presence of nonsmooth data.
Definition 1
Let and be given. The directional derivative of at in the direction , denoted by , is defined as
[TABLE]
Definition 2
Let be convex. The set of all subgradients of at , denoted by , is defined as
[TABLE]
Definition 3
cla Let be locally Lipschitz at . The Clarke’s generalized directional derivative of at in the direction , denoted by , is defined as
[TABLE]
Definition 4
(cla, , Definition 10.3) Let be locally Lipschitz at . The Clarke’s generalized gradient of at , denoted by , is defined as
[TABLE]
If is convex, then and ; see cla .
A function is called regular at if it is locally Lipschitz at , and exists satisfying for any (cla, , Definition 10.12). The set of regular functions contains that of convex functions cla .
Consider the VOP,
[TABLE]
in which is a vector-valued function with . Indeed,
[TABLE]
Here, and are the feasible set and the objective function, respectively. Throughout the paper, we suppose , , are locally Lipschitz. Also, we consider an ordering cone with nonempty interior.
Definition 5
The vector is called an efficient solution of (1) w.r.t. if there exists no such that .
We close this section by definition of norm-based robust efficient solution for VOPs. This notion, introduced by Rahimi and Soleimani-damaneh our-new , generalizes the concepts scrutinized by Georgiev et al. geo and Zamani et al. zam . Before going to the definition, we need some notations. For an matrix , the Frobenius norm is defined as
[TABLE]
The set of all real matrices is denoted by ; and the set of all matrices with is denoted by . Given and , we define .
Definition 6
our-new The vector is called a norm-based robust efficient solution of (1) w.r.t. , if there exists some scalar such that for any , the vector is an efficient solution of
[TABLE]
w.r.t. . The scalar is called a robustness radius for
3 Characterization
In this section, we provide a full characterization of norm-based robust efficient solutions, for VOPs, in terms of Clarke’s generalized gradient. To this end, we define two kinds of non-ascent directions of the objective functions. Notice that as is a vector-valued function, the members of are matrices whose columns are .
Definition 7
A vector is called a first kind non-ascent direction of at if for each and each .
Definition 8
A vector is called a second kind non-ascent direction of at if for each and each .
Hereafter, and denote the set of all first and second kind non-ascent directions of at , respectively. Due to the properties of polar cone, implies for each . Here, stands for the polar of According to (cla, , Proposition 10.15), is always true, and it holds as equality if and , , are regular at in the sense of Clarke.
Definition 9
We say that Constraint Qualification 1 (CQ1) holds at if
It can be seen that CQ1 holds if for any ,
[TABLE]
Theorem 3.1 is one of the most important results of the paper.
Theorem 3.1
Let .
- (i)
If is a norm-based robust efficient solution of (1) w.r.t. , then
[TABLE]
- (ii)
Let be convex and be -convex. If then is a norm-based robust efficient solution of (1) w.r.t. .
- (iii)
Let be convex, be -convex, and CQ1 hold at . Then, is a norm-based robust efficient solution of (1) w.r.t. if and only if
[TABLE]
Proof (i) By indirect proof, assume that there exists a nonzero vector such that . Then, there are two sequences and such that as . By (cla, , Theorem 10.17), for each ,
[TABLE]
where ; and the th column of belongs to for some . Locally Lipschitzness of at and imply that the sequence is bounded and without loss of generality is convergent to some . So, due to , we have Now, assume that is a robustness radius of . As and , there exists some with So, and for sufficiently large ,
[TABLE]
This leads to
[TABLE]
Hence, according to (4),
[TABLE]
This contradiction completes the proof of part (i).
(ii) By indirect proof, assume that there exist two sequences and such that and for any
[TABLE]
This implies
[TABLE]
Without loss of generality, assume that converges to some with
Two cases for the sequence may occur; either it has a subsequence convergent to or it does not have any subsequence convergent to . In the first case, without loss of generality, assume . Then,
[TABLE]
On the other hand, as is -convex, for any ,
[TABLE]
Combining (6) and (7) leads to
[TABLE]
for any and any . This implies that . Therefore, This contradicts the assumption.
Now, we consider the second case: does not have any subsequence convergent to . Therefore, without loss of generality, there exists some scalar such that for any . By setting , as is convex, we have
[TABLE]
for any Furthermore, . Hence,
[TABLE]
Let be arbitrary. Similar to above, for each . On the other hand, from the -convexity and the locally Lipschitzness of ,
[TABLE]
So, according to the convexity of , we have
[TABLE]
Thus, , leading to This contradicts the assumption, and the proof of part (ii) is completed.
(iii) This part results from parts (i) and (ii) accompanying Definition 9. ∎
As mentioned before, if the feasible set is convex, and , are convex, then i.e. CQ1 automatically holds. This fact leads to the following corollary, derived from Theorem 3.1.
Corollary 1
Assume that the feasible set is convex, and f_{i},$$i=1,2,\ldots,p, are convex. Then, is a norm-based robust efficient solution of (1) w.r.t. if and only if .
The following example shows that Theorem 3.1(iii) is not true without CQ1.
Example 1
Consider a VOP
[TABLE]
with ordering cone
[TABLE]
and
[TABLE]
It is not difficult to see that is -convex. Let . We have
[TABLE]
and
[TABLE]
So, and for each . Hence, Therefore, CQ1 is not fulfilled. It is seen that while is not a norm-based robust efficient solution of the considered problem.∎
The above example has another message that unlike , for one can not derive CQ1 from -convexity of the objective function.
The next result characterizes robustness by means of the normal cone and Clarke’s generalized gradient.
Theorem 3.2
Assume that is convex and .
- (i)
If is a norm-based robust efficient solution of (1) w.r.t. , then
[TABLE]
- (ii)
If is -convex and
[TABLE]
then is a norm-based robust efficient solution of (1) w.r.t. .
Proof (i) According to Theorem 3.1(i), norm-based robust efficiency implies
[TABLE]
Now, by (roc, , Corollary 16.4.2), we get
[TABLE]
On the other hand,
[TABLE]
So,
[TABLE]
Hence, the closure of the convex set coincides with . This leads to
[TABLE]
(ii) By setting
[TABLE]
and applying (roc, , Corollary 16.4.2) on (8), we have
[TABLE]
On the other hand, . Therefore,
[TABLE]
and the proof is completed due to Theorem 3.1(ii). ∎
Corollaries 2, 3, and 4 are direct results of Theorems 3.1 and 3.2.
Corollary 2
Let be convex, be convex, and . Then the following three assertions are equivalent.
- (i)
* is a norm-based robust efficient solution of (1) w.r.t. ;*
- (ii)
There exists no such that for any and any , ;
- (iii)
pos\bigg{(}\displaystyle\bigcup_{i=1}^{p}\partial f_{i}(\bar{x})\bigg{)}+N_{\Omega}(\bar{x})=\mathbb{R}^{n}.**
Corollary 3
Let be convex and be -convex and continuously differentiable at . Then the following three statements are equivalent.
- (i)
* is a norm-based robust efficient solution of (1) w.r.t. ;*
- (ii)
There exists no such that ;
- (iii)
**
Corollary 4
Let be convex and be convex and continuously differentiable at . Then the following three assertions are equivalent.
- (i)
* is a norm-based robust efficient solution of (1) w.r.t. ;*
- (ii)
There exists no satisfying , ;
- (iii)
pos\big{\{}\nabla f_{1}(\bar{x}),\nabla f_{2}(\bar{x}),\ldots,\nabla f_{p}(\bar{x})\big{\}}+N_{\Omega}(\bar{x})=\mathbb{R}^{n}.**
4 Problems with Conic Constraints
Consider a VOP with conic constraints as follows:
[TABLE]
Here, and are respectively the objective and constraint functions, whose components are assumed to be locally Lipschitz. Furthermore, is an ordering cone in with nonempty interior. The feasible set of (9) is
[TABLE]
Consider a function defined by
[TABLE]
and set
[TABLE]
[TABLE]
It is evident that
[TABLE]
The following lemma constructs the main result of the current section. Hereafter,
[TABLE]
Lemma 1
If and , then
- (i)
\Big{\{}d\in\mathbb{R}^{n}:~{}(\lambda^{*}\circ g)^{\circ}(\bar{x};d)\leq 0,~{}\forall\lambda^{*}\in A(\bar{x})\Big{\}}\subseteq T_{\Omega_{1}}(\bar{x});**
- (ii)
N_{\Omega_{1}}(\bar{x})\subseteq cl\,pos\bigg{(}\displaystyle\bigcup_{\lambda^{*}\in A(\bar{x})}\partial_{c}(\lambda^{*}\circ g)(\bar{x})\bigg{)};**
- (iii)
If is -convex, then the inequalities given in (i) and (ii) hold as equality.
Proof (i) If , then there is nothing to prove. So, assume . By (cla, , Theorems 10.34 and 10.42), since is locally Lipschitz around , we get
[TABLE]
where stands for the Clarke tangent cone to at . Moreover, because .
Now, consider satisfying for any . According to the definition of generalized Clarke’s directional derivatives, there exist sequences , , , such that
[TABLE]
The sequence is bounded and, by working with subsequences if necessary, one may assume that this sequence converges to some . Furthermore, as and are continuous at ,
[TABLE]
Moreover, due to the locally Lipschitzness of functions, the sequence is bounded, and hence,
[TABLE]
[TABLE]
Hence, , and this completes the proof of part (i) due to (10).
(ii) According to part (i), we have Furthermore, , leading to . So, .
(iii) As is -convex, is convex. So, due to , there exists such that for any . On the other hand, the function is continuous on and is compact. Therefore, the inequalities given in parts (i) and (ii) hold as equality because of (gob-2, , Theorem 7.9) and (cla, , Proposition 2.9). ∎
Theorem 4.1 is the main achievement of the current section.
Theorem 4.1
Let .
- (i)
If is convex and is a norm-based robust efficient solution of (9) w.r.t. with , then
[TABLE]
- (ii)
Let be -convex, be -convex and . If
[TABLE]
then is a norm-based robust efficient solution of (9) w.r.t. .
Proof (i) Apply Lemma 1(ii) and Theorem 3.2.
(ii) Considering arbitrary , we prove , and then norm-based robustness of comes from Theorem 3.1. According to the assumption of the theorem, there exist finite sets and , Clarke’s gradients and , and scalars and such that
[TABLE]
On the other hand, as and , we have . Also, since , there exist two sequences and such that and ; see cla . Therefore, implies
[TABLE]
leading to So, we get which means .∎
The following corollaries are direct consequences of the above theorem (when and or and are continuously differentiable). In these corollaries, and .
Corollary 5
Let be convex and .
- (i)
If is a norm-based robust efficient solution of (9) w.r.t. , and 0\notin co\Big{(}\displaystyle\bigcup_{j\in A(\bar{x})}\partial_{c}g_{j}(\bar{x})\Big{)}, then
[TABLE]
- (ii)
Let and be convex. If
[TABLE]
then is a norm-based robust efficient solution of (9) w.r.t. .
Corollary 6
Let be convex and and be continuously differentiable at .
- (i)
If is a norm-based robust efficient solution of (9) w.r.t. , and , then
[TABLE]
- (ii)
Let and be convex. If
[TABLE]
then is a norm-based robust efficient solution of (9) w.r.t. .
In the following, we investigate the robustness for a semi-infinite VOP. Consider the following semi-infinite VOP:
[TABLE]
Here, is the objective function (i.e. , are the constraint functions and is an infinite index set. We set as the feasible set of (13), i.e.,
[TABLE]
Let and be locally Lipschitz. Notice that Problem (13) is a special case of (9). We say that the Slater constraint qualification (SCQ) holds for (13) if the following conditions are together satisfied:
- (i)
J is compact,
- (ii)
The function is continuous on ,
- (iii)
There is a such that for any .
Set In the following theorem, we provide a characterization for norm-based robust efficient solutions of .
Theorem 4.2
Let be convex and .
- (i)
Assume that 0\notin co\big{\{}\bigcup_{j\in A(\bar{x})}\partial g_{j}(\bar{x})\big{\}} and SCQ holds for (13). If is a norm-based robust efficient solution of (13) w.r.t. , then
[TABLE]
- (ii)
Assume that is -convex. Then, is a norm-based robust efficient solution of (13) w.r.t. , if
[TABLE]
Proof Apply Theorem 3.2 and (gob-2, , Lemma 7.7 and Theorem 7.9). ∎
5 Robustness and Gap Function
Gap function is one of the important tools for characterizing optimality/efficiency in optimization. To the best of our knowledge, gap function for multiobjective problems was first developed by Chen et al. Chen1998 . Here, we define a gap function for VOP (1) as a set-valued mapping defined as
[TABLE]
for and . In this gap function, is the set of efficient solutions of the following VOP w.r.t. ,
[TABLE]
The vector-valued function is called -regular at , if for any the function is regular at . If is -convex, then it is -regular. Also, if , then is -regular if and only if is regular for .
The following theorem provides a necessary condition for norm-based robust efficiency.
Theorem 5.1
Let be convex and be -regular at . If is a norm-based robust efficient solution of (1) w.r.t. and (3) is fulfilled, then there exists such that .
Proof As is a norm-based robust efficient solution, according to Theorem 3.2, we get
[TABLE]
So, there exist , , , and such that and . Now, by (3) and -regularity of , we get
[TABLE]
Therefore, there exists such that
[TABLE]
As is convex,
[TABLE]
On the other hand, if , then and so, there exists such that . This leads to for each , due to . Hence, This strict inequality contradicts (14) and the proof is complete. ∎
Corollary 7
Let be convex and be continuously differentiable. If is a norm-based robust efficient solution of (1) w.r.t. , then .
Corollary 8
Let be convex and be regular. If is a norm-based robust efficient solution of (1) w.r.t. , then there exists such that .
6 Conclusions
Investigation and characterization of the norm-based robust solutions of VOPs was the main aim of the current work. After addressing some basic notions, we obtained necessary and sufficient conditions for norm-based robustness utilizing two new directions, defined invoking Clarke’s generalized gradient. Furthermore, we developed these conditions for norm-based robust efficient solutions of VOPs with conic constraints and semi-infinite VOPs. Moreover, we derived a necessary condition for norm-based robustness by means of a nonsmooth gap function. In addition to general results, we analysed the problem for special cases.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1(1) Ben-Tal, A., Ghaoui, L. El., Nemirovski, A.: Robust Optimization. Princeton Ser. Appl. Math., Princeton University Press, NJ (2009)
- 2(2) Ben-Tal, A., Nemirovski, A.: Robust optimization methodology and applications, Mathematical Programming. 92, 453-480 (2002)
- 3(3) Bertsimas, D., Brown, D. B., Caramanis, C.: Theory and applications of robust optimization, SIAM Review. 53, 464-501 (2011)
- 4(4) Ehrgott, M., Ide, J., Schöbel, A.: A Minmax robustness for multi-objective optimization problems, European Journal of Operational Research. 239, 17-31 (2014)
- 5(5) Fliege, J., Werner, R.: Robust multiobjective optimization applications in portfolio optimization, European Journal of Operational Research. 234, 422-433 (2014)
- 6(6) Georgiev, P. Gr., Luc, D. T., Pardalos, P.: Robust aspects of solutions in deterministic multiple objective linear programming, European Journal of Operational Research. 229, 29-36 (2013)
- 7(7) Goberna, M. A., Jeyakumar, V. Li. G., López, M. A.: Robust solutions to multi-objective linear programs with uncertain data, European Journal of Operational Research. 242, 730-743 (2015)
- 8(8) Ide, J., K o ¨ ¨ 𝑜 \ddot{o} bis, E.: Concepts of efficiency for uncertain multi-objective optimization problems based on set order relations, Mathematical Methods of Operations Research. 80, 99-127 (2014)
