Tractability of Convex Vector Optimization Problems in the Sense of Polyhedral Approximations
Firdevs Ulus

TL;DR
This paper investigates the conditions under which convex vector optimization problems can be approximated by polyhedral inner and outer bounds to their Pareto frontiers, revealing limitations and characterizations of tractability.
Contribution
It provides a characterization of when CVOPs are tractable for polyhedral approximations based on weighted sum scalarization problems.
Findings
Not all CVOPs are tractable for polyhedral approximations.
Tractability is characterized by properties of weighted sum scalarizations.
The study extends understanding of approximation limits in non-compact feasible regions.
Abstract
There are different solution concepts for convex vector optimization problems (CVOPs) and a recent one, which is motivated from a set optimization point of view, consists of finitely many efficient solutions that generate polyhedral inner and outer approximations to the Pareto frontier. A CVOP with compact feasible region is known to be bounded and there exists a solution of this sense to it. However, it is not known if it is possible to generate polyhedral inner and outer approximations to the Pareto frontier of a CVOP if the feasible region is not compact. This study shows that not all CVOPs are tractable in that sense and gives a characterization of tractable problems in terms of the well known weighted sum scalarization problems.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Tractability of Convex Vector Optimization Problems in the Sense of Polyhedral Approximations
Firdevs Ulus
Abstract
There are different solution concepts for convex vector optimization problems (CVOPs) and a recent one, which is motivated from a set optimization point of view, consists of finitely many efficient solutions that generate polyhedral inner and outer approximations to the Pareto frontier. A CVOP with compact feasible region is known to be bounded and there exists a solution of this sense to it. However, it is not known if it is possible to generate polyhedral inner and outer approximations to the Pareto frontier of a CVOP if the feasible region is not compact. This study shows that not all CVOPs are tractable in that sense and gives a characterization of tractable problems in terms of the well known weighted sum scalarization problems.
Keywords: Vector optimization, multiobjective optimization, convex programming, polyhedral approximation.
MSC 2010 Classification: 90C29, 90C25
1 Introduction
Vector optimization problem with a finite dimensional image space is to minimize an -valued objective function with respect to the partial order induced by an ordering cone over a feasible region. Whenever the ordering cone is the positive orthant, the problem is called a multi-objective optimization problem, namely objective functions are to be minimized with respect to the component-wise ordering.
There are different solution concepts regarding vector optimization problems. A minimizer (efficient solution or Pareto optimal solution) for instance, is a singleton in the feasible set which is not dominated by the other feasible points. Similarly, a weak minimizer (weakly efficient solution or weak Pareto optimal solution) is a feasible solution which is not strictly dominated. Note that a solution is said to (strictly) dominate another solution if the image of is (strictly) less than the image of with respect to ordering cone .
More recently, a solution concept, which is motivated from a set optimization point of view, has been introduced for vector optimization problems by Heyde and Löhne in [13]. Accordingly, a solution consists of minimizers which, together with the extreme directions of the ordering cone, generate the Pareto frontier. Clearly, for linear vector optimization problems (LVOPs) a solution in this sense contains finitely many minimizers and there are algorithms to generate one, see, for instance, [2, 3, 4, 7, 10, 12, 19].
In [16], an -solution concept is given as a finite set of weak minimizers which generates an inner and an outer approximation to the Pareto frontier. There are Benson-type algorithms that find -solutions to convex vector optimization problems (CVOPs) assuming that the feasible region is compact, see [6, 16]. Note that if the feasible region is compact, then the problem is bounded, that is, the image of the feasible region in the objective space is included in a shifted cone, namely for some and being the ordering cone of the problem. In some applications, the feasible region of a convex vector optimization problem is not compact. Computation of some set-valued risk measures [16] can be given as an example of such cases. In general, the problem of interest may be unbounded or it may be difficult to check if it is a bounded problem.
The aim of this study is to understand the structure of possibly unbounded CVOPs and to see if these problems are tractable in the sense that there exist polyhedral outer and inner approximations to the Pareto frontier. We provide a simple example for which the problem is not bounded and it is not possible to find polyhedral outer and inner approximations such that the Hausdorff distance between the two is finite. On the other hand, the existence of unbounded, but tractable problems is known. For instance, it is possible to generate a solution to a linear vector optimization problem as long as the Pareto frontier exists.
Here, we provide a characterization of tractable CVOPs depending on the recession cone of the upper image (image of the feasible region added to the original ordering cone) of the problem. Accordingly, there exists a polyhedral inner and outer approximations to the Pareto frontier of a CVOP if and only if the problem is bounded with respect to the ordering cone taken as the recession cone of the upper image of the problem. We call such problems self-bounded.
We give a characterization of the recession cone of the upper image of a self-bounded problem in terms of the well-known weighted sum scalarization problems. Accordingly, for a self-bounded problem, the set of weights which makes the weighted sum scalarization problem bounded is equal to the (positive) dual cone of the recession cone. Moreover, we also show the reverse implication, that is, if these two sets are equal, then the problem is self-bounded.
This paper is structured as follows. Section 2 is dedicated to basic concepts and notation. In Section 3, some results on convex upper closed sets are provided. The convex vector optimization problem, its solution concepts and the main results of the paper are provided in Section 4. Section 5 provides some concluding remarks.
2 Preliminaries
A subset of is a cone if when and . For a set , the interior, closure, boundary, convex hull and the conic hull of are denoted respectively by , , , , and . Moreover, is called a direction of if . The recession cone of consists of the directions of , that is,
[TABLE]
A polyhedral convex set can be written as
[TABLE]
where , each is a point, and each is a direction of . The set of points together with the set of directions are said to generate the polyhedral convex set . Throughout, we also consider (not necessarily polyhedral) convex subsets of in the form where is a convex cone. In this case, the set of points together with cone are said to generate .
The distance from a point to a set is given by . The Hausdorff distance between two closed sets and is given by
[TABLE]
A convex cone is said to be solid, if it has a non-empty interior; pointed if it does not contain any line through 0; and non-trivial if . A non-trivial convex pointed cone C defines a partial ordering on : if and only if . Let be a non-trivial convex pointed cone and a convex set. A function is said to be -convex if holds for all , , see e.g., [17, Definition 6.1].
For a pointed cone , a point is called -minimal element of A if . If cone is also solid, then a point is called weakly -minimal element if . The set of all -minimal elements of and weakly -minimal elements of are denoted by and , respectively. The (positive) dual cone of is the set .
Let cone be nontrivial and convex. A set is said to be upper closed with respect to if , and convex upper closed with respect to if . The collection of such sets are denoted by , that is,
[TABLE]
Remark 2.1**.**
It is known that is a partially ordered conlinear space with neutral element , where and . Here, and are the usual Minkowski summation and multiplication with the conventions for all . Moreover, is a complete lattice under with
[TABLE]
for a nonempty collection , see, for instance, [9].
is said to be bounded if there exists some with . Similarly, for any cone , we say that is bounded with respect to if there exists some with .
Throughout, denotes the closed ball around with radius , that is , where is the Euclidean norm. The positive orthant in is .
3 On Convex Upper Closed Sets
For solving convex vector optimization problems, convex upper closed sets with respect to the ordering cone of the problem play an important role as the image of the set of all weak minimizers can be seen as (a subset of) the boundary of a convex upper closed set known as the upper image. Indeed, there are solution concepts for convex vector optimization problems that involve generating (approximations to) the upper image, see, for instance, [15, 16]. For linear vector optimization problems, it is possible to generate this set by a finite set of points and a finite set of directions [15], whereas for nonlinear convex vector optimization problems, a solution usually generates an inner and an outer approximation to the upper image [16].
If an upper closed set is known to be bounded with respect to , then it is possible to find an outer approximation to which is generated by a finite set and cone in the sense that . If one also wants to generate an inner approximation using the same cone , then needs to be satisfied. The following proposition shows that such cone needs to be equal to the recession cone of .
Proposition 3.1**.**
Let be bounded with respect to for some closed convex cone which also satisfies . Then, .
Proof.
As is bounded with respect to , there exists such that . Then, . On the other hand, implies that . ∎
Definition 3.2**.**
A nonempty set is said to be self-bounded if and it is bounded with respect to its own recession cone .
Remark 3.3**.**
Note that the definition of self-boundedness can be extended to sets with recession cones that are not solid. An example of a not self-bounded set would be for , where is the epigraph of . Clearly, and there exists no such that .
Let be the set of all self-bounded sets together with the whole space, that is,
[TABLE]
Next, we show that is a conlinear space, however it is not necessarily a complete lattice.
Proposition 3.4**.**
* is a conlinear space with the neutral element .*
Proof.
By Remark 2.1, it is enough to show that and are in for , ,
Let for , let be such that , for . Clearly, . Note that is self-bounded as holds. To see the last inclusion, let , that is, for some ; let , that is, for some . For any , we have .
Let for , . Let be such that . Note that for some . Then, . Note that is self-bounded as holds. To see the last inclusion, let , that is, for some , ; let , that is, for some , . For any , we have .
∎
Remark 3.5**.**
Note that is closed under intersections. Consider a collection and let be such that , for . The assertion holds trivially if the intersection is empty. Assume . Then, . Let . Note that the existence of such is guaranteed as is solid and . Then, it can be shown that .
Note that would be a complete lattice with
[TABLE]
if both sets are in . Clearly, . However, is not necessarily self-bounded. Consider for instance, for . Note that as , see also Remark 3.3.
The following lemma together with Propositions 3.7 and 3.9 shows the importance of the concept of self-boundedness in terms of approximations of convex upper closed sets via convex sets of the form .
Lemma 3.6**.**
Let be a compact and convex set, be a non-trivial solid convex cone and be fixed. For any , there exists a finite set such that .
Proof.
Let , where is the Euclidean norm. Define
[TABLE]
Note that . Indeed, for any , , and as . Furthermore, we have . To see, let . Note that , for some , partition of , for , , and with . Now, , since , and .
Let be the collection of all finite subsets of with at least elements. Define . is an open cover for , and there exists a finite subcover as is compact, that is, there exists such that . Let . Clearly, . As , there exists such that for all . Then, implies that satisfies the assertion. ∎
Proposition 3.7**.**
Let be bounded with respect to a non-trivial convex pointed cone and be fixed. Then, for any , there exists a finite set of points such that
[TABLE]
Proof.
First, we show that there exists a compact set such that . Consider the sequence of sets given by for , where is fixed. Note that holds for all , and as is solid. Hence, . Note that since is bounded with respect to , there exists with for all . Moreover, for all . Since both and are closed and is pointed, is compact for all . Let . As is bounded with respect to , for all . Moreover, is decreasing and since , and . Then, there exists such that for and satisfies the required property.
By Lemma 3.6, there exists a finite set such that . Then, we have . ∎
Remark 3.8**.**
Note that for , is a non-trivial convex cone and . Moreover, if is self-bounded, then by Proposition 3.7, it is possible to generate finite outer approximation to using . Indeed, for any there exists a finite subset of such that . Moreover, also generates an inner approximation as . It is clear that the Hausdorf distance between the inner and the outer approximations is bounded, namely, .
The following proposition shows that if is not self-bounded as in Definition 3.2, then it is not possible to find a polyhedral outer approximation such that the Hausdorff distance between and is finite.
Proposition 3.9**.**
Let be not self-bounded but bounded with respect to for some non-trivial closed convex cone . Let a finite set satisfy . Then, .
Proof.
Since is not self-bounded but bounded with respect to , . Then, there exists . For any , there exists such that as is convex and is not a recession direction. Let be such that . As , there exists such that . Then, there exists such that . Clearly, . Let and . Consider . On the one hand, as , there exists such that for . Let . Then, for , as . On the other hand, can be written as for some as is the unit normal vector to . Then, for , we have
[TABLE]
Then, . ∎
4 Convex Vector Optimization
4.1 Problem Setting and Solution Concepts
A convex vector optimization problem (CVOP) with ordering cone is to
[TABLE]
where , and are non-trivial pointed convex ordering cones with nonempty interior, is a convex set, the vector-valued objective function is -convex, and the constraint function is -convex (see e.g., [17]). Note that the feasible set of (P) is convex. Throughout we assume that (P) is feasible, i.e., . The image of the feasible set is defined as . The set
[TABLE]
is called the upper image of (P) (or upper closed extended image of (P), see [11]). Clearly, is convex and closed. Hence . Moreover, , see, for instance, Proposition 4.1 in [6].
Remark 4.1**.**
Proposition 4.1 in [6] also states that is bounded with respect to but this is true only under the assumption that the feasible region is bounded, see Example 4.6 for a simple counterexample.
Definition 4.2**.**
Let be a closed convex cone such that . Problem (P) is said to be bounded with respect to if is bounded with respect to . (P) is said to be bounded if it is bounded with respect to and unbounded if it is not bounded.
There are different solution concepts regarding CVOPs. The following is a well-known solution concept which is also known as a (weakly) efficient solution or (weakly) Pareto optimal solution of (P).
Definition 4.3**.**
An element of is said to be a minimizer if and a weak minimizer if .
Note that the image of a (weak) minimizer is a single point on the boundary of the upper image. For bounded convex vector optimization problems, an -solution concept which generates inner and outer approximations to the whole upper image is given in [16] as follows.
Definition 4.4**.**
[16, Definition 3.3]** For a bounded problem (P), a nonempty finite set of (weak) minimizers is called a finite (weak) -solution of (P) if
[TABLE]
Clearly, this definition suggests polyhedral inner and outer approximations to the upper image as follows
[TABLE]
Note that if problem (P) is bounded with respect to for some non-trivial closed convex cone and moreover if satisfies , then the problem, where cone is taken as the ordering cone, is equivalent to the original problem. In other words, and hence . If such exists, then it has to be the recession cone of the upper image by Proposition 3.1. In the following definition, we suggest that we call a problem self-bounded if such cone exists.
Definition 4.5**.**
(P) is said to be self-bounded if and if (P) is bounded with respect to .
By Proposition 3.9, it is known that if a problem is not self-bounded then for any polyhedral outer approximation to the upper image, the Hausdorff distance between the outer approximation and the upper image is not finite. In particular, there exists no finite weak - solution of (P). The following is a trivial example of a not self-bounded CVOP.
Example 4.6**.**
Consider the biobjective optimization problem where the ordering cone is the positive orthant , the two objective functions to be minimized are , and the feasible region is the real line, . Clearly, the image of the feasible region is the graph of , namely and the upper image is the epigraph of , . Note that the problem is not bounded since for any , we have . Moreover, one can easily check that the recession cone of is . Hence, this problem is not self-bounded and it is not possible to find a polyhedral outer approximation to the upper image for a given error bound.
As seen in the above example, there are convex vector optimization problems that are not tractable in terms of having polyhedral outer approximations and clearly problems that are not self-bounded are not tractable in that sense. The following example provides a non-linear convex tractable problem with a non-compact feasible region.
Example 4.7**.**
Consider the biobjective optimization problem with a solid ordering cone , where the two objective functions to be minimized are , and the feasible region is the positive real line. Clearly, and . The problem is not bounded as the ordering cone is strictly smaller than the positive orthant. However, it is self-bounded, hence tractable in the sense of polyhedral approximations.
Assume for now that problem (P) is self-bounded. Clearly, if one can compute the recession cone of the upper image and if the recession cone is polyhedral and pointed, then it is possible to apply the approximation algorithms for bounded CVOPs in the literature, where the ordering cone is taken as , see [6, 16]. Note that, it is in general difficult to check if the recession cone of the upper image is polyhedral and pointed. However, it is trivially polyhedral if the objective function is -valued for instance. In this case, it would be either pointed or a halfspace. Note that if the recession cone of the upper image of a two-dimensional CVOP is a halfspace, then the upper image itself is a halfspace by convexity. Then one could simplify the problem to a linear vector optimization problem and apply for instance, the parametric simplex algorithm from [19], which works even if the upper image is a halfspace.
In each iteration of algorithms provided in [6, 16], a scalarized problem is solved. In particular, the weighted sum scalarization of (P), which is given by
[TABLE]
for , is solved in each iteration of the geometric dual algorithm. It is also solved at the initialization step of the ’primal’ Benson’s algorithm. The followings are well-known results, see e.g., [14, 17].
Proposition 4.8**.**
Let . An optimal solution of (Pw) is a weak minimizer of (P).
Theorem 4.9** ([14, Corollory 5.3]).**
If is a non-empty closed set and (P) is a convex problem, then for each weak minimizer of (P), there exists such that is an optimal solution to (Pw).
4.2 Self-Bounded Problems
In this section, we consider self-bounded problems and provide a characterization result in terms of weighted sum scalarization problems.
Recall that a vector optimization problem is said to be linear if the objective function is where , the feasible region and the ordering cone are polyhedral. Note that LVOPs are self-bounded as long as the upper image is not the whole space. Indeed, for a LVOP with , the recession cone of the upper image is polyhedral, it can be computed by solving the so called homogeneous problem, and problem (P) is bounded with respect to , see, for instance, [15] for the details. Moreover, it is also known that for linear problems we have , see [19].
In order to give a characterization of the self-bounded convex vector optimization problems we define
[TABLE]
Remark 4.10**.**
It is easy to show that is a convex cone. Note also that is not necessarily a closed cone. Consider Example 4.6. Note that makes the sum scalarization problem (Pw) unbounded for any . On the other hand, for any other , (Pw) is bounded. Hence, , and this is not a closed set.
Remark 4.11**.**
Note that (Pw) can be reformulated as . Then, is the negative of the barrier cone of the upper image, namely , where
[TABLE]
It is known that for any nonempty closed convex set ,
[TABLE]
see, for instance, [1, 21]. Moreover, if is hyperbolic, that is, if for some bounded , then is closed, see [8, Proposition 1.1].
The following results relates the recession cone of the upper image and for convex vector optimization problems. Indeed, it is seen that the above-mentioned result for LVOPs holds also for the self-bounded CVOPs.
Proposition 4.12**.**
It is true that . Moreover, if problem (P) is self-bounded, then .
Proof.
The statements follow by Remark 4.11. ∎
It is clear that self-boundedness of problem (P) also guarantees that is a closed set. Next, we show that implies that problem (P) is self-bounded as long as .
For the following lemma and the theorem, consider a basis of given by
[TABLE]
where is fixed. Note that is a compact set. Moreover, as , we have . Then, holds if only if , hence and
Lemma 4.13**.**
Assume . Then
[TABLE]
Proof.
implies that As , it is true that for . Moreover, as , it is true that . Hence, for any .
For contradiction, assume Then, for all , there exists such that . In particular, consider for Then, there exists with for . Note that is compact and by Bolzano Weierstrass Theorem, it is sequentially compact. That is, there exists a convergent subsequence of with . Then,
[TABLE]
as and .
Since is -convex and , are finite convex functions on . Moreover, converges point-wise to . By Theorem 10.8 of [18], converges uniformly to on each compact subset of . Let . Clearly, is compact for all and . Since uniformly converges to on , we have
[TABLE]
Moreover, as is a decreasing sequence in , exists and
[TABLE]
which contradicts to the fact that . ∎
Theorem 4.14**.**
If , then problem (P) is self-bounded.
Proof.
If , then and . Moreover, as , we have by Lemma 4.13. Let . Below, we show that , hence, (P) is self-bounded. Assume the contrary, that is, there exists with . Using the separation argument, there exists such that . Then, and . Let . Clearly, and , which contradicts to the fact that . ∎
Remark 4.15**.**
The relation between hyperbolic sets and their barrier cones is studied by Zaffaroni in [20]. Indeed an easier proof of Theorem 4.14 can be done using Theorem 6.5 in [20]. The direct proof provided above uses the set , which in general is taken as the initial outer approximation to the upper image in Beson-type approximation algorithms, see [5, 16]. Hence, Lemma 4.13 is also important for practical reasons.
5 Concluding Remarks
The aim of this study is to understand the structure of possibly unbounded convex vector optimization problems and to see if those are tractable in the sense that there are polyhedral inner and outer approximations of the upper image. It has been shown that not all CVOPs are tractable and indeed, only the ones that are self-bounded are tractable.
For the problems which are not known to be bounded, no solution concept which generates inner and outer approximations to the upper image is known in the literature. Clearly, for problems that are not self-bounded, it is not possible to come up with such a concept as it is not possible to find a polyhedral outer approximation, see Proposition 3.9 and Definition 4.5. However, one could generalize the concept of (weak) -solution given for bounded problems to the self-bounded problems, using the recession cone of the upper image as follows.
Definition 5.1**.**
For a self-bounded problem (P), a nonempty finite set of (weak) minimizers is called a finite (weak) -solution of (P) if
[TABLE]
This definition is valid in the sense that the existence is known, see Proposition 3.7 and Definition 4.5. However, since it is difficult to compute in general, it is not really practical. Note on the other hand that for two dimensional self-bounded CVOPs, is polyhedral and there are two extreme directions generating it as long as is not a halfspace.
As discussed in Section 1, Benson-type algorithms proposed in [6, 16] are designed to solve bounded CVOPs. Note that a problem is bounded if and only if it is self-bounded and . Then, by Proposition 4.12 and Theorem 4.14, a problem is bounded if and only if . As is known to be a convex cone, see Remark 4.10, in order to check if a problem is bounded, it is enough to check if (Pw) is bounded for all extreme directions of .
Note that the algorithms in [6, 16] can be extended to solve self-bounded problems as long as the recession cone of the upper image is polyhedral and its extreme directions can be computed, which remains as an open problem.
Acknowledgment
We are grateful to the anonymous referees for insightful comments allowed us to correct some inaccuracies appearing in the preceding version and for numerous suggestions that improved the presentation. We would also like to thank Prof. Alberto Zaffaroni for his constructive discussion during the revision process.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] S. Adly, E. Ernst, and M. Théra. Norm-closure of the barrier cone in normed linear spaces. Proceedings of the American Mathematical Society , 132(10):2911–2915, 2004.
- 2[2] H. P. Benson. An outer approximation algorithm for generating all efficient extreme points in the outcome set of a multiple objective linear programming problem. Journal of Global Optimization , 13:1–24, 1998.
- 3[3] M. Ehrgott, A. Löhne, and L. Shao. A dual variant of Benson’s outer approximation algorithm. Journal Global Optimization , 52(4):757–778, 2012.
- 4[4] M. Ehrgott, J. Puerto, and A. M. Rodriguez-Chia. Primal-dual simplex method for multiobjective linear programming. Journal of Optimization Theory and Applications , 134:483–497, 2007.
- 5[5] M. Ehrgott and L. Shao. Approximately solving multiobjective linear programmes in objective space and an application in radiotherapy treatment planning. Mathematical Methods of Operations Research , 68(2):257–276, 2008.
- 6[6] M. Ehrgott, L. Shao, and A. Schöbel. An approximation algorithm for convex multi-objective programming problems. Journal of Global Optimization , 50(3):397–416, 2011.
- 7[7] R. E. Evans, J. P. Steuer. A revised simplex method for multiple objective programs. Mathematical Programming , 5(1):54–72, 1973.
- 8[8] P. Goossens. Hyperbolic sets and asymptotes. Journal of Mathematical Analysis and Applications , 116:604–618, 1986.
