Tropical analogues of a Dempe-Franke bilevel optimization problem
Sergei Sergeev, Zhengliang Liu

TL;DR
This paper extends bilevel optimization to tropical algebra, demonstrating that existing algorithms can be adapted and decomposing feasible sets into tropical polyhedra for solving these new problems.
Contribution
It generalizes Dempe and Franke's algorithm to tropical bilevel problems and introduces a method to decompose feasible sets into tropical polyhedra.
Findings
Dempe and Franke's algorithm applies to tropical bilevel problems
Feasible sets can be decomposed into tropical polyhedra
Tropical linear programming solvers are applicable
Abstract
We consider the tropical analogues of a particular bilevel optimization problem studied by Dempe and Franke and suggest some methods of solving these new tropical bilevel optimization problems. In particular, it is found that the algorithm developed by Dempe and Franke can be formulated and its validity can be proved in a more general setting, which includes the tropical bilevel optimization problems in question. We also show how the feasible set can be decomposed into a finite number of tropical polyhedra, to which the tropical linear programming solvers can be applied.
| 1 | {1} | {2} | ||
| 2 | {2} | {1} | ||
| 3 | {1,2} |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsPolynomial and algebraic computation · Algebraic structures and combinatorial models · Commutative Algebra and Its Applications
Tropical analogues of a Dempe-Franke bilevel optimization problem
Sergeĭ Sergeev and Zhengliang Liu
*University of Birmingham, School of Mathematics, Edgbaston B15 2TT, UK
Supported by EPSRC grant EP/P019676/1Emails of authors: [email protected], [email protected]
Abstract
We consider the tropical analogues of a particular bilevel optimization problem studied by Dempe and Franke [4] and suggest some methods of solving these new tropical bilevel optimization problems. In particular, it is found that the algorithm developed by Dempe and Franke can be formulated and its validity can be proved in a more general setting, which includes the tropical bilevel optimization problems in question. We also show how the feasible set can be decomposed into a finite number of tropical polyhedra, to which the tropical linear programming solvers can be applied.
1 Introduction
Bilevel programming problems are hierarchical optimization problems with two levels, each of which is an optimization problem itself. The upper level problem models the leader’s decision making problem whereas the lower level problem models the follower’s problem. These two problems are coupled through common variables.
Consider a particular problem formulated by Dempe and Franke [4]:
[TABLE]
Here and are polyhedra in , commonly given as solution sets to some systems of affine inequalities.
Our goal is to study some analogues and generalisations of problem (1) over the tropical (max-plus) semiring. This is a special case of a general idea to develop tropical bilevel optimization, inspired both by the well-developed methodology of bilevel optimization and some of the recent successes in tropical convexity and tropical optimization [1, 2, 7].
The tropical semiring is the set of real numbers with , equipped with the “tropical addition” , which is taking the maximum of two numbers, and “tropical multiplication”, which is the ordinary addition [3]. Thus we have: and , and the elements , respectively , are neutral with respect to and . These arithmetical operations are then extended to matrices and vectors in the usual way, and the sign for multiplication will be consistently omitted. Observe that we have for all and hence, for example, if for some , then we have for the tropical scalar products of these vectors with any (note that now means and all matrix-vector products are understood tropically).
The maximization and minimization problems are not equivalent in tropical mathematics. This is intuitively clear since only one of these operations plays the role of addition and the other is “dual” to it. Namely, the maximization problems are usually easier. Therefore, the following four problems can be all considered as tropical analogues of (1).
Min-min problem (or) Max-min problem:
[TABLE]
Min-max problem (or) Max-max problem:
[TABLE]
where and are vectors with entries in and and are tropical polyhedra of , in the sense of the following definition.
Definition 1.1** (Tropical Polyhedra and Tropical Halfspaces)**
Tropical polyhedron* is defined as an intersection of finitely many tropical affine halfspaces defined as*
[TABLE]
for some and .
Note that unlike the classical halfspace, the tropical halfspace is defined as a solution set of a two-sided inequality, since we cannot move terms in the absence of (immediately defined) tropical subtraction. Also note that any tropical polyhedron can be defined as a set of the form
[TABLE]
where are matrices and are vectors with entries in of appropriate dimensions. Furthermore, any tropical polyhedron is a tropically convex set in the sense of the following definition:
Definition 1.2** (Tropical Convex Set and Tropical Convex Hull)**
A set is called tropically convex if for any two points , then .
* is called the tropical convex hull of if any point of is a tropical convex combination of the points of .*
Furthermore, it is well-known that any compact tropical polyhedron is the tropical convex hull of a finite number of points (e.g., [2]).
2 The min-min and max-min problem
The direct analogue of Problem 1 is the min-min problem, which we consider together with the max-min problem. Here and below, the notation “” will stand for maximization or minimization. Instead of the performance measure we will consider a more general function , for which certain properties will be assumed, depending on the situation.
Thus we consider the following problem:
[TABLE]
Using we can rewrite the lower level value function (LLVF) reformulation of (2):
[TABLE]
Further we will assume that is continuous and and are compact in the topology111In other words, is continuous and the sets and are compact in the usual Euclidean topology. induced by the metric .
Let us now introduce the following notion.
Definition 2.1** (Min-Essential Sets)**
Let be a tropical polyhedron. Set is called a min-essential subset of , if for any the minimum is attained at a point of .
Lemma 2.1
If is a min-essential set of and then is also min-essential.
Inspired by Dempe and Franke [4] we suggest to generalize their algorithm in order to solve (2)in the form of (3). Here denotes a min-essential subset of .
Algorithm 1
**(Solving Min-min Problem and Max-min Problem)
*1. Initial step. Find a pair solving the relaxed problem
[TABLE]
We verify whether . If “yes” then stop, is a solution.
If not then find a point of that attains . Let .
- General step. Find a pair solving the problem
[TABLE]
We verify whether . If “yes” then stop, is a solution.
If not then find a point that attains . Let , and repeat 2. with .* *
We now include the proof of convergence and validity of this algorithm, although it just generalizes the one given by Dempe and Franke [4].
Theorem 2.1
Let be finite. Then Algorithm 1 terminates in a finite number of steps and results in a globally optimal solution of (1).
Proof First observe that as and are compact then the feasible set of (4) is also compact. The feasible set of (5) is also compact as intersection of the compact set with the closed set
[TABLE]
As is continuous as a function of , the optima in (4) and (5) always exist.
Now consider the sequence generated by the algorithm. Points belong to a finite (min-essential) subset of and hence there exist and such that and . However, and hence
[TABLE]
The inequalities turn into equalities, and is a globally optimal solution since it is feasible for (2) and globally optimal for its relaxation (5).
Let us now argue that a finite min-essential set exists for each tropical polyhedron .
Definition 2.2** (Minimal Points)**
Let be a tropical polyhedron. A point is called minimal if and imply . The set of all minimal points of is denoted by .
Definition 2.3** (Extreme Points)**
Let be a tropical polyhedron. A point is called extreme if any equality with and implies or .
We have the following known observation. Note, however, that this observation does not hold in the usual convexity, as counterexamples on the plane can be easily constructed.
Lemma 2.2** (Helbig [8])**
Any minimal point of a tropical polyhedron is extreme.
The set of extreme points of a tropical polyhedron is finite, see for example Allamigeon, Gaubert and Goubault [2]. Combining this with an observation that the set is compact and hence contains a minimal point, we obtain the following claims.
Proposition 2.1
* is a finite (and non-empty) min-essential subset for any tropical polyhedron .*
Corollary 2.1
Any tropical polyhedron has a finite min-essential subset.
Several problems arise when trying to implement the general Dempe-Franke algorithm in tropical setting. One of them is how to find a point of a finite min-essential set that attains and which min-essential set to choose. An option here is to exploit the tropical simplex method of Allamigeon, Benchimol, Gaubert and Joswig [1], which (under some generically true conditions imposed on ) can find a point that attains and belongs to the set of tropical basic points of . The set of tropical basic points is finite and includes all extreme points [1] and hence all the minimal points of , thus it is also a finite min-essential subset of by Lemma 2.1.
Even more imminent problem is how to solve (5), as the techniques referred to in Dempe and Franke [4] are not immediately ”tropicalized”. An option here is to use reduction of the constraints defining a tropical polyhedron to MILP constraints. Such reduction was suggested, e.g., in De Schutter, Heemels and Bemporad [6] based on [5]. More precisely, we need to consider constraints of the following two kinds: 1) and 2) . Constraints of the first type are easy to deal with, since this is the same as to write for all , in terms of the usual arithmetic. Constraints of the second type mean that for at least one , and this can be written as , where and , with a sufficiently large number. One can see that this reduction to MILP also applies to the constraints in (6). Combining these techniques with the general Dempe-Franke algorithm is a matter of ongoing research.
Let us now discuss another approach to solving the problem
[TABLE]
where is isotone with respect to the second argument: whenever . We can observe the following..
Proposition 2.2
If is isotone with respect to the second argument then the minimum in (7) is equal to the minimum in the following problem:
[TABLE]
This proposition provides for the following straightforward procedure solving (7) (and, in particular, Min-min Problem):
Algorithm 2
**(Solving (7) and Min-min Problem)
*Step 1. Identify the set of minimal points .
Step 2. For each point we solve the following optimization problem:
[TABLE]
Step 3. Find the minimum among all problems (8) for all .**
Note that when for some vectors over , problem (8) can be solved by any algorithm of tropical linear programming [1, 3, 7]. The set of all minimal points can be found by a combination of the tropical double description method of [2] that finds the set of all extreme points and the techniques of Preparata et al. for finding all minimal points of a finite set [9], although clearly a more efficient procedure should be sought for this purpose.
2.1 The max-max and min-max problems
Let us now consider the problems where the lower-level objective is to maximize rather than to minimize:
[TABLE]
Following the LLVF approach, (9) is equivalent to
[TABLE]
where . The following are similar to Definitions 2.2 and 2.1.
Definition 2.4** (Maximal Points)**
Let be a tropical polyhedron. A point is called maximal if and imply .
Definition 2.5** (Max-Essential Subset)**
Let be a tropical polyhedron. Set is called a max-essential subset of , if for any the maximum is attained at a point of .
However, it is immediate that each compact tropical polyhedron contains its greatest point, and the above notions trivialize.
Proposition 2.3
Let be a compact tropical polyhedron. Then contains its greatest point .Furthermore, the singleton is a max-essential subset of .
Proposition 2.3 implies that (9) (and (10)) are equivalent to
[TABLE]
where is the greatest point of . The following result yields an immediate solution of the max-max problem.
Corollary 2.2** (Solving Max-max Problem)**
If is isotone with respect to both arguments and , then is a globally optimal solution of (9), where and are the greatest points of and .
Let us now consider (11) where is not necessarily isotone, or where as in the case of Min-max problem. Suppose that has all components in and define point with coordinates:
[TABLE]
We first prove the following claim.
Lemma 2.3
Let . Consider sets and such that and . Let be such that
[TABLE]
Then, if , equation is equivalent to
[TABLE]
Proof. Observe that implies . With such as in (12) and such that , we have
[TABLE]
Therefore, becomes
[TABLE]
Moreover since we obtain that for each . Hence we can further simplify (14) to (13).
Let us also introduce the following notation:
[TABLE]
Note that “” means in the usual arithmetics. Now, using Lemma 2.3 we can prove the following.
Theorem 2.2
We have the following decomposition:
[TABLE]
where the union is taken over and are such that and .
Theorem 2.2 suggests that Problem (11) (and, equivalently, (9)) can be solved by the following straightforward procedure.
Algorithm 3
**(Solving (9) and Min-max Problem)
*Step 1. For each partition , of , identify the system of inequalities (15) defining and and find a solution of the problem over , if such solution exists.
Step 2. Compute over all solutions found at Step 1. **
When , this procedure reduces the problem to a finite number of tropical linear programming problems solved, e.g., by the algorithms of [1, 3, 7].
Example 2.1
Consider the following numerical example in two-dimensional case. Let is the tropical (max-plus) convex hull of the points , and . See Figure 1 (a). is defined by , and . See Figure 1 (b).
In this example, (the greatest point of in Figure 1 (b)). Therefore, . Table 1 shows three possible partitions of and . Partition 1 corresponds to the line segment between and in and the line segment connecting and in (red). Partition 2 corresponds to the line segment between and in and the line segment connecting and in (blue). Partition 3 corresponds to the line segment between and in (green) and in the union of the line segment connecting and and the line segment between and (green).**
Assume the upper level objective is of the form , where , . In ordinary algebra it can be written as . It is obvious that the objective function is isotone with respect to and . In partition 1, and is always a solution regardless of and . In partition 2, and is a solution. In partition 3, either and or and solve the problem. However, these solutions are always dominated by the optimal points of partition 1 and partition 2. Therefore, in this example, it is sufficient to consider only partition 1 and partition 2. and decide between and . Taking makes an optimal solution of the problem, but taking and results in .
3 Conclusions
We have studied the four different tropical analogues of a problem considered by Dempe and Franke [4]. We showed that we can solve the problems by generalizing the Dempe-Franke algorithm and using reduction to MILP, or by decomposing the feasible set of a problem into a number of tropical polyhedra and performing tropical linear programming over these subdomains. The resulting methods need further practical study and theoretical improvement.
4 Acknowledgement
We gratefully acknowledge fruitful communication with Bart De Schutter and Ton van den Boom (TU Delft), who informed us about the reduction of tropical optimization problems to MILP.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Allamigeon, X., Benchimol, P., Gaubert, S., Joswig, M.: Tropicalizing the simplex algorithm. SIAM J. on Discrete Math. 29 (2), 751-795 (2015).
- 2[2] Allamigeon, X., Gaubert, S., Goubault, É.: Computing the vertices of tropical polyhedra using directed hypergraphs. Discrete Comput. Geom. 49 , 247-279 (2013).
- 3[3] Butkovič, P.: Max-linear Systems: Theory and Algorithms. Springer, London (2010).
- 4[4] Dempe, S., Franke, S.: Solution algorithm for an optimistic linear Stackelberg problem. Computers and Oper. Res. 41 277-281 (2014).
- 5[5] De Schutter, B., Heemels, W.P.M.H. and Bemporad, A.: On the equivalence of linear complementarity problems. Oper. Res. Letters, 30 (4) 211-222 (2002).
- 6[6] De Schutter, B., Heemels, W.P.M.H., Bemporad, A.: Max-plus-algebraic problems and the extended linear complementarity problem – algorithmic aspects. In: Proceedings of the 15th IFAC World Congress, Barcelona, Spain (2002).
- 7[7] Gaubert, S., Katz, R.D., Sergeev, S.: Tropical linear-fractional programming and parametric mean-payoff games. J. of Symb. Computation 47 (12) 1447-1478 (2012).
- 8[8] Helbig, S.: On Carathéodory’s and Krein-Milman’s theorems in fully ordered groups. Comment. Math. Univ. Carolin. 29 (1) 157-167 (1988).
