Positive Semidefiniteness and Positive Definiteness of a Linear Parametric Interval Matrix
Milan Hlad\'ik

TL;DR
This paper studies conditions for positive definiteness and semidefiniteness of symmetric matrices with linearly parameterized entries over interval domains, extending classical results and aiding optimization methods.
Contribution
It provides new characterizations and computationally efficient conditions for positive (semi-)definiteness of parametric interval matrices, expanding classical theory.
Findings
Characterization of positive definiteness over parameter intervals
Efficient sufficient and necessary conditions proposed
Extensions of classical interval matrix results
Abstract
We consider a symmetric matrix, the entries of which depend linearly on some parameters. The domains of the parameters are compact real intervals. We investigate the problem of checking whether for each (or some) setting of the parameters, the matrix is positive definite (or positive semidefinite). We state a characterization in the form of equivalent conditions, and also propose some computationally cheap sufficient\,/\,necessary conditions. Our results extend the classical results on positive (semi-)definiteness of interval matrices. They may be useful for checking convexity or non-convexity in global optimization methods based on branch and bound framework and using interval techniques.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Positive Semidefiniteness and Positive Definiteness of a Linear Parametric Interval Matrix
Milan Hladík111 Charles University, Faculty of Mathematics and Physics, Department of Applied Mathematics, Malostranské nám. 25, 11800, Prague, Czech Republic, e-mail: [email protected]
Abstract
We consider a symmetric matrix, the entries of which depend linearly on some parameters. The domains of the parameters are compact real intervals. We investigate the problem of checking whether for each (or some) setting of the parameters, the matrix is positive definite (or positive semidefinite). We state a characterization in the form of equivalent conditions, and also propose some computationally cheap sufficient / necessary conditions. Our results extend the classical results on positive (semi-)definiteness of interval matrices. They may be useful for checking convexity or non-convexity in global optimization methods based on branch and bound framework and using interval techniques.
**Keywords:**Interval computation, interval matrix, parametric matrix, positive semidefiniteness, positive definiteness, global optimization.
1 Introduction
A commonly used deterministic approach to global optimization [3, 5, 7, 8, 15, 27] is based on exhaustive splitting of the search space into smaller parts (usually boxes) and applying various interval techniques to remove boxes that provably do not contain any global minimizer, to compute rigorous lower and upper bounds on the optimal value, and to prove optimality of some point within a box, among others.
An important step in this approach is convexity testing on a box. If the objective function is identified as convex on the box, any local minimum is also global, and the search within the box becomes easier. Similarly, if the function is convex nowhere on the box and the box lies inside the feasible set, then the box can be removed as it contains no local, and hence also no global, minimum. Convexity also plays an important role in the global optimization BB method [3, 4, 5, 12, 39], which is based in constructing a convex underestimator of the objective function by appending an additional convex quadratic term.
Convexity of the objective function on a box is usually studied via an interval matrix enclosing all Hessian matrices of the function on the box. Since convexity of a function corresponds to positive (semi-)definiteness of its Hessian matrix, we face the problem of checking positive (semi-)definiteness of an interval matrix.
Let us introduce some notation now. We use for the diagonal matrix with entries , and for the sign of ( if and otherwise). For vectors, the sign is applied entrywise.
An interval matrix is defined as
[TABLE]
where \mbox{\underline{{{A}}}},\mbox{\overline{{{A}}}}\in{\mathbb{R}}^{m\times n}, \mbox{\underline{{{A}}}}\leq\mbox{\overline{{{A}}}}, are given, and the inequality is understood entrywise. The midpoint and the radius of are defined respectively as
[TABLE]
The set of all -by- interval matrices is denoted by . Supposing that both and are symmetric, the symmetric counterpart to is
[TABLE]
A symmetric interval matrix \mbox{A}{}^{S}\in{\mathbb{IR}}^{n\times n} is strongly positive definite (positive semidefinite) if is positive definite (positive semidefinite) for each A\in\mbox{A}{}^{S}. Next, \mbox{A}{}^{S} is weakly positive definite (positive semidefinite) if is positive definite (positive semidefinite) for some A\in\mbox{A}{}^{S}. Eventually, \mbox{\mbox{}}\in{\mathbb{IR}}^{n\times n} is regular if every A\in\mbox{\mbox{}} is nonsingular.
The classical results characterizing strong positive semidefiniteness and positive definiteness are stated below; see Rohn [33, 35, 36], and Białas and Garloff [1]. Suppose that \mbox{\mbox{}}\in{\mathbb{IR}}^{n\times n} is given with and symmetric.
Theorem 1**.**
The following are equivalent:
- (1)
\mbox{A}{}^{S}* is positive semidefinite,* 2. (2)
* is positive semidefinite for each ,* 3. (3)
* for each .*
Theorem 2**.**
The following are equivalent:
- (1)
\mbox{A}{}^{S}* is positive definite,* 2. (2)
* is positive definite for each ,* 3. (3)
* for each ,* 4. (4)
* is positive definite and is regular.*
Checking strong positive (semi-)definiteness is known to be a co-NP-hard problem (Kreinovich et al. [19]). On the other hand, checking whether there is a positive semidefinite matrix in \mbox{A}{}^{S} is a polynomial time problem; see Jaulin and Henrion [14].
There are other related results on positive definiteness of interval matrices. For instance, Liu [21] presents a sufficient condition and applies it to stability issues, Kolev [17] presents a method to determine a positive definite margin of an interval matrix, and Shao and Hou [38] propose a necessary and sufficient criterion for a larger class of complex Hermitian interval matrices.
Positive (semi-)definiteness closely relates to matrix eigenvalues. A real symmetric matrix is positive (semi-)definite if and only if all its eigenvalues are positive (nonnegative). This relation indicates that positive (semi-)definiteness can be investigated from the perspective of eigenvalues of interval matrices. Such eigenvalues were studied, e.g., in [11, 13, 16, 18, 20, 22, 25], and some of those results could possibly be used to check for positive (semi-)definiteness; a simple sufficient condition for strong positive definiteness appeared already in Rohn [33, 35, 36]. This paper, however, is focused in other direction. We generalize some of the classical results to interval matrices affected by linear dependencies between the matrix entries.
2 Linear Parametric Matrices: Positive Semidefiniteness
The standard notion of an interval matrix assumes that all matrix entries vary within the given intervals independently of other entries. This assumption is rarely satisfied in practice. To approach more closely to practical use and to model possible dependencies, consider a more general concept of a linear parametric matrix
[TABLE]
where are fixed symmetric matrices and are parameters varying respectively in \mbox{\mbox{}}_{1},\dots,\mbox{\mbox{}}_{K}\in{\mathbb{IR}}.
Strong and weak positive definiteness extends to parametric matrices naturally as follows.
Definition 1**.**
A parametric matrix , p\in\mbox{\mbox{}}, is strongly positive definite (positive semidefinite) if is positive definite (positive semidefinite) for each p\in\mbox{\mbox{}}. It is weakly positive definite (positive semidefinite) if is positive definite (positive semidefinite) for at least one p\in\mbox{\mbox{}}.
Linear parametric form generalizes the standard interval matrix. Evaluation A(\mbox{\mbox{}})=\sum_{k=1}^{K}A^{(k)}\mbox{\mbox{}}_{k} by interval arithmetic encloses the set of matrices , p\in\mbox{\mbox{}}, in an interval matrix and reduces the problem to the standard non-parametric one. This “relaxation” of parametric structure, however, overestimates the true set and may lead to loss of positive (semi-)definiteness.
Example 1**.**
Let
[TABLE]
This parametric matrix is strongly positive semidefinite, but its relaxation
[TABLE]
is not, as it contains, e.g., the indefinite matrix
[TABLE]
Linear parametric forms are also used to model linear dependencies between parameters in interval linear equation solving [10, 30, 31, 41]. Linear dependencies cause not only the problem to be more difficult from the computational viewpoint, but it is also hard to describe the corresponding solution set; see Mayer [23].
2.1 Strong positive semidefiniteness
Surprisingly, characterization of strong positive semidefiniteness from Theorem 1 can be extended to parametric matrices quite straightforwardly.
Theorem 3**.**
The following are equivalent:
- (1)
* is positive semidefinite for each p\in\mbox{\mbox{}},* 2. (2)
* is positive semidefinite for each such that p_{k}\in\{\mbox{\underline{{p}}}_{k},\mbox{\overline{{p}}}_{k}\} ,* 3. (3)
* for each .*
Proof.
“” Obvious.
“” Let . Define and p_{k}:=p^{c}_{k}-s_{k}p^{\Delta}_{k}\in\{\mbox{\underline{{p}}}_{k},\mbox{\overline{{p}}}_{k}\}, . Now, by positive semidefiniteness of , we have
[TABLE]
“” Let p\in\mbox{\mbox{}} and . Now,
[TABLE]
This result shows that strong positive semidefiniteness can be verified by checking positive semidefiniteness of real matrices. This enables us to effectively check strong positive semidefiniteness of large matrices provided the number of parameters is small. Moreover, as stated below, the number can be further reduced in some cases.
Theorem 4**.**
**
- (1)
If is positive semidefinite for some , then we can fix p_{i}:=\mbox{\underline{{p}}}_{i} for checking strong positive semidefiniteness. 2. (2)
If is negative semidefinite for some , then we can fix p_{i}:=\mbox{\overline{{p}}}_{i} for checking strong positive semidefiniteness.
Proof.
(1) Let p\in\mbox{\mbox{}}. We use the fact that positive semidefiniteness is closed under addition and nonnegative multiples. Thus, A^{(i)}(p_{i}-\mbox{\underline{{p}}}_{i}) is positive definite. If
[TABLE]
is positive semidefinite for some p_{k}\in\mbox{\mbox{}}_{k}, , then
[TABLE]
is positive semidefinite, too.
(2) Analogously. ∎
As long as is too large to apply Theorem 3, and Theorem 4 fails to reduce the number of real matrices to be processed, the following sufficient condition may be useful.
Theorem 5**.**
For each , let , where both are positive semidefinite. Then , p\in\mbox{\mbox{}}, is strongly positive semidefinite if
[TABLE]
is positive semidefinite.
Proof.
Let p\in\mbox{\mbox{}}. By closedness of positive semidefiniteness under addition and nonnegative multiples, we have that
[TABLE]
is positive semidefinite, too. ∎
A splitting of into a difference between two positive semidefinite matrices can be carried out as follows. Let be a spectral decomposition of . Let be the diagonal matrix the entries of which are the positive parts of , and similarly has the negative parts on the diagonal. Then and both , are positive semidefinite.
2.2 Weak positive semidefiniteness
Concerning weak positive semidefiniteness, the problem is still solvable in polynomial time by utilizing a suitable semidefinite program [6, 26, 40]. Let be the block diagonal matrix with blocks
[TABLE]
All entries of depend affinely on variables . Positive definiteness of is equivalent to positive definiteness of and feasibility of variables p\in\mbox{\mbox{}}. Therefore, by solving this semidefinite program we check whether , p\in\mbox{\mbox{}}, is weakly positive semidefinite.
Anyway, a cheap necessary condition may be useful, e.g., for nonconvexity testing in global optimization [7].
Theorem 6**.**
For each , let , where both are positive semidefinite. If , p\in\mbox{\mbox{}}, is weakly positive semidefinite, then
[TABLE]
is positive semidefinite.
Proof.
Let p\in\mbox{\mbox{}} such that is positive semidefinite. By closedness of positive semidefiniteness under addition and nonnegative multiples, we have that
[TABLE]
is positive semidefinite, too. ∎
In view of Theorem 4, it is easy to see that the conditions from Theorems 5 and 6 are necessary and sufficient provided for each , the matrix is either positive or negative definite.
3 Linear Parametric Matrices: Positive Definiteness
In a similar fashion as in Section 2, we can characterize positive definiteness of parametric matrices.
Theorem 7**.**
The following are equivalent:
- (1)
, p\in\mbox{\mbox{}}, is strongly positive definite, 2. (2)
* is positive definite for each such that p_{k}\in\{\mbox{\underline{{p}}}_{k},\mbox{\overline{{p}}}_{k}\} ,* 3. (3)
* for each .*
Proof.
Analogous to Theorem 3. ∎
Theorem 8**.**
**
- (1)
If is positive semidefinite for some , then we can fix p_{i}:=\mbox{\underline{{p}}}_{i} for checking strong positive definiteness. 2. (2)
If is negative semidefinite for some , then we can fix p_{i}:=\mbox{\overline{{p}}}_{i} for checking strong positive definiteness.
Proof.
Analogous to Theorem 4. ∎
Theorem 9**.**
For each , let , where both are positive semidefinite. Then , p\in\mbox{\mbox{}}, is strongly positive definite if
[TABLE]
is positive definite.
Proof.
Analogous to Theorem 5. ∎
A parametric matrix , p\in\mbox{\mbox{}}, is called regular if is nonsingular for each p\in\mbox{\mbox{}}. Regularity of parametric matrices was investigated by Popova [29], for instance. We have the following relation to regularity, extending item of Theorem 2.
Theorem 10**.**
The parametric matrix , p\in\mbox{\mbox{}}, is strongly positive definite if and only if the following two properties hold:
- (1)
* is positive definite for an arbitrarily chosen p\in\mbox{\mbox{}},* 2. (2)
, p\in\mbox{\mbox{}}, is regular.
Proof.
“” Obvious as each positive definite matrix is nonsingular.
“” Let be positive definite for p^{1}\in\mbox{\mbox{}} and suppose to the contrary that is not positive definite for p^{2}\in\mbox{\mbox{}}. Hence has positive eigenvalues, and has at least one non-positive eigenvalue. Due to continuity of eigenvalues [24] and compactness of , there is p^{0}\in\mbox{\mbox{}} such that is singular. A contradiction. ∎
Now, we have two sufficient conditions for checking strong positive definiteness. The first one is stated in Theorem 9, and the second one utilizes regularity according to Theorem 10. By Poljak and Rohn [28] (see also [2, 19]), checking regularity is a co-NP-hard problem even for standard interval matrices. However, there are some polynomially verifiable sufficient conditions that we can apply. We will utilize a similar approach to [29]: preconditioning, relaxation and call of a Beeck criterion for checking regularity of an interval matrix (see Rex and Rohn [32]). By interval aritmetic, we evaluate the interval matrix
[TABLE]
where is the preconditioner. Now, the Beeck sufficient condition for regularity of (which implies regularity of , p\in\mbox{\mbox{}}) reads
[TABLE]
We show by examples that no one condition for checking strong positive definiteness is stronger than the other one, where the criterion is utilized for regularity checking. Notice that the values in the matrices below are displayed to a precision of four digits, however, the real computation was done rigorously in Matlab using the interval library Intlab by Rump [37] and the verification software package Versoft by Rohn [34].
Example 2**.**
Let
[TABLE]
This parametric matrix is strongly positive definite.
Let us check the sufficient condition by Theorem 9. The matrix is positive definite, so we split only
[TABLE]
Now,
[TABLE]
is positive definite, proving strong positive definiteness of , p\in\mbox{\mbox{}}.
In comparison, the sufficient regularity condition fails to prove regularity. Using the preconditioner
[TABLE]
the relaxation leads to an interval matrix
[TABLE]
which is not confirmed to be regular by using the condition as .
Example 3**.**
Let
[TABLE]
In this example, Theorem 9 fails to prove positive definiteness. In contrast, with the preconditioner
[TABLE]
and the relaxation matrix
[TABLE]
the condition proves positive definiteness by showing .
Theorem 6 is modified to necessary condition for weak positive definiteness as follows.
Theorem 11**.**
For each , let , where both are positive semidefinite. If , p\in\mbox{\mbox{}}, is weakly positive definite, then
[TABLE]
is positive definite.
Proof.
Analogous to Theorem 6. ∎
4 Example
Consider a class of functions
[TABLE]
where are not necessarily mutually different, and . For such functions, their Hessian matrix has directly a linear parametric form without using any kind of linearization. It is easy to see that each entry of the Hessian of is a linear function with respect to . Thus the variables play the role of the parameters , and their domain works as .
Example 4**.**
Let
[TABLE]
and we want to check its convexity on x\in\mbox{\mbox{}}=[2,3], y\in\mbox{\mbox{}}=[1,2] and z\in\mbox{\mbox{}}=[0,1]. The Hessian of reads
[TABLE]
The direct evaluation the Hessian matrix by interval arithmetic results in an enclose by the interval matrix
[TABLE]
This interval matrix is not strongly positive semidefinite since the smallest eigenvalue, computed by the exponential formula by Hertz [9], is . Nevertheless, Theorem 9 proves to be positive definite by utilizing the parametric form
[TABLE]
Thus, we can conclude that is convex on the interval domain.
Acknowledgments.
The author was supported by the Czech Science Foundation Grant P402-13-10660S.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] S. Białas and J. Garloff. Intervals of P-matrices and related matrices. Linear Algebra Appl. , 58:33–41, 1984.
- 2[2] M. Fiedler, J. Nedoma, J. Ramík, J. Rohn, and K. Zimmermann. Linear Optimization Problems with Inexact Data . Springer, New York, 2006.
- 3[3] C. A. Floudas. Deterministic Global Optimization. Theory, Methods and Applications , volume 37 of Nonconvex Optimization and its Applications . Kluwer, Dordrecht, 2000.
- 4[4] C. A. Floudas and C. E. Gounaris. A review of recent advances in global optimization. J. Glob. Optim. , 45(1):3–38, 2009.
- 5[5] C. A. Floudas and P. M. Pardalos, editors. Encyclopedia of Optimization. 2nd ed. Springer, New York, 2009.
- 6[6] B. Gärtner and J. Matoušek. Approximation Algorithms and Semidefinite Programming . Springer, Berlin Heidelberg, 2012.
- 7[7] E. R. Hansen and G. W. Walster. Global Optimization Using Interval Analysis . Marcel Dekker, New York, second edition, 2004.
- 8[8] E. M. T. Hendrix and B. Gazdag-Tóth. Introduction to nonlinear and global optimization , volume 37 of Optimization and Its Applications . Springer, New York, 2010.
