Minkowski sums and Hadamard products of algebraic varieties
Netanel Friedenberg, Alessandro Oneto, Robert L. Williams

TL;DR
This paper investigates the algebraic and geometric properties of Minkowski sums and Hadamard products of algebraic varieties, focusing on conditions under which these operations produce varieties and analyzing their characteristics.
Contribution
It provides new insights into when Minkowski sums and Hadamard products of algebraic varieties are themselves varieties and explores their properties based on the original varieties.
Findings
Conditions under which Minkowski sums are varieties
Conditions under which Hadamard products are varieties
Properties of these operations in algebraic geometry
Abstract
We study Minkowski sums and Hadamard products of algebraic varieties. Specifically we explore when these are varieties and examine their properties in terms of those of the original varieties.
| -th Hadamard rank | ||
| 3 | 2 | 2 |
| 4 | 2 | 2 |
| 5 | 2 | 3 |
| 3 | 2 | |
| 6 | 2 | 3 |
| 3 | 2 | |
| 7 | 2 | 4 |
| 3 | 2 | |
| 4 | 2 | |
| 8 | 2 | 4 |
| 3 | 3 | |
| 4 | 2 | |
| 9 | 2 | 5 |
| 3 | 3 |
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsCommutative Algebra and Its Applications · Polynomial and algebraic computation · Advanced Differential Equations and Dynamical Systems
∎
11institutetext: Netanel Friedenberg 22institutetext: Yale University,
10 Hillhouse Ave-Ste 442
PO Box 208283
New Haven, CT 06520-8283, United States
22email: [email protected] 33institutetext: Alessandro Oneto 44institutetext: INRIA Sophia Antipolis Méditerranée,
2004 Route de Lucioles,
06902 Sophia Antipolis, France,
44email: [email protected] 55institutetext: Robert L. Williams 66institutetext: Texas A&M University, Department of Mathematics
Mailstop 3368
College Station, TX 77843-3368 United States
66email: [email protected]
Minkowski sums and Hadamard products of algebraic varieties
Netanel Friedenberg
Alessandro Oneto
and Robert L. Williams
Abstract
We study Minkowski sums and Hadamard products of algebraic varieties. Specifically we explore when these are varieties and examine their properties in terms of those of the original varieties. This project was inspired by Problem 5 on Surfaces in Sturmfels .
1 Introduction
In algebraic geometry we have several constructions to build new algebraic varieties from given ones. Examples of classical, well-studied constructions are joins, secant varieties, rational normal scrolls, and Segre products. In these cases, it is very interesting to understand geometric properties, e.g., the dimension and the degree, of the variety constructed in terms of those of the original varieties. In this chapter we focus on the Minkowski sum and the Hadamard product of algebraic varieties. These are constructed by considering the entry-wise sum and multiplication, respectively, of points on the varieties. Due to the nature of these operations, there is a remarkable difference between the affine and the projective case.
The entry-wise sum is not well-defined over projective spaces. For this reason, we consider only Minkowski sums of affine varieties. However, in the case of affine cones, the Minkowski sum corresponds to the classical join of the corresponding projective varieties. Conversely, we focus on Hadamard products of projective varieties and, in particular, of varieties of matrices with fixed rank. This is because these Hadamard products parametrize interesting problems related to algebraic statistics and quantum information.
Our original motivating question was the following.
Question 1
Which properties do the Minkowski sum and the Hadamard product have with respect to the properties of the original varieties? In particular, what are their dimensions and degrees?
We now introduce these constructions. We work over an algebraically closed field . We will add extra assumptions on when needed. We use the notation .
Definition 1
Let be affine varieties. We define the Minkowski sum of and , denoted , as the Zariski closure of the image of under the entry-wise summation map
[TABLE]
Note that taking the Zariski closure of is necessary to construct an algebraic variety, as explained in Example 1.
As far as we know there is no literature about Minkowski sums of varieties. We compute the dimension and degree of Minkowski sums of generic affine varieties.
Theorem 3.9
Let be varieties. Then, for and in general position, .
Corollary 1
Suppose has characteristic other than . Let be varieties whose projective closures are contained in complementary linear subspaces; equivalently, are contained in disjoint affine subspaces which are not parallel. Then for generic , .
A crucial observation in our computations is that the Minkowski sum of affine varieties disjoint at infinity can be described in terms of the join of their projectivizations, see Proposition 1 and Remark 2. This is a construction inspired by the combinatorial Cayley trick used to construct Minkowski sums of polytopes.
Definition 2
Let be projective varieties. We define the Hadamard product of and , denoted by , as the Zariski closure of the image of under the map
[TABLE]
Let be the homogeneous coordinates over . The map is not defined over the union of coordinate spaces , where , is its complement, and is the linear space defined by .
Thus, the Hadamard product of projective varieties is
[TABLE]
where is the point obtained by entry-wise multiplication of the points and . Also in this construction the operation of closure is crucial, as we show in Example 2.
In BCK , the authors studied the geometry of Hadamard products, with a particular focus on the case of linear spaces. This work has been continued in BCFL .
In particular, we are interested in studying Hadamard products of varieties of matrices. The Hadamard product of matrices is a classical operation in matrix analysis H . Its most relevant property is that it is closed on positive matrices. The Hadamard product of tensors appeared more recently in quantum information PHYS and in statistics CMS ; MM16 . In the latter, the authors studied restricted Boltzmann machines which are statistical models for binary random variables where some are hidden. From a geometric point of view, this reduces to studying Hadamard powers of the first secant variety of Segre products of copies of . An interesting question is to understand how to express matrices as Hadamard products of small rank matrices. We call these expressions Hadamard decomposition. We define Hadamard ranks of matrices by using a multiplicative version of the usual definitions used for additive tensor decompositions. The study of Hadamard ranks is related to the study of Hadamard powers of secant varieties of Segre products of projective spaces.
In Section 4, we focus in particular on the dimension of these Hadamard powers. We define the expected dimension and, consequently, we define the expected -th Hadamard generic rank, i.e., the expected number of rank matrices needed to decompose the generic matrix of size as their Hadamard product. It is
[TABLE]
We confirm this is correct for square matrices of small size using Macaulay2.
The paper is structured as follows. In Section 2, we present some explicit computations of these varieties. We use both Macaulay2 M2 and Sage sage . These computations allowed us to conjecture some geometric properties of Minkowski sums and Hadamard products of algebraic varieties. In Section 3, we analyze Minkowski sums of affine varieties. In particular, we prove that, under genericity conditions, the dimension of the Minkowski sum is the sum of the dimensions and we investigate the degree of the Minkowski sum. In Section 4, we study Hadamard products and Hadamard powers of projective varieties. In particular, we focus on the case of Hadamard powers of projective varieties of matrices of given rank. We introduce the notion of Hadamard decomposition and Hadamard rank of a matrix. These concepts may be viewed as the multiplicative versions of the well-studied additive decomposition of tensors and tensor ranks.
2 Experiments
Problem 5 on Surfaces in Sturmfels asked the following:
*Compute the Minkowski sum and the Hadamard product
of two random circles in . Try other curves.*
In order to compute Minkowski sums and Hadamard products of circles and other curves, we used the algebra softwares Macaulay2 and Sage to obtain equations and nice graphics. These also aided our general understanding of the geometric properties of these constructions. Via elimination theory, we can compute the ideals of Minkowski sums and Hadamard products. This is the script in Macaulay2 to do so.
R = QQ[z_1..z_n, x_1..x_n,y_1..y_n]; I = ideal( ... ); -- ideal of X in variables x_i; J = ideal( ... ); -- ideal of Y in variables y_i;
---- construct the ideals of graphs of the maps ---- phi_+ and phi_star S = I + J + ideal(z_1-x_1-y_1,...,z_n-x_n-y_n); P = I + J + ideal(z_1-x_1y_1,...,z_n-x_ny_n); Msum = eliminate(toList{x_1..x_n | y_1..y_n}, S); Hprod = eliminate(toList{x_1..x_n | y_1..y_n}, P);
With Sage, we produced graphics of the real parts of Minkowski sums and Hadamard products of curves in . This is the script we used.
A.<x1,x2,x3,y1,y2,y3,z1,z2,z3>=QQ[] I=( ... )*A # ideal of X in the variables x; J=( ... )*A # ideal of Y in the variables y;
construct the ideals defining the graphs of the maps
phi_+ and phi_star
S = I + J + (z1-(x1+y1),z2-(x2+y2),z3-(x3+y3))A P = I + J + (z1-(x1y1),z2-(x2y2),z3-(x3y3))*A
MSum = S.elimination_ideal([x1,x2,x3,y1,y2,y3]) HProd = P.elimination_ideal([x1,x2,x3,y1,y2,y3])
Assuming we get a surface, take the one generator of
each ideal.
MSumGen=MSum.gens()[0] HProdGen=HProd.gens()[0]
We plot these surfaces.
Because MSumGen and HProdGen are considered as elements of A,
which has 9 variables, they take 9 arguments.
var(’z1,z2,z3’) implicit_plot3d(MSumGen(0,0,0,0,0,0,z1,z2,z3)==0, (z1, -3, 3), (z2, -3,3), (z3, -3,3)) implicit_plot3d(HProdGen(0,0,0,0,0,0,z1,z2,z3)==0, (z1, -3, 3), (z2, -3,3), (z3, -3,3))
In Figures 1, 2, 3 and 4 are some of the pictures we obtained. These experiments gave us a first idea about the properties of Minkowski sums and Hadamard products.
Note 1
The fact that and are the closures of images of under the maps and immediately gives us that
and that if and are irreducible, so are and .
Also, the fact that and are linear projections of and , respectively, leads us to expect other geometric properties of and . Because the projection of a variety in generic position from a linear space with is generically one-to-one, we naïvely expect that, for and in general position, with ,
These expectations, however, do not follow directly from the projections of the varieties in general position because, even for and in general position, is not in general position. Hence, we need further analysis as in the following sections.
3 Minkowski sum of affine varieties
Recall the definition of the Minkowski sum of two affine varieties and as the closure of the image of under the map
[TABLE]
The operation of closure is needed in order to get an algebraic variety. Indeed, we can give an example where , the setwise Minkowski sum of and , is not closed.
Example 1
In the affine plane with coordinates , consider the plane curves and . We claim that contains the torus , so . For if and then if and only if we can write and in the forms and for some scalar such that . Clearing denominators in this last expression, we find the requirement is that , i.e. is a zero of the quadratic polynomial . Note that and . So if we let be a zero of then with and as above we have .
On the other hand is not all of . If the characteristic of the base field is not 2, then does not contain the origin (though it does contain the punctured axes). In characteristic 2 we find that contains no point of the punctured axes and .
One of our main tools for proving results about the Minkowski sum is an alternative description of it in terms of the join of the two varieties.
For subvarieties of or , we let be the setwise join of and , i.e., the union of the lines connecting distinct points and . This space is usually not closed and its Zariski closure is the classical join of and .
Our analysis of the Minkowski sum of affine algebraic sets and via a join will involve hyperplanes positioned as in Lemma 1 below. For an intuitive sense of the statement of the lemma, one may consider the case where are the projectivizations of parallel affine hyperplanes.
Lemma 1
Let be three distinct hyperplanes in with . Say and are nonempty disjoint subvarieties. Let , , , and . Then:
- (i)
, 2. (ii)
, and 3. (iii)
.
In particular, if and have positive dimension then
[TABLE]
Proof
(i) Because and are disjoint, we have is Zariski closed, so [see Example 6.17 on p.70 of Harris ].
(ii) From the first part, we have
[TABLE]
So to get the claimed expression for it suffices to show
- (a)
and 2. (b)
.
- (a)
By symmetry it is enough to show that .
Say and . So but . Thus, the line between and intersects in exactly . 2. (b)
We show that .
By definition, . So, because is a linear space, for any and , the line between and is contained in .
(iii) First, note that because , we have
[TABLE]
Hence, we just need to show that is disjoint from .
Considering any and , it suffices to show that the line between and does not meet . If we assume, towards a contradiction, that there is some , then and would be distinct points on the hyperplane , so the line between them would be contained in . But , so cannot be contained in .
Finally, if and are positive dimensional then and are nonempty, so .∎
Our alternative description of the Minkowski sum will give us cases in which is already closed. Recall from Example 1 that for the two plane curves and , is not Zariski closed. Note that in this example, and have a common asymptote, or equivalently, that their projective closures meet at the line at infinity. We will see that when the characteristic of the base field is not 2, all cases where is not closed share an analogous property.
Definition 3
Let be varieties and denote the projective closures of and in by and , respectively. Let be the hyperplane at . We say that and are disjoint at infinity if .
Remark 1
If and are disjoint at infinity then , thus .
Proposition 1
Assume that the characteristic of is not 2. Suppose are varieties that are disjoint at infinity. Let be distinct scalars and let be the projective closures of and , respectively. Let be the coordinates on .
If we identify with and with , then:
- (i)
; 2. (ii)
; 3. (iii)
, namely, is Zariski closed.
Proof
(i) Let be the hyperplane at in . Note that
[TABLE]
which is identified with . Therefore the statement that and are disjoint at infinity is equivalent to
[TABLE]
On the other hand, and , and so we see that . So, by Lemma 1 applied to , , and , we find that
[TABLE]
(ii) & (iii) For any and , the line between the points and meets the affine hyperplane in exactly the point . So, we have shown that . In particular, because is closed, this tells us that is a closed subset of . Hence, . ∎
Remark 2
We call the construction the Cayley trick, as the underlying idea is exactly the same as that of the Cayley trick used to construct Minkowski sums of polytopes.
As a consequence of the following lemma, if we restrict to the cases with , then the hypothesis that and are disjoint at infinity is a genericity condition.
Lemma 2
Let be varieties with . Then, we have that the set is a nonempty open subset of . That is, for generic , and do not intersect.
Proof
First, note that for any point the stabilizer of in has dimension . This is because any two point stabilizers in are conjugate and the stabilizer of is the set of all with first column of the form , which has dimension .
Let which is a subvariety of . Let and be the restrictions of the canonical projections from . Note that is surjective, because for any there exists some taking to . Further, the fiber over any point is a left coset of a point stabilizer in and so has dimension . Thus, .
Because is projective, the projection is a closed map, so is a closed subset of . Since , is a proper closed subset of . So,
[TABLE]
is a nonempty open subset of . ∎
Now, we claim that if are varieties with , then
for general , and are disjoint at infinity.
To see this, note that, considering ,
[TABLE]
The action of on extends to an action on , and the identification is -equivariant. So we have
[TABLE]
By Lemma 2, for general this is empty.
Remark 3
We could have used the group of affine transformations . Indeed, shifting an affine variety does not change the part at infinity of its projective closure.
When a result holds under the same conditions as Lemma 2, i.e., if we fix and then it holds for and , for general , we shall say that the result holds for and in general position.
We are now ready to compute the dimension of Minkowski sums. Based on the examples in Section 2, it seems that for , we get . This does happen generically.
Theorem 3.1
Let be varieties. Then for and in general position, .
Proof
As observed in Note 1, we have that, for any ,
[TABLE]
So, we need to prove the converse for in general position.
Let and .
Note that because for any vector , it suffices to show that for general , . We consider the case , the case being analogous.
Note that by just looking at full-dimensional irreducible components of and , we may assume without loss of generality that and are irreducible.
We denote by the tangent space to the variety at the point .
For now fix . If then
[TABLE]
is simply the addition map , and so we see that if and then . So to conclude that it suffices to show that there is a dense subset of such that for each there exist and with and , for then
[TABLE]
and because is dense some is a smooth point of . Also, because the image of a dense subset under a continuous function is a dense subset of the image, we see that it suffices to show that there is a nonempty open subset of such that for in this set, .
For any variety let denote the smooth locus of . So we have the morphism , and we let denote the image of this morphism.
Consider
[TABLE]
which is an open subset of . In particular, if we let
[TABLE]
then is a (possibly empty) open subset of , and if then . Also, is nonempty if and only if is nonempty. So we conclude that to show that , it suffices to show that .
Now we let vary. Fix and . So for , with . Now is an -dimensional subspace of and so because , is a nonempty open subset of the Grassmannian. So because acts transitively on we conclude that for generic , . Thus , and so .
For the case where the same proof works upon replacing the condition that tangent spaces intersect trivially with the condition that they intersect transversely. ∎
Further, when the characteristic of the base field is not 2 we can use the Cayley trick to show that the condition of disjoint at infinity is sufficient to have additivity of dimension.
Theorem 3.2
Assume the characteristic of the base field is not 2. Let be varieties which are disjoint at infinity. Then .
Proof
As observed in Note 1, we have that for any ,
[TABLE]
If either or has dimension zero then is a union of finitely many shifts of the other and so has dimension .
Assume and have both positive dimension. Then, by Proposition 1 (with any ) and Lemma 1, we have that
[TABLE]
where and are the parts at infinity of the projective closures of and , and is an open subset of while is closed. Hence, we have
[TABLE]
where last equality follows since
[TABLE]
So . ∎
We now consider the degree of Minkowski sums. Recall that the degree of a variety of dimension in or is the number of points in the intersection of and a general linear subspace of dimension .
Proposition 2
Let be the ground field with characteristic other than 2. Let be varieties which are disjoint at infinity. Then, for generic , in the same notation as in Proposition 1, we have that .
Proof
The proof will go in three main steps.
- (i)
Show that, up to projective equivalence, dilating by a generic and then applying the Cayley trick is the same as intersecting with a generic hyperplane whose affine part is parallel to . 2. (ii)
Prove that for generic the corresponding hyperplane intersects generically transversely. 3. (iii)
Apply Bézout’s theorem and show that the part of the intersection that is at infinity does not contribute to the degree.
Once again we use our Cayley trick and, to simplify computations, we fix and . Note that, for any , and are disjoint at infinity so we still get the conclusions of Proposition 1 and Theorem 3.2.
(i) For , let
[TABLE]
We consider as acting on with coordinates . For we have
[TABLE]
so is a group homomorphism .
Note that acts on the hyperplane as
[TABLE]
Similarly, fixes the hyperplane pointwise. Thus, and . Since acts as a projective transformation, and so takes lines to lines, . In particular,
[TABLE]
We know that , so we consider . We get
[TABLE]
and we find that, for ,
[TABLE]
Thus .
(ii) We claim that, for generic ,
* intersects generically transversely.*
First, note that it suffices to only consider the affine points of , i.e. those with , because
[TABLE]
But is the disjoint union of as ranges over , so for all but finitely many , must not be contained in the singular locus of . So, for all but finitely many , we have that must not be contained in the singular locus of . So for generic , the general point of is a smooth point of . In order to check transversality, we need another description of this intersection, which we compute now.
[TABLE]
where the second equality follows from Lemma 1.
Thus, considering , we have that is on the line between the points and , for some and . Since this line intersects transversely and contains this line, if is a smooth point of then we have that and intersect transversely at . Thus, for generic , intersects generically transversely.
(iii) For such an , applying Bézout’s theorem gives us that
[TABLE]
We can write as the disjoint union of the open subset and the closed subset . Now,
[TABLE]
has dimension and has dimension . Therefore,
[TABLE]
Finally, since
[TABLE]
we get . ∎
Corollary 2
Suppose has characteristic other than . Let be varieties whose projective closures are contained in complementary linear subspaces; equivalently, are contained in disjoint affine subspaces which are not parallel. Then for generic , .
Proof
Since and are contained in complementary linear spaces they are disjoint, so, in particular, and are disjoint at infinity.
By Proposition 2, for a generic , we have . Moreover, contained in complementary linear spaces also gives us that and are contained in complementary linear spaces, so ; see (Harris, , Example 18.17). So, for generic ,
∎
4 Hadamard products of projective varieties
We defined the Hadamard product of projective varieties as
[TABLE]
where is the point obtained by entry-wise multiplication of the points .
Also in this case the operation of closure is crucial.
Example 2
Consider the Hadamard product between the rational normal curve in and the point . Now, we obviously have . The equality follows because, if , then we have that . However, in this case the operation of taking the closure is needed in order to get the entire line; indeed, the points and cannot be written as the Hadamard product of a point in and the point .
Another useful way to describe the Hadamard product of projective varieties is as a linear projection of the Segre product of and , i.e., the variety obtained as the image of under the map
[TABLE]
If , with , , are the coordinates of the ambient space of the Segre product , then the Hadamard product is the projection of with respect to the linear space .
Therefore, as observed in Note 1, if and are irreducible, then is irreducible and the dimension of their Hadamard product is at most the sum of the dimensions of the original varieties, i.e.,
Example 3
It is easy to find examples where equality does not hold. Actually, the dimension of the Hadamard product of two varieties can be arbitrary small. E.g., consider two skew lines in as and . Then is empty.
A classic approach to compute the dimension of projective varieties is to look at their tangent space. From now, we consider as the ground field in order to avoid fuzzy behaviors caused by positive characteristics or non algebraically closed fields. Also, this is the case we want to consider in our applications.
In the case of joins, there is a result by A. Terracini T11 which describes the tangent space of the join at a generic point in terms of the tangent spaces of the original varieties. In BCK , the authors proved a version of this result for Hadamard products of projective varieties.
Lemma 3
(BCK, , Lemma 2.12)* Let and be generic points, then the tangent space to the Hadamard product at the point is given by*
[TABLE]
Another powerful tool to study Hadamard products of projective varieties is tropical geometry. In particular, we have the following relation. Since we are not using tropical geometry elsewhere, here we assume the reader to be familiar with the concept of tropicalization of a variety. For the inexperienced reader, we suggest to read MS for an introduction of the topic.
Proposition 3
(MS, , Proposition 5.5.11)* Given two irreducible varieties , the tropicalization of the Hadamard product of and is the Minkowski sum of their tropicalizations, i.e.,*
Applying this result, in BCK , the authors gave an upper-bound for the dimension of the Hadamard product of two varieties.
Proposition 4
(BCK, , Proposition 5.4)* Let be irreducible varieties. Let be the maximal subtorus acting on both and and let be the smallest subtorus having a coset containing and a coset containing . Then*
We call this upper bound expected dimension and denote it . However, this is not always the correct dimension. In BCK , the authors present an example of a Hadamard product of two projective varieties with dimension strictly smaller than the expected dimension.
From the definition of the Hadamard product of two varieties, it makes sense also to analyze self Hadamard products of a projective variety. We call them Hadamard powers of a projective variety.
Definition 4
We define the -th Hadamard power of a projective variety as
[TABLE]
where
In general, a projective variety is not contained in its Hadamard powers. However, if lies in the variety , we get the following chain of non necessary strict inclusions
[TABLE]
Therefore, it becomes very natural to check if the Hadamard powers of a projective variety eventually fill the ambient space. In general, the answer is no.
Proposition 5
Let be a toric variety in . Then,
Proof
Since any toric variety contains the point , it follows that . The other inclusion follows by applying Proposition 4 to the case . ∎
Remark 4
Recently, C. Bocci and E. Carlini gave a necessary and sufficient condition for a plane irreducible curve to have its -th Hadamard power equal to the curve itself. This result has been shared with us in private communication and will appear in BC .
Remark 5
Proposition 5 can be proved directly by recalling that the ideals defining toric varieties are given by binomial ideals, namely ideals whose generators are differences of monomials as , where and we use the multi-index notation .
Now, consider two points of , and . For any generator of the ideal defining , we have . Therefore,
[TABLE]
hence, .
Remark 6
Given a projective variety , the -th secant variety is the Zariski closure of the union of linear spaces spanned by points lying on . This is a very classical object that has been studied since the second half of -th century. In particular, we have a chain of non necessary strict inclusions given by
[TABLE]
Therefore, we can ask if the secant varieties of a variety eventually fill the ambient space. It is not difficult to prove that the answer is no. Indeed, if is a linear space, then and, therefore, if is degenerate, i.e., it is contained in a proper linear subspace of , then its secant varieties do not fill the ambient space.
Hadamard powers of projective varieties may be viewed as the multiplicative version of the classical notion of secant varieties where instead of looking at the linear span of points lying on a variety we consider their Hadamard product. Moreover, by Proposition 5, we have that the role played by linear spaces in the case of secant varieties is taken by toric varieties in the case of Hadamard products.
Example 4
A concrete example satisfying the assumptions of Proposition 5 is the variety of rank matrices of size . Indeed, it is generated by the minors of the generic matrix . Therefore, . This gives another proof of the well-known fact that the Hadamard product of two rank matrices is still of rank .
The latter example rises a very interesting question.
Question 2
What if we consider matrices of rank higher than ? Can we decompose all matrices as Hadamard products of rank matrices?
The answer is positive, as we show in the following proposition.
Proposition 6
Let be a matrix of size and fix . Then, can be written as the Hadamard product of at most matrices of rank less or equal than .
Proof
Without loss of generality, we may assume that and let be the rows of the matrix . Then, consider the following matrices :
[TABLE]
Then, it is easy to check that .
If , we do the same constructions, considering columns instead of rows. ∎
Therefore, it makes sense to give the following definitions.
Definition 5
Let be a matrix and fix . We call an -th Hadamard decomposition of an expression of the type We define the -th Hadamard rank of as the smallest length of such a decomposition, i.e.,
[TABLE]
We define the generic -th Hadamard rank of matrices of size as
[TABLE]
and the maximal -th Hadamard rank of matrices of size as
[TABLE]
We remark that these definitions may be seen as the multiplicative versions of the more common notion of tensor ranks, where we consider additive decompositions of tensors as sums of decomposable tensors. In terms of matrices, we look at decomposition as sums of rank matrices. A massive amount of work has been devoted to problems related to tensor ranks during the last few decades, especially due to their applications to statistics, data analysis, signal process, and others. See L for a complete exposition of the current state of the art.
Hadamard product of matrices, i.e., the entrywise product, is the naïve definition for matrix multiplication that any school student would hope to study. Even if it is not the standard multiplication we have been taught, it is a very interesting operation, with nice properties and applications in matrix analysis, statistics and physiscs. As mentioned in the introduction, the generalization to the case of tensors has been used in data mining and quantum information CMS ; PHYS . We look at it from a geometric point of view, by studying Hadamard powers of varieties of matrices.
For a fixed positive integer , we denote by the variety of matrices of size with rank at most . In other words, is the -th secant variety of the Segre product . These are well-studied classic objects. Since , the matrix of all ’s, which is the identity element for the Hadamard product, is contained in the variety , we have a chain of inclusions as in (1).
Remark 7
Our aim is to study Hadamard powers of the varieties of matrices with rank at most . As we observed before, we can view the Hadamard power as a linear projection of the Segre product . In terms of matrices, this is the geometric translation of the well-known fact that the Hadamard product of two matrices is a submatrix of their Kronecker product. Indeed, if and , we define the Kronecker product as . Then, , where denotes the restriction on the indexes and .
Hadamard powers of a specific space of tensors has been considered in CMS as the geometric interpretation of a particular statistical model. Therefore, we believe that the definitions of Hadamard ranks of matrices, and more generally of tensors, are very natural and may be an interesting area of research from several perspectives.
Proposition 6 gives us an upper bound on the -th Hadamard rank, i.e.,
We can also give a lower bound on the generic rank as a straightforward application of the following well-known property of Hadamard product of matrices.
Lemma 4
Given two matrices , we have that
Proof
Say that and . Consider the additive decomposition of and as sums of rank matrices, i.e.,
where are column vectors. Then, we get that
Therefore, we have that . ∎
As an immediate consequence of this lemma we see that that , for any . In particular, we obtain a lower bound on the generic Hadamard rank.
Corollary 3
Fix . Then, the generic -th Hadamard rank of matrices of size is at least .
Proof
If , then . Hence, the Hadamard product of matrices of rank cannot have maximal rank and, therefore, it cannot be enough to cover all the space of matrices of size .
Therefore, we have the following chain of inequalities.
[TABLE]
By this chain of inclusions we get the following result.
Proposition 7
Let and consider . Then, we have
Proof
On the left hand side of (2) we have
On the right hand side, we have , which is equal to if . Then, in order to conclude, we just need to prove the case .
Let . If we consider a matrix of rank , then it lies on . Assume that has rank and let , for , be the rows of . Consider the first two rows. If and are not both equal to zero, for all , then there exists a linear combination of with all entries different from zero and, therefore, we can decompose as follows
[TABLE]
If we have , for some , any linear combination of and will have the -th entry equal to zero. Therefore, we cannot use the previous algorithm. Hence, we define , for , as
Now, there exists a linear combination of with all entries different from zero. Therefore, if we define a row as
we can decompose as
Therefore, . ∎
Example 5
Consider the matrix . Then, we consider
Hence,
Remark 8
We proved that for , the -th Hadamard rank is equal to . Actually, the upper-bound in (2) let us be more precise. Indeed, we can say that for any , we get .
In other cases, we need a more geometric approach in order to understand the generic Hadamard rank. By using Proposition 4, we can define the expected dimension for the -th Hadamard power of the variety of rank matrices.
Proposition 8
In the same above notation,
[TABLE]
Proof
We proceed by induction on . For , it follows trivially from definitions. Consider . Then, since , by Proposition 4 and by inductive hypothesis, we get
[TABLE]
∎
We refer to the formula on the right hand side of (3) as the expected dimension of . More precisely, we have the following
[TABLE]
Therefore, the expected generic -th Hadamard rank is
[TABLE]
Remark 9
A very important concept in the world of tensors additive decomposition is the idea of identifiability, namely, we say that a tensor is identifiable if it has a unique decomposition as sum of decomposable tensors. Since we are viewing Hadamard decomposition as a multiplicative version of tensor decomposition, we might look for identifiability also in this set up. However, in this case, we cannot have identifiability for any matrix. Indeed, consider a -th Hadamard decomposition of a matrix , i.e., we have
then, for any -tuple of rank matrices , all with non-zero entries, we can construct a different -th Hadamard decomposition as
M=\big{(}R_{1}\star A_{1}\big{)}\star\cdots\star\big{(}R_{s-1}\star A_{s-1}\big{)}\star\big{(}(R_{1}\star\cdots\star R_{s-1})^{\star(-1)}\star A_{s}\big{)},
where denotes the Hadamard inverse of the matrix . Here, we have to recall that , for any , by Lemma 4, and, similarly, we have {\rm rk}\big{(}(R_{1}\star\cdots\star R_{s-1})^{\star(-1)}\star A_{s}\big{)}\leq{\rm rk}(A_{s}), because .
We can check that (3) is the actual dimension and, consequently, (4) gives the correct generic -th Hadamard rank for matrices of small size.
Here we describe an algorithm written with Macaulay2 to compute the dimensions of Hadamard powers of varieties of square matrices of given rank. This allows us to compute the corresponding generic Hadamard ranks (Table 1). We reduced to square matrices for simplicity of exposition, but the code can be easily generalized.
The key point is to use Lemma 3 which states that the tangent space to at a generic point is given by
[TABLE]
Hence, we first need to construct the tangent spaces at random points of .
Recall that, if is a matrix of rank written as , , the tangent space of at is given by
Here is the Macaulay2 code.
INPUT: n = sizes of matrices; r = rank of matrices; s = Hadamard power to compute;
OUTPUT: D = dimension of the s-th Hadamard power of the variety of rank r matrices of size nxn.
S := QQ[z_(1,1)..z_(n,n), a_(1,1)..a_(n,r),b_(1,1)..b_(n,r), c_(1,1)..c_(2r,n)]; ---- Construct s random matrices of rank r u = for i from 1 to s list for j from 1 to 2r list random(S^n,S^{0}); A = for i from 0 to (s-1) list sum ( for j from 0 to (r-1) list u_i_(2j) * transpose(u_i_(2j+1)) ); ---- Construct their tangent spaces C = for i from 1 to 2r list genericMatrix(S,c_(i,1),n,1); TA = for i from 0 to (s-1) list sum for j from 0 to (r-1) list u_i_(2j) * transpose C_(2j) + C_(2j+1) * transpose(u_i_(2*j+1));
Now, we construct the vector spaces spanning the tangent space of as in (5). First, we define a function HP to compute the Hadamard product of two matrices.
---- Method to construct the Hadamard product of a ---- list of matrices of same size; HP = method(); HP List := L -> ( s := #L; r := numRows(L_0); c := numColumns(L_0); for i from 1 to (s-1) do if (numRows(L_i)!=r or numColumns(L_i)!=c) then return << "error"; H := for i from 0 to (r-1) list for j from 0 to (c-1) list product ( for h from 0 to (s-1) list (L_h)j_i ); return matrix H ) ---- Construct the two vector spaces spanning the tangent ---- space of the Hadamard power and find their equations ---- in the space of matrices TAstar = for i from 0 to (s-1) list HP(toList(set{TA_i}+set(A)-set{A_i})); M = genericMatrix(S,z(1,1),n,n); H = for i from 0 to (s-1) list ideal flatten entries (M - TAstar_i); H1 = for i from 0 to (s-1) list eliminate(toList(c_(1,1)..c_(2*r,n)),H_i); T = QQ[z_(1,1)..z_(n,n)]; E = for i from 0 to (s-1) list sub(H1_i,T);
In E, we have the list of the equations of the tangent spaces to the variety at the random points. From these, we can construct a vector basis for each tangent space. Now, in order to compute the dimension of their span it is enough to compute the rank of the matrix obtained by collecting all these vector basis together.
K = for i from 0 to (s-1) list kernel transpose contract(transpose vars(T),mingens E_i); tt = mingens K_0 | mingens K_1; if s >= 3 then ( for i from 2 to (s-1) do tt = tt | mingens K_i ); D = rank tt
In the following table, we list the generic -th Hadamard ranks that we have computed for square matrices of small size.
Acknowledgements.
This article was initiated during the Apprenticeship Weeks (22 August-2 September 2016), led by Bernd Sturmfels, as part of the Combinatorial Algebraic Geometry Semester at the Fields Institute. The second author was supported by G S Magnuson Foundation from Kungliga Vetenskapsakademien (Sweden).
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1(1) Cristiano Bocci, Enrico Carlini, and Joe Kileel, Hadamard products of linear spaces, Journal of Algebra 448 (2016): 595-617.
- 2(2) Cristiano Bocci, Gabriele Calussi, Giuliana Fatabbi, and Anna Lorenzini, On Hadamard products of linear varieties, Journal of Algebra and its applications , to appear.
- 3(3) Cristiano Bocci and Enrico Carlini, Idempotent Hadamard powers of varieties, in preparation.
- 4(4) María Angélica Cueto, Jason Morton, and Bernd Sturmfels, Geometry of the restricted Boltzmann machine, Algebraic Methods in Statistics and Probability , (eds. M.Viana and H.Wynn), AMS, Contemporary Mathematics 516 (2010): 135-153.
- 5(5) Daniel R. Grayson, and Michael E. Stillman, Macaulay 2, a software system for research in algebraic geometry, Available at http://www.math.uiuc.edu/Macaulay 2 .
- 6(6) Joe Harris, Algebraic Geometry: A First Course, Graduate Texts in Mathematics 133 , Springer Science & Business Media New York (1992).
- 7(7) Roger A. Horn, Topics in Matrix Analysis, Cambridge University Press (1994).
- 8(8) Ludovico Lami and Marcus Huber, Bipartite depolarizing maps, Journal of Mathematical Physics 57 , no. 9 (2016).
