Typical ranks of semi-tall real 3-tensors
Toshio Sumi, Mitsuhiro Miyazaki, Toshio Sakata

TL;DR
This paper investigates the typical ranks of semi-tall real 3-tensors, especially when p equals (m-1)(n-1)+1, revealing cases where the known relationship with nonsingular bilinear maps does not hold.
Contribution
It extends previous results by analyzing the case p=(m-1)(n-1)+1, showing that typical ranks can be p and p+1 even without the existence of certain nonsingular bilinear maps.
Findings
Typical ranks are p and p+1 in several cases including absence of nonsingular bilinear maps.
The 'only if' condition relating typical ranks to nonsingular bilinear maps does not always hold for p=(m-1)(n-1)+1.
The paper provides new insights into the structure of tensor ranks in semi-tall cases.
Abstract
Let , and be integers with and . We showed in previous papers that if , then typical ranks of -tensors over the real number field are and if and only if there exists a nonsingular bilinear map . We also showed that the "if" part also valid in the case where . In this paper, we consider the case where and show that the typical ranks of -tensors over the real number field are and in several cases including the case where there is no nonsingular bilinear map . In particular, we show that the "only if" part of the above mentioned fact does not valid for the case .
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsTensor decomposition and applications · Black Holes and Theoretical Physics · Advanced Neuroimaging Techniques and Applications
Typical ranks of semi-tall real 3-tensors
Toshio SUMI111Faculty of Arts and Science, Kyushu University, Fukuoka, Japan, Mitsuhiro MIYAZAKI222Department of Mathematics, Kyoto University of Education, Kyoto, Japan and Toshio SAKATA333Emeritus professor, Kyushu University, Fukuoka, Japan
(Version of )
Abstract
Let , and be integers with and . We showed in previous papers that if , then typical ranks of -tensors over the real number field are and if and only if there exists a nonsingular bilinear map . We also showed that the “if” part also valid in the case where . In this paper, we consider the case where and show that the typical ranks of -tensors over the real number field are and in several cases including the case where there is no nonsingular bilinear map . In particular, we show that the “only if” part of the above mentioned fact does not valid for the case .
Keywords: tensor rank, typical rank, tall tensor, semi-tall tensor, Bezout’s theorem, determinantal variety
MSC:15A69, 14P10, 14M12, 13C40
1 Introduction
Tensor rank is a subject which is widely studied in both pure and applied mathematics. A high dimensional array of datum is called a tensor in the field of data analysis. Precisely, let , …, be positive integers. A -dimensional array datum is called a -way tensor or simply a -tensor of format . For a set , the set of tensors with entries in is denoted by .
Let be a field and an -dimensional vector space over with fixed basis , …, for . Then there is a one to one correspondence between and by . A non-zero tensor corresponding to an element of of the form is called a rank 1 tensor. For a general tensor of format , the rank of , denoted by , is by definition the minimum integer such that can be expressed as a sum of rank 1 tensors, where we set the empty sum to be zero. Thus, the rank is a measure of the complexity of a tensor. Further, for a 2-tensor, i.e., a matrix, the rank is identical with the one defined in linear algebra.
However, for the case where , the behavior of rank is much more complicated than the matrix case. In the matrix case, the rank is the maximum size of non-zero minors. Thus, if is an infinite field, the set of matrices with rank form a Zariski dense open subset of . However, there are non-empty Euclidean open subsets of such that one consists of rank 2 tensors and the other one consists of rank 3 tensors. In particular, it is not possible to characterize the rank of a tensor by vanishing and/or non-vanishing of polynomials.
Let , , be positive integers. If the set of rank tensors of format over contains a non-empty Euclidean open subset of , we say that is a typical rank of tensors over . The set of typical ranks of tensors over is denoted as or simply .
If the base field is , the set of tensors of format with rank at most contains a non-empty Zariski open set if and only if its Zariski closure is (cf., Chevalley’s Theorem, see e.g., [Har92, p. 39]). Therefore, there exists exactly one “typical rank of tensors over ”. This is called the generic rank of tensors over and denoted as or simply .
It is fairly easy to show that (see e.g., [SSM16, Chapter 6]). Further if and only if the -th higher secant variety of the image of Segre embedding is the whole space , where denotes the projective space consisting of one dimensional subspaces of the -vector space . Thus, by counting the dimensions, we see that .
Suppose that . Then if and only if . Catalisano, Geramita, and Gimigliano [CGG02] (see also [CGG08]) proved that if , then . Thus, in these cases. ten Berge [tB00] called a -tensor with a tall array or a tall tensor and proved that for these cases (see [SSM16, Chapter 6] for another proof). Here we define a -tensor a semi-tall tensor if . We [SSM13, SMS15, SMS17] studied the plurality of typical ranks of semi-tall tensors and proved that if , then if there exists a nonsingular bilinear map and otherwise, where a bilinear map is nonsingular if implies or .
We also showed in [SMS17] that the former part of the above mentioned result also valid in the case where . Therefore, the latter part of the above mentioned result in the case where is left open. In this paper, we treat the case where and show that in several cases. In particular, we show that the latter part does not valid in the case where .
2 Preliminaries
Let be a field and . For , we set and denote . For and , we set . Note by the definition of rank.
We first state the definition of the typical rank over .
Definition 2.1
If the set of rank tensors over of format contains a non-empty Euclidean open subset of , then we say is a typical rank of tensors over . We denote the set of typical ranks of tensors over by or simply .
By the definition of the rank, we see the following fact.
Lemma 2.2
Let , and be positive integers. Then for any permutation , , of 1, 2, 3.
Definition 2.3
For , we set
[TABLE]
and
[TABLE]
and call flattenings of .
By the correspondence , where (resp. , ) is a vector space over of dimension (resp. , ) with fixed basis, flattenings correspond to natural isomorphisms and . In particular, and .
Definition 2.4
For , we set , , and .
Definition 2.5
Let be a commutative ring and . We denote by the ideal of generated by -minors of .
3 A condition of an -tensor to be of rank
From now on, let , and be integers with and . We set .
Fact 3.1
- (1)
. In particular, **[CGG02]**. 2. (2)
If , then **[tB00]**. 3. (3)
Suppose . If there exists a nonsingular bilinear map , then . Moreover, if , then the converse also hold true **[SSM13, SMS15, SMS17]**.
Therefore, the case where and there is no nonsingular bilinear map is still left open. In the following, we consider the case where and study if there are plural typical ranks of tensors over .
Before concentrating on the case where , we state notations and a criterion of an tensor to be of rank in the case where . Note that .
Definition 3.2
We set is nonsingular., is nonsingular., , , , , , and , .
Remark 3.3
[TABLE]
and for .
Definition 3.4
Let be a row vector of indeterminates, i.e., , …, are independent indeterminates. For , we set .
Definition 3.5
Let and be column vectors with entries in of dimension and respectively. We set , where denotes the Kronecker product, i.e., if , then .
For , we define to be the vector subspace of generated by .
Lemma 3.6
For , if and only if .
- Proof
Set and . Then by [SMS17, Theorem 6.5 (1)(3)], we see that if and only if there are and diagonal matrices , …, such that
[TABLE]
First suppose that there are and , …, which satisfy . If we set for , then
[TABLE]
for and
[TABLE]
is nonsingular. Therefore .
**Conversely, assume that . Then there are , …, and , …, such that , …, are linearly independent. Set for , for and . Then it is easily verified that and , …, satisfy . **
4 Determinantal varieties and Bezout’s theorem
From now on, we consider the case where . Then .
Definition 4.1
We set
[TABLE]
for and
[TABLE]
where and .
The next fact is the key lemma of this paper.
Lemma 4.2
Let be an indeterminate and . Then the following conditions are equivalent, where denotes the affine variety defined by an ideal .
- (1)
. 2. (2)
* is a factor of .*
In order to prove this lemma, we need some preparation. First we make the following
Definition 4.3
Let be an indeterminate and an infinite sequence of complex numbers. We set , for any .
It is easily verified that is an ideal of .
Now let , …, . Set for , and
[TABLE]
for , where the right hand side is an -determinant (some ’s may not appear for small ).
By the first row expansion, we see the following
Lemma 4.4
For , we have .
Set . By the above lemma, we see that . Further, since for and , there is no polynomial in whose degree is less than except the zero polynomial, i.e., is generated by .
Set
[TABLE]
and for integers , …, with , we denote by the maximal minor of consisting of the -th, …, -th rows of .
Now we state the following
Lemma 4.5
Under the notation above, the following conditions are equivalent.
- (1)
. 2. (2)
* for .* 3. (3)
* for and .* 4. (4)
* for .* 5. (5)
.
- Proof
Let
[TABLE]
be a matrix. Then for , where is the Kronecker’s delta.
(1)(3)****: Since and by assumption, we see that for . Thus, we see that for .
(3)(2)****: We see by the first row expansions of and and the assumption that
[TABLE]
for .
(2)**(1)**** follows from the fact that the last rows of are linearly independent, (3)(4) follows from the facts that and and Lemma 4.4 and (4)(5) follows from the definition of . **
Since if and only if and if and only if divides , we see Lemma 4.2 by Lemma 4.5.
Now we recall the following facts about determinantal varieties (see e.g. [Har92, p.151 and p.243]).
Fact 4.6
*Let be a matrix of indeterminates. Then the projective variety in defined by has degree and codimension . *
Note that and since . Note also that there are monic factors of of degree in .
In view of this fact, we make the following
Definition 4.7
For , we set , .
Then by Lemma 4.2, Fact 4.6 and Bezout’s theorem, we see the following
Corollary 4.8
Let be the linear subspace of defined by . Then and intersect transversely at distinct points, where denotes the projective variety defined by the homogeneous ideal .
By the implicit function theorem, we see the following fact.
Corollary 4.9
There is a Euclidean open neighborhood of in such that if , then is injective and the number of real points of is the number of real monic polynomials of degree which divide , where we say a point of a complex projective space is real if all possible ratios of its homogeneous coordintes are real numbers.
We denote the number of real monic polynomials of degree which divides by . Then we see the following
Lemma 4.10
[TABLE]
By replacing to a smaller neighborhood if necessary, we may assume that for any and (cf. [SMS17, Corollary 4.20]). Then we have the following fact.
Lemma 4.11
Suppose . Then , where denotes the point of defined by .
5 Plural typical ranks of some formats of 3-tensors
In this section, we show that in certain formats of 3-tensors, there are plural typical ranks. We use the notation of the previous section.
First we recall the following fact.
Fact 5.1** ([SMS17, Proposition 2.4, Lemma 3.5, Theorems 7.3 and 8.1])**
If and are not bit-disjoint, then , where two positive integers are bit-disjoint if there are no 1’s in the same place of their binary notation.
Example 5.2
in the following cases.
- (1)
Both and are even. 2. (2)
and . 3. (3)
and . 4. (4)
and . 5. (5)
and . 6. (6)
and .
Set . Then there is a permutation matrix such that . Set and . Further set , and , where is the map defined in Definition 3.2. Then is an open neighborhood of . Further, we see the following fact by Lemma 4.11.
Lemma 5.3
If , then .
Since contains , is not an empty set. Therefore, we see by Lemma 3.6 that if , then there exists a non-empty Euclidean open subset of consisting of tensors of rank larger than . Further, since we see by [SMS17, Theorem 8.1] that typical ranks of tensors are less than or equal to , we see the following fact.
Lemma 5.4
If , then .
Now we state the following
Theorem 5.5
Suppose and . Then in the following cases.
- (1)
* or .* 2. (2)
* and or .* 3. (3)
* and .* 4. (4)
* and .* 5. (5)
* and .*
- Proof
**By Lemma 4.10 and computation, we see that in the following cases: (1) or , (2) and or , (3) and , (4) and , (5) and and (6) and . Thus, we see the result by Example 5.2 and Lemma 5.4. **
Remark 5.6
Set and . Then and are bit-disjoint. However, by Theorem 5.5, we see that . Thus the converse of Fact 5.1 does not valid.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[CGG 02] M. V. Catalisano, A. V. Geramita, and A. Gimigliano, Ranks of tensors, secant varieties of Segre varieties and fat points , Linear Algebra Appl. 355 (2002), 263–285.
- 2[CGG 08] M. V. Catalisano, A. V. Geramita, and A. Gimigliano, On the ideals of secant varieties to certain rational varieties , J. Algebra 319 (2008), no. 5, 1913–1931.
- 3[Har 92] Joe Harris, Algebraic geometry, A first course. , Graduate Texts in Mathematics, vol. 133, Springer-Verlag, New York, 1992,
- 4[SSM 16] Toshio Sakata, Toshio Sumi and Mitsuhiro Miyazaki, Algebraic and Computational Aspects of Real Tensor Ranks , Springer Briefs in Statistics, Springer, 2016.
- 5[SMS 15] Toshio Sumi, Mitsuhiro Miyazaki and Toshio Sakata, Typical ranks of m × n × ( m − 1 ) n 𝑚 𝑛 𝑚 1 𝑛 m\times n\times(m-1)n tensors with 3 ≤ m ≤ n 3 𝑚 𝑛 3\leq m\leq n over the real number field , Linear Multilinear Algebra 63 (2015), no. 5, 940–955.
- 6[SMS 17] Toshio Sumi, Mitsuhiro Miyazaki and Toshio Sakata, Typical ranks for 3-tensors, nonsingular bilinear maps and determinantal ideals, Journal of Algebra, 471 409–453 (Feb. 2017)
- 7[SSM 13] Toshio Sumi, Toshio Sakata and Mitsuhiro Miyazaki, Typical ranks for m × n × ( m − 1 ) n 𝑚 𝑛 𝑚 1 𝑛 m\times n\times(m-1)n tensors with m ≤ n 𝑚 𝑛 m\leq n , Linear Algebra and its Application, 438 953–958 (Jan. 2013).
- 8[t B 00] Jos M. F. ten Berge, The typical rank of tall three-way arrays , Psychometrika 65 (2000), no. 4, 525–532.
