1. Introduction
Let be an irreducible and reduced non-degenerate variety. The rank with respect to X of a point is the minimal integer h such that p lies in the linear span of h distinct points of X. In particular, if we have that .
Since the h-secant variety of X is the subvariety of obtained as the closure of the union of all -planes spanned by h general points of X, for a general point we have .
When the ambient projective space is a space parametrizing tensors we enter the area of tensor decomposition. A tensor rank decomposition expresses a tensor as a linear combination of simpler tensors. More precisely, given a tensor
T, lying in a given tensor space over a field
k, a tensor rank-1 decomposition of
T is an expression of the form
where the
’s are linearly independent rank one tensors, and
. The rank of
T is the minimal positive integer
h such that
T admits such a decomposition.
Tensor decomposition problems come out naturally in many areas of mathematics and applied sciences. For instance, in signal processing, numerical linear algebra, computer vision, numerical analysis, neuroscience, graph analysis, control theory and electrical networks [
1,
2,
3,
4,
5,
6,
7]. In pure mathematics tensor decomposition issues arise while studying the additive decompositions of a general tensor [
8,
9,
10,
11,
12,
13,
14].
Comon’s conjecture [
3], which states the equality of the rank and symmetric rank of a symmetric tensor, and Strassen’s conjecture on the additivity of the rank of tensors [
15] are two of the most important and guiding problems in the area of tensor decomposition.
More precisely, Comon’s conjecture predicts that the rank of a homogeneous polynomial with respect to the Veronese variety is equal to its rank with respect to the Segre variety into which is diagonally embedded, that is .
Strassen’s conjecture was originally stated for triple tensors and then generalized to several different contexts. For instance, for homogeneous polynomials it says that if and are homogeneous polynomials in distinct sets of variables then .
In
Section 3 and
Section 4, while surveying the state of the art on Comon’s and Strassen’s conjectures, we push a bit forward some standard techniques, based on catalecticant matrices and more generally on flattenings, to extend some results on these conjectures, known in the setting of Veronese and Segre varieties, for Segre-Veronese and Segre-Grassmann varieties that is to the context of mixed tensors.
In
Section 5 we introduce a method to improve a classical result on Comon’s conjecture. By standard arguments involving catalecticant matrices it is not hard to prove that Comon’s conjecture holds for the general polynomial in
of symmetric rank
h as soon as
, see Proposition 1. We manage to improve this bound looking for equations for the
-secant variety
, not coming from catalecticant matrices, that are restrictions to the space of symmetric tensors of equations of the
-secant variety
. We will do so by embedding the space of degree
d polynomials into the space of degree
polynomials by mapping
F to
and then considering suitable catalecticant matrices of
rather than those of
F itself.
Implementing this method in Macaulay2 we are able to prove for instance that Comon’s conjecture holds for the general cubic polynomial in variables of rank as long as . Please note that for cubics the usual flattenings work for .
3. Comon’s Conjecture
It is natural to ask under which assumptions (
2) is indeed an equality. Consider the Segre-Veronese embedding
with
k-vector spaces of dimension
. Its composition with the diagonal embedding
is the Veronese embedding of
of degree
. Let
be the corresponding Veronese variety. We will denote by
the linear span of
in
.
In the notations of
Section 2.2 set
and
. For any symmetric tensor
we may consider its symmetric rank
and its rank
as a mixed tensor. Comon’s conjecture predicts that in this particular setting the inequality (
2) is indeed an equality [
3].
Conjecture 1 (Comon’s).
Let T be a symmetric tensor. Then .
Conjecture 1 has been generalized in several directions for complex border rank, real rank and real border rank, see Section 5.7.2 in [
16] for a full overview.
Please note that when Comon’s conjecture is true. Indeed, is cut out by the size minors of a general square matrix and is cut out by the size minors of a general symmetric matrix, that is .
Conjecture 1 has been proved in several special cases. For instance, when the symmetric rank is at most two [
3], when the rank is less than or equal to the order [
17], for tensors belonging to tangential varieties to Veronese varieties [
18], for tensors in
[
19], when the rank is at most the flattening rank plus one [
20], for the so called Coppersmith–Winograd tensors [
21], for symmetric tensors in
and also for symmetric tensors of symmetric rank at most seven in
[
22].
On the other hand, a counter-example to Comon’s conjecture has recently been found by Y. Shitov [
23]. The counter-example consists of a symmetric tensor
T in
which can be written as a sum of 903 rank one tensors but not as a sum of 903 symmetric rank one tensors. It is important to stress that for this tensor
T rank and border rank are quite different. Comon’s conjecture for border ranks is still completely open (Problem 25 in [
23]).
Even though it has been recently proven false in full generality, we believe that Comon’s conjecture is true for a general symmetric tensor, perhaps it is even true for those tensor for which .
In what follows we use simple arguments based on flattenings to give sufficient conditions for Comon’s conjecture, recovering a known result, and its skew-symmetric analogue.
Lemma 1. The tensors such that for a given flattening form a proper closed subset of . Furthermore, the same result holds if we replace the Segre-Veronese variety with the Segre-Grassmann variety .
Proof. Let
be a general point. Assume that
. This condition forces the
-flattening matrix to have rank at most
. On the other hand, by Proposition 4.1 in [
24] these minors do not vanish on
, and therefore define a proper closed subset of
. In the Segre-Grassmann setting we argue in the same way by using skew-flattenings. □
Proposition 1. [25] For any integer there exists an open subset such that for any the rank and the symmetric rank of T coincide, that is Proof. First of all, note that we always have
. Furthermore,
Section 2.1 yields that for any
-flattening
the inequality
holds. Since
T is symmetric and its catalecticant matrices are particular flattenings we get that
for any
.
Now, for a general
we have
, and if
, where
, then Lemma 1 yields
. Therefore, under these conditions we have the following chain of inequalities
and hence
. □
Now, consider the Segre-Plücker embedding with k-vector spaces of dimension . Its composition with the diagonal embedding is the Plücker embedding of with . Let be the corresponding Grassmannian and let us denote by its linear span in .
For any skew-symmetric tensor we may consider its skew rank that is its rank with respect to the Grassmannian , and its rank as a mixed tensor. Playing the same game as in Proposition 1 we have the following.
Proposition 2. For any integer there exists an open subset such that for any the rank and the skew rank of T coincide, that is Proof. As before for any tensor T we have . For any -skew-flattening we have . Furthermore, since is in particular a flattening also the inequality holds.
Now, for a general
we have
, and if
, where
, Lemma 1 yields
, where
is the skew-flattening corresponding to the partition
of
d. Therefore, we deduce that
and hence
. □
Remark 2. Propositions 1 and 2 suggest that whenever we are able to write determinantal equations for secant varieties we are able to verify Comon’s conjecture. We conclude this section suggesting a possible way to improve the range where the general Comon’s conjecture holds giving a conjectural way to produce determinantal equations for some secant varieties.
Set , -times, , d-times, and consider the corresponding Segre varieties , and Veronese varieties , . Fix the polynomial and let Π be the linear space spanned by the polynomials of the form , where F is a polynomial of degree d. This allow us to see . Please note that polynomials of the form lie in the tangent space of Y at , and therefore .
Hence for a polynomial F of degree d we have . Our aim is to understand when the equality holds.
We may mimic the same construction for the Segre varieties X and , and use determinantal equations for the secant varieties of to give determinantal equations of the secant varieties of X and henceforth conclude Comon’s conjecture. In particular, as soon as d is odd and , this produces new determinantal equations for and with . Therefore, this would give new cases in which the general Comon’s conjecture holds. Unfortunately, we are only able to successfully implement this procedure in very special cases, see Section 5. 4. Strassen’s Conjecture
Another natural problem consists in giving hypotheses under which in Equation (
3) equality holds. Consider the triple Segre embedding
, and let
be the corresponding Segre variety. Now, take complementary subspaces
,
,
, and let
be the Segre varieties associated respectively to
and
.
In the notations of
Section 2.2 set
,
and
. Strassen’s conjecture states that the additivity of the rank holds for triple tensors, or in onther words that in this setting the inequality (
3) is indeed an equality [
15].
Conjecture 2 (Strassen’s).
In the above notation let be two tensors. Then .
Even though Conjecture 2 was originally stated in the context of triple tensors that is bilinear forms, with particular attention to the complexity of matrix multiplication, several generalizations are immediate. For instance, we could ask the same question for higher order tensors, symmetric tensors, mixed tensors and skew-symmetric tensors. It is also natural to ask for the analogue of Conjecture 2 for border rank. This has been answered negatively [
26].
Conjecture 2 and its analogues have been proven when either
or
has dimension at most two, when
can be determined by the so called substitution method [
21], when
both for the rank and the border rank [
27], when
are symmetric that is homogeneous polynomials in disjoint sets of variables, either
is a power, or both
and
have two variables, or either
or
has small rank [
28], and also for other classes of homogeneous polynomials [
29,
30].
As for Comon’s conjecture a counterexample to Strassen’s conjecture has recently been given by Y. Shitov [
31]. In this case Y. Shitov proved that over any infinite field there exist tensors
such that the inequality in Conjecture 2 is strict.
In what follows, we give sufficient conditions for Strassen’s conjecture, recovering a known result, and for its mixed and skew-symmetric analogues.
Proposition 3. [25] Let be k-vector spaces of dimensions , and consider . Let and be two homogeneous polynomials. If there exists an integer such thatthen . Proof. Clearly,
holds in general. On the other hand, our hypothesis yields
where the last inequality follows from Remark 1. □
Remark 3. The argument used in the proof of Proposition 3 works for general only if for the generic rank we have . For instance, when the generic rank is 21 while the maximal dimension of the spaces spanned by partial derivatives is 20.
Proposition 4. Let and be k-vector spaces of dimension and respectively. Consider for every . Let and be two mixed tensors.
If for any there exists a pair with and -flattenings , as in (Section 2.1) such thatthen . Proof. Clearly,
. On the other hand, our hypothesis yields
where
denotes the
-flattening of the mixed tensor
. □
Arguing as in the proof of Proposition 4 with skew-symmetric flattenings we have an analogous statement in the Segre-Grassmann setting.
Proposition 5. Let and be k-vector spaces of dimension and respectively. Consider for every , and let and be two skew-symmetric tensors with .
If for any there exists a pair with and -skew-flattenings , as in (Section 2.1) such thatthen . 5. On the Rank of
In this section, building on Remark 2, we present new cases in which Comon’s conjecture holds. Recall, that for a smooth point
, the
a-osculating space of
X at
x is roughly the smaller linear subspace locally approximating
X up to order
a at
x, and the
a-osculating variety of
X is defined as the closure of the union of all the osculating spaces
For any
the osculating space
of order
a at the point
can be written as
Equivalently,
is the space of homogeneous polynomials whose derivatives of order less than or equal to
a in the direction given by the linear form
L vanish. Please note that
and
for any
. Moreover, for any
and
we can embed a copy of
into the osculating space
by considering
Remark 4. Let us expand the ideas in Remark 2. We can embedand Remark 2 yields that This embedding extends to an embedding at the level of Segre varieties, and, in the notation of Remark 2, we have that .
Assume that for a polynomial we have . Then . Now, if we find a determinantal equation of coming as the restriction to Π, the space of symmetric tensors, of a determinantal equation of , and not vanishing at then and hence proving Comon’s conjecture for F.
This will be the leading idea to keep in mind in what follows. The determinantal equations involved will always come from minors of suitable catalecticant matrices, that can be therefore seen as the restriction to Π of determinantal equations for the secants of the Segre coming from non symmetric flattenings.
It is easy to give examples where the inequality (
4) is strict. When
the generic rank is
. Then for
d odd we have
while for
d even we have
. Hence
if
, where
is the rational normal curve. It is natural to ask if the inequality is indeed an equality as long as the rank is subgeneric. In the case
we have the following result.
Proposition 6. Let be the degree d rational normal curve. If then there does not exist such that .
Proof. Clearly, it is enough to prove the statement for
. Let
be a general point. Then
with
general linear forms. In particular
Please note that . Now, assume that p is contained also in . Then there exists a linear subspace of dimension passing through p intersecting at points counted with multiplicity. Let be the points among the coinciding with some of the and such that the intersection multiplicity of and at is one, and be the points among the coinciding with some of the and such that the intersection multiplicity of and at is greater that or equal to two.
Set , then and intersects at points counted with multiplicity. Consider general points with , and the linear space . Therefore, and intersects at points counted with multiplicity. Since adding enough general points to we may construct a hyperplane in intersecting at points counted with multiplicity, a contradiction. □
Proposition 6 can be applied to get results on the rank of a special class of matrices called Hankel matrices.
Let
be a binary form and consider
as homogeneous coordinates on
. Furthermore, consider the matrices
It is well known that the ideal of
is cut out by the minors of
of size
[
4].
Now, consider a polynomial
with homogeneous coordinates
. Then
has homogeneous coordinates
with
To determine the rank of
we have to relate the rank of the matrices
with the rank of
.
Definition 1. A matrix such that whenever is called a Hankel matrix.
In particular all the matrices of the form and considered above are Hankel matrices.
Let be the vector space of matrices with coefficients in the base field k. For any let be the subvariety consisting of all matrices of rank at most h.
Now, consider the map given by and . For any we can view the subspace formed by matrices of the form as the subspace of Hankel matrices. Now, given any linear morphism we can ask if for some we have .
Corollary 1. Consider the linear morphismThen and . Proof. Since when we have that . By Proposition 6 , and by construction is the linear change of coordinates mapping a binary form to .
Since , if an minor of a general matrix B in does not vanish, under the assumption that all the minors of B vanish, then there is a minor of that does not vanish. □
When
we are able to determine, via Macaulay2 [
32] aided methods, the rank of
in some special cases.
- i
. The variety
is the hypersurface in
cut out by the Aronhold invariant, see for instance (Section 1.1 in [
4]). With a Macaulay2 computation we prove that if
is general then the Aronhold invariant does not vanish at
, hence
.
- ii
. The varieties
and
are both hypersurfaces, given respectively by the determinant of the catalecticant matrix of second partial derivatives and the Aronhold invariant (Section 1.1 in [
4]). With Macaulay2 we prove that the determinant of the second catalecticant matrix does not vanish at
for
general, hence
.
- iii
. The secant variety
is the hypersurface cut out by the second catalecticant matrix (Section 1.1 in [
4]) while
is the entire osculating space. A Macaulay2 computation shows that
. This proves that
, for
F general.
- iv
. In this case
and
is given by the determinant of the second catalecticant matrix (Section 1.1 in [
4]). Again using Macaulay2 we show that
. This proves that
, for
F general.
Corollary 2. For the osculating varieties and we have Proof. The action of on extends naturally to an action on stabilizing and more generally the secant varieties . Since this action is transitive on we have if and only if for any point that is . Finally, we conclude by applying iii and iv in the list above. □
Macaulay2 Implementation
In the Macaulay2 file Comon-1.0.m2 we provide a function called Comon which operates as follows:
- -
Comon takes in input three natural numbers ;
- -
if then the function returns that Comon’s conjecture holds for the general degree d polynomial in variables of rank h by the usual flattenings method in Proposition 1. If not, and d is even then it returns that the method does not apply;
- -
if d is odd and , where , then again it returns that the method does not apply;
- -
if d is odd, and then it returns that the method does not apply since must be smaller than the number of order k partial derivatives;
- -
if
d is odd,
and
then
Comon, in the spirit of Remark 4, produces a polynomial of the form
then substitutes random rational values to the
, computes the polynomial
, the catalecticant matrix
D of order
k partial derivatives of
G, extracts the most up left
minor
P of
D, and compute the determinant
of
P;
- -
if then Comon returns that the method does not apply, otherwise it returns that Comon’s conjecture holds for the general degree d polynomial in variables of rank h.
Please note that since the function random is involved Comon may return that the method does not apply even though it does. Clearly, this event is extremely unlikely. Thanks to this function we are able to prove that Comon’s conjecture holds in some new cases that are not covered by Proposition 1. Since the case is covered by Proposition 6 in the following we assume that .
Theorem 1. Assume and set . Then Comon’s conjecture holds for the general degree d homogeneous polynomial in variables of rank h in the following cases:
- -
and ;
- -
and ;
- -
and .
Proof. The proof is based on Macaualy2 computations using the function Comon exactly as shown in Example 1 below. □
Example 1. We apply the function Comon in a few interesting cases:
Macaulay2, version 1.12
with packages: ConwayPolynomials, Elimination, IntegralClosure, InverseSystems,
LLLBases, PrimaryDecomposition, ReesAlgebra, TangentCone
i1 : loadPackage "Comon-1.0.m2";
i2 : Comon(5,3,4)
Lowest rank for which the usual flattenings method does not work = 6
o2 = Comon’s conjecture holds for the general degree 3 homogeneous polynomial
in 6 variables of rank 4 by the usual flattenings method
i3 : Comon(5,3,6)
Lowest rank for which the usual flattenings method does not work = 6
o3 = Comon’s conjecture holds for the general degree 3 homogeneous polynomial
in 6 variables of rank 6
i4 : Comon(5,3,7)
Lowest rank for which the usual flattenings method does not work = 6
o4 = The method does not apply --- The determinant vanishes
i5 : Comon(5,5,21)
Lowest rank for which the usual flattenings method does not work = 21
o5 = Comon’s conjecture holds for the general degree 5 homogeneous polynomial
in 6 variables of rank 21
i6 : Comon(4,7,35)
Lowest rank for which the usual flattenings method does not work = 35
o6 = Comon’s conjecture holds for the general degree 7 homogeneous polynomial
in 5 variables of rank 35