Sign Patterns of Orthogonal Matrices and the Strong Inner Product Property
Bryan A. Curtis, Bryan L. Shader

TL;DR
This paper introduces the strong inner product property, a new condition for constructing sign patterns of orthogonal matrices, and provides algorithms for verifying this property, revealing new combinatorial insights.
Contribution
The paper presents the strong inner product property, new algorithmic techniques for verification, and constructs infinite families of sign patterns for row orthogonal matrices.
Findings
Infinite families of sign patterns allowing row orthogonality
Algorithmic methods for verifying the strong inner product property
Insights into the combinatorial structure of orthogonal matrices
Abstract
A new condition, the strong inner product property, is introduced and used to construct sign patterns of row orthogonal matrices. Using this property, infinite families of sign patterns allowing row orthogonality are found. These provide insight into the underlying combinatorial structure of row orthogonal matrices. Algorithmic techniques for verifying that a matrix has the strong inner product property are also presented. These techniques lead to a generalization of the strong inner product property and can be easily implemented using various software.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Sign Patterns of Orthogonal Matrices and the Strong Inner Product Property
Bryan A. Curtis
Bryan L. Shader
Department of Mathematics, University of Wyoming, Laramie, WY 82071, USA
Abstract
A new condition, the strong inner product property, is introduced and used to construct sign patterns of row orthogonal matrices. Using this property, infinite families of sign patterns allowing row orthogonality are found. These provide insight into the underlying combinatorial structure of row orthogonal matrices. Algorithmic techniques for verifying that a matrix has the strong inner product property are also presented. These techniques lead to a generalization of the strong inner product property and can be easily implemented using various software.
keywords:
Strong inner product property , sign pattern , orthogonality , orthogonal matrix , row orthogonal matrix
MSC:
[2010] 15B10 ,
MSC:
[2010] 15B35
1 Introduction
Characterizing the sign patterns of orthogonal matrices has been of interest since the early 1960’s. This endeavor was first proposed by M. Fiedler, in June 1963, at the Symposium on the Theory of Graphs and Its Applications [1]. More recently there has been renewed interest in sign patterns of orthogonal matrices [2], [3], and in related qualitative and combinatorial problems [4], [5], [6]. There has been some success in characterizing the sign patterns of orthogonal matrices for small orders or with additional combinatorial constraints [7], [8], [9]. As of the publication of this paper there is no characterization for orders .
For many years the only known necessary condition for a sign pattern to allow orthogonality was potential orthogonality; that is the rows (respectively columns) are nonzero and the sign patterns of each pair of rows (respectively columns) have a realization that are orthogonal. The first example of a potentially orthogonal sign pattern not allowing orthogonality was given in 1996 [9]. Shortly after this observation, Johnson and Waters provided the first necessary condition stronger than potential orthogonality [8]. It is still not known whether this necessary condition is sufficient.
Developing sufficient conditions has also had some success in the literature. A common technique is to take a known orthogonal matrix and search for “nearby” orthogonal matrices. Givens rotations can be used to perturb certain zero entries of orthogonal matrices without affecting the sign of the nonzero entries [6]. The implicit function theorem has also been used in conjunction with special classes of orthogonal matrices [9]. In this paper we introduce the strong inner product property, a tool that guarantees the existence of sign patterns of orthogonal matrices by perturbing the entries of “nicely” behaved orthogonal matrices. The strong inner product property surpasses previous methods in its ability to construct numerous examples of sign patterns of orthogonal matrices.
The next section provides the preliminary definitions and notation necessary to discuss sign patterns of orthogonal matrices. In Section 3 we introduce the strong inner product property and develop some basic results. Section 4 provides the motivation behind, and describes how to apply, the strong inner product property. In section 5 we consider some applications of the strong inner product property. We conclude with a generalization of the strong inner product property and a useful verification technique in Section 6.
2 Preliminaries and Notation
All matrices in this paper are real. Throughout, we restrict to be integers. The symbols and represent the zero and identity matrices of appropriate sizes, respectively. Let denote the set of all real matrices, Skewn the set of all skew symmetric matrices, and Symn the set of all symmetric matrices. A matrix (respectively vector ) is nowhere zero if every entry in (respectively ) is nonzero. A matrix has full rank if its rank is the largest possible. Define to be the matrix with a 1 in position and 0 elsewhere. If there is ever ambiguity in the dimensions of we will specify. The set of row orthogonal matrices is
[TABLE]
if we abbreviate this to .
The support of a matrix (respectively vector ) is the set of indices corresponding to the nonzero entries of (respectively ). For , and the submatrix of with rows indexed by and columns indexed by is denoted by ; in the case that this is shortened to and similarly for . The Hadamard (entrywise) product of the matrices and is denoted by . For a matrix , denotes the column vector of dimension obtained by stacking together the columns of . For example, if
[TABLE]
Notice is indexed by the pairs , and , in reverse lexicographic order, and is a bijective linear map.
The sign of a real number is
[TABLE]
A sign pattern is a -matrix and the sign pattern of a matrix , written , is the sign pattern whose -entry is . Given an sign pattern , the qualitative set of is
[TABLE]
The sign pattern allows orthogonality if there exists a (row) orthogonal matrix . The super pattern of in the direction of the sign pattern is the matrix having -entry equal to if and otherwise. For example, if
[TABLE]
then
[TABLE]
3 Strong Inner Product Property
We begin with the definition of the strong inner product property and some basic results.
Definition 3.1**.**
The matrix with has the strong inner product property (SIPP) provided has full rank and is the only symmetric matrix satisfying .
At first glance the strong inner product property may seem unnatural. However, as we will see in Section 4, the strong inner product property manifests when properly chosen manifolds intersect transversally.
In future sections we apply the SIPP to row orthogonal matrices. As row orthogonal matrices have full rank, the condition “ has full rank” in Definition 3.1 seems unnecessary. This condition is justified when taking a closer look at the motivation behind the SIPP. In particular, the techniques in Section 4 can be applied to the family of matrices
[TABLE]
where is a fixed positive definite matrix. When is positive definite the theory in Section 4 leads to the above definition of the SIPP. Requiring full rank ensures is positive definite. We focus on the SIPP for row orthogonal matrices but give its properties in the general setting.
The terminology SIPP follows that of the strong Arnol’d property which uses similar ideas to obtain results about the maximum nullity of a certain family of symmetric matrices associated with a graph [10]. There have been other generalizations of the strong Arnol’d property in different settings [4].
In the case that and is invertible the conditions required to have the SIPP can be simplified.
Theorem 3.2**.**
Suppose is invertible. Then has the SIPP if and only if is the only matrix such that is symmetric and .
Proof.
Suppose that has the SIPP. Let be an matrix such that is symmetric and . Let so that . Then is symmetric and . Since has the SIPP, and consequently, .
Conversely, suppose that is the only matrix such that is symmetric and . Let be a symmetric matrix such that . Let so that is symmetric and . By our assumptions . Hence , and since is invertible, . Therefore, has the SIPP. ∎
If we further restrict to be orthogonal then we have the following useful corollary.
Corollary 3.3**.**
Suppose . Then has the SIPP if and only if is the only matrix such that the dot product between row of and row of equals the dot product between row of and row of for all and , and .
Proof.
This equivalence follows from Theorem 3.2 and the observation that the -entry of is the dot product between the -th row of and the -th row of . ∎
When studying (row) orthogonal matrices there are two convenient types of equivalence. A signed permutation matrix is a square sign pattern with exactly one nonzero entry in each row and column. Matrices are sign equivalent if , where and are signed permutation matrices. If , the matrices and are equivalent if is sign equivalent to or . Both forms of equivalence preserve (row) orthogonality and the combinatorial structure of the corresponding sign patterns. Not surprisingly, sign equivalence preserves having the SIPP. However, the same cannot always be said about equivalence (see Example 3.7).
Lemma 3.4**.**
Let be sign equivalent. Then has the SIPP if and only if has the SIPP.
Proof.
It suffices to assume that has the SIPP and show that has the SIPP. Since and are sign equivalent, , where and are signed permutation matrices. Hence has full rank. Let X\in\text{\rm Sym{}_{m}} and . Then is symmetric and . Suppose that . Then
[TABLE]
and so . Since has the SIPP, . Consequently,
[TABLE]
Therefore, has the SIPP. ∎
We now show that if are equivalent, then has the SIPP if and only if has the SIPP. By Lemma 3.4 it suffices to prove the case .
Proposition 3.5**.**
Let . Then has the SIPP if and only if has the SIPP.
Proof.
It suffices to assume that has the SIPP and show that has the SIPP. Let . Suppose that is symmetric and . By Theorem 3.2 it remains to show that . Note that . Since ,
[TABLE]
Thus, is symmetric. Further, since . Having assumed has the SIPP, and so has the SIPP. ∎
If is nowhere zero and has full rank, then has the SIPP (if , then implying that ). On the other hand, Corollary 4.6 suggests that the SIPP becomes exceedingly rare amongst sparse matrices. Lemma 3.6 demonstrates that matrices must avoid certain structural barriers in order to have the SIPP.
Lemma 3.6**.**
Let . If has two rows with disjoint support, then does not have the SIPP.
Proof.
Assume that has two rows with disjoint support. Up to permutation of rows and columns has the form
[TABLE]
where and are nonzero. Observe that the symmetric matrix
[TABLE]
satisfies . However, implying that . Therefore, the matrix does not have the SIPP. ∎
There is no analog of Lemma 3.6 for the columns of a matrix , i.e. can have columns with disjoint support and the SIPP (see Proposition 3.10). Having established Lemma 3.6 we can now show that Proposition 3.5 does not hold for arbitrary invertible square matrices.
Example 3.7**.**
Consider
[TABLE]
Then
[TABLE]
By Lemma 3.6 does not have the SIPP.
On the other hand, does have the SIPP. To see this, let satisfy . Then must have the form
[TABLE]
Assuming is symmetric implies .
The proof of Proposition 3.5 relies on the fact that is the inverse of when . It may therefore be tempting to try and prove that if has the SIPP then so must . As the next example illustrates, this is not always the case.
Example 3.8**.**
Consider
[TABLE]
Then
[TABLE]
Since is nowhere zero, it has the SIPP. To see that does not have the SIPP, choose
[TABLE]
and note that and is symmetric.
Occasionally it is possible to verify that a matrix has the SIPP by checking if a certain submatrix has the SIPP.
Proposition 3.9**.**
Assume . Let and for some .
- (i)
If has the SIPP, then has the SIPP. 2. (ii)
If has the SIPP, the rows of are linearly independent and is nowhere zero, then has the SIPP.
Proof.
We begin by proving (i). Assume has the SIPP. Let \hat{X}\in\text{\rm Sym{}_{m}} satisfy . We must show that . Consider the symmetric matrix
[TABLE]
Then
[TABLE]
Since has the SIPP we know that . Thus, and so has the SIPP.
We now prove (ii). Assume has the SIPP, the rows of are linearly independent and is nowhere zero. Let X\in\text{\rm Sym{}_{m+1}} satisfy . We must show that . Observe that has the form
[TABLE]
for some \hat{X}\in\text{\rm Sym{}_{m}}, and . Then
[TABLE]
and so
[TABLE]
Since is nowhere zero, (2) becomes
[TABLE]
Having assumed the rows of are linearly independent, we conclude that and . Since , (1) reduces to and since has the SIPP, . Hence proving that has the SIPP. ∎
Proposition 3.10**.**
Let and . Then has the SIPP if and only if the matrix B=\left[\begin{array}[]{@{}c|c@{}}A&O\end{array}\right] has the SIPP.
Proof.
Clearly has full rank if and only if has full rank.
Begin by assuming has the SIPP. Let X\in\text{\rm Sym{}_{m}} and suppose . Then and since has the SIPP, we have . Thus, has the SIPP.
Now assume has the SIPP. Let X\in\text{\rm Sym{}_{m}} and suppose . Then and since has the SIPP . Thus, has the SIPP. ∎
4 Development and Motivation Behind the SIPP
The primary goal in this section is to motivate and rigorously develop the SIPP. We will also show how to use families of (preferably sparse) matrices with the SIPP to obtain larger families of sign patterns that allow orthogonality. In order to accomplish this, it is necessary to understand some facts about smooth manifolds. We refer the reader to [11] for more details.
Let be a smooth manifold in and let . Define to be the set of smooth paths , and let be the derivative of with respect to . The tangent space of at is
[TABLE]
and the normal space to at , denoted , is the orthogonal complement of . Note that as vector spaces
[TABLE]
Let and be an sign pattern. Both and are smooth manifolds [11] and can both be thought of as submanifolds of with inner product
[TABLE]
This identification follows from . Notice that there exists a matrix with sign pattern if and only if the intersection of and is nonempty.
The smooth manifolds and , both in , intersect transversally at if
[TABLE]
or equivalently
[TABLE]
A smooth family of manifolds in is defined by a continuous function , where is an open set in and for each the function is a diffeomorphism between and the manifold . Theorem 4.1 below is a specialization of Lemma 2.2 in [10] and is stated with proof in [4].
Theorem 4.1** (Holst et al. [10]).**
Let and be smooth families of manifolds in , and assume that and intersect transversally at . Then there is a neighborhood of the origin and a continuous function such that and for each , and intersect transversally at .
It is useful to think of Theorem 4.1 as saying if the manifolds and intersect transversally, then small perturbations of and still intersect (transversally) in a continuous way. Our aim is to apply these ideas to and . This requires the appropriate tangent and normal spaces.
The Stiefel manifold . Observe that if and only if . Since this identification preserves dimension we may use the calculation of in [12] to obtain
[TABLE]
Note that for every there exists a matrix such that ; is not unique unless . With these observations we now compute the tangent space of .
Lemma 4.2**.**
Let . Then
[TABLE]
Further, there exists some such that
[TABLE]
Proof.
Let be a differentiable path in such that . Then and by taking derivatives of both sides
[TABLE]
It follows that is contained in the vector space
[TABLE]
Let satisfy QP^{T}=\left[\begin{array}[]{@{}c|c@{}}I&O\end{array}\right]. For each let so that . Using the substitution
[TABLE]
Notice that Y[I\ O]^{T}\in\text{\rm Skew{}{m}} implies has the form \left[\begin{array}[]{@{}c|c@{}}K&L\end{array}\right] for some K\in\text{\rm Skew{}{m}} and . Thus,
[TABLE]
It follows from the invertibility of that has the same dimension as
[TABLE]
Thus,
[TABLE]
where the last equality comes from (3). Therefore, . ∎
The second representation of in Lemma 4.2 will prove useful in Section 6 when we introduce the verification matrices. The first representation facilitates the proof of the following lemma. We next determine the normal space .
Lemma 4.3**.**
Let . Then
[TABLE]
Proof.
Let
[TABLE]
Let XQ^{T}\in\text{\rm Skew{}{m}} and Z\in\text{\rm Sym{}{m}}. Then
[TABLE]
with the last equality coming from being symmetric and being skew-symmetric. Hence, by Lemma 4.2, is contained in . Since the rows of are linearly independent, the dimension of is equal to the dimension of Symm. Thus,
[TABLE]
where the second equality follows from (1). We conclude that . ∎
We now compute the tangent and normal spaces of the manifold of matrices with a given sign pattern .
Lemma 4.4**.**
Let have sign pattern . Then
[TABLE]
and
[TABLE]
Proof.
For each and , where , define to be the path on given by . Then and . Thus,
[TABLE]
Now let such that . Then for each and so . Therefore, , as desired.
For the normal space we have
[TABLE]
We note that if is an , positive definite matrix, then
[TABLE]
is a smooth manifold [11]. Hence one can talk about its tangent and normal space, and how it intersects the manifold of a given sign pattern transversally at a given matrix. Thus, similar results to Lemmas 4.2 - 4.3 and Theorem 4.5 hold. We do not need that level of generality in this study.
We now show how the transverse intersection of and is related to the SIPP and how a (row) orthogonal matrix having the SIPP gives rise to many sign patterns that allow orthogonality. This will be used heavily in Section 5.
Theorem 4.5**.**
Let have sign pattern . The manifolds and intersect transversally at if and only if has the SIPP. Further, if has the SIPP, then every super pattern of allows orthogonality.
Proof.
[TABLE]
Thus, if and only if has the SIPP.
Suppose that has the SIPP and let be any sign pattern. Define the smooth family of manifolds by
[TABLE]
for . Then the manifolds and intersect transversally at . Thus, for sufficiently small, Theorem 4.1 guarantees a continuous function such that and intersect transversally at and . Since we know that for sufficiently small has sign pattern . Further, implies allows orthogonality. ∎
Theorem 4.5 is most effective at producing new sign patterns allowing orthogonality when is sparse. The following corollary gives a bound on the number of zero entries a matrix with the SIPP can have. The bound in Corollary 4.6 is sharp as can be seen in Example 6.12.
Corollary 4.6**.**
Let have the SIPP. Then the number of zero entries in is bounded above by .
Proof.
Let be the sign pattern of and denote the number of zero entries in . By (3), . Further, by Theorem 4.5, the matrix has the SIPP if and only if . We conclude that
[TABLE]
5 Families of Sign Patterns and Consequences of the SIPP
We now give some consequences of matrices having the SIPP and several examples of families of sign patterns which allow orthogonality. The first example follows immediately from Proposition 3.10 and Theorem 4.5.
Corollary 5.1**.**
Let have sign pattern and let be an sign pattern with . If has the SIPP then the sign pattern \left[\begin{array}[]{@{}c|c@{}}S&O\end{array}\right]_{\vec{R}} allows orthogonality.
Considering Corollary 5.1, it is reasonable to ask if an sign pattern allows orthogonality, then must it contain an subpattern that allows orthogonality. As was pointed out in the final remark of [8], the sign pattern
[TABLE]
allows orthogonality, but does not have a submatrix that allows orthogonality.
Our next example concerns orthogonal Hessenberg matrices. The Hessenberg matrix
[TABLE]
is row orthogonal. Hence for each there is a least one orthogonal Hessenberg matrix. Remarkably, the proof that orthogonal Hessenberg matrices have the SIPP does not depend on the signs of its entries. This is not always the case.
Corollary 5.2**.**
Let and have zero-nonzero pattern
[TABLE]
Then every super pattern of allows orthogonality.
Proof.
Suppose that is a matrix such that and the dot product between the -th row of and -th row of equals the dot product between the -th row of and the -th row of for all and . By Corollary 3.3, it suffices to show that .
Since , whenever . Consequently, row of and row of are orthogonal whenever . By our assumptions, row of and row of are orthogonal whenever . Hence, each row of is orthogonal to every row of . Since the rows of form an orthonormal basis of , we conclude that . Therefore, has the SIPP and by Theorem 4.5 every super pattern of allows orthogonality. ∎
In [6] Givens rotations are used to find sign patterns that allow orthogonality. As we will see, the techniques used there are not sufficient to prove Corollary 5.2.
A Givens rotation is an orthogonal matrix that fixes all but two of the coordinate axes and rotates the plane spanned by these two coordinate axes. For let denote the Givens rotation which rotates the -plane counterclockwise by radians.
Let have columns and rows . Postmultiplying by replaces column by , replaces column by and does not affect the remaining entries of . Similarly, premultiplying by replaces row by , replaces row by and does not affect the remaining entries of .
Let have sign pattern . Let denote the sign pattern obtained from by replacing row and row by the negative of row and row respectively. Let denote the sign pattern obtained from by replacing column and column by column and the negative of column respectively. Then there exists a such that
[TABLE]
By Corollary 5.2 the sign pattern
[TABLE]
allows orthogonality. However, there is no way to obtain an orthogonal matrix from an orthogonal Hessenberg with this sign pattern using a sequence of products of Givens rotations as described above. In particular, having a 1 in the and entries would require a nonzero sign in the or entry.
We next show that a row orthogonal matrix with the SIPP cannot have a large zero submatrix. First, we give a result about row orthogonal matrices.
Lemma 5.3**.**
Let have the form
[TABLE]
where is . Then . In particular, if is nonzero, then .
Proof.
Since is row orthogonal, the rows of are orthogonal to the rows of . This, along with the observation that is , gives
[TABLE]
Since the rows of are linearly independent, . Thus,
[TABLE]
Note that there exist row orthogonal matrices with a zero submatrix such that . The next result shows such matrices do not have the SIPP.
Proposition 5.4**.**
Let have a zero submatrix. If has the SIPP, then .
Proof.
Suppose that . By Lemma 5.3, has the form
[TABLE]
Thus, by Lemma 3.6, does not have the SIPP. ∎
The next two propositions show how to construct row orthogonal matrices with the SIPP and a zero submatrix such that .
Proposition 5.5**.**
Let have the form
[TABLE]
where is nowhere zero and both and have the SIPP. Then has the SIPP.
Proof.
Let be an symmetric matrix such that . Partition as
[TABLE]
where (resp. ) is a symmetric (resp. ) matrix. As and is nowhere zero, we have
[TABLE]
The fact that has the SIPP, the symmetry of and (6) imply that
[TABLE]
Thus, (5) becomes and since the rows of are orthogonal, postmultiplying by gives
[TABLE]
Now (4) simplifies to . The symmetry of and the fact that has the SIPP imply
[TABLE]
Equations (7)-(9) imply that . Therefore, has the SIPP. ∎
We can use Proposition 3.9 to obtain the next result.
Proposition 5.6**.**
Let and N=\left[\begin{array}[]{@{}c|c@{}}\mathbf{b}&B\end{array}\right] be row orthogonal matrices, where and are nowhere zero vectors. Then
[TABLE]
is row orthogonal. Further, has the SIPP if and only if and have the SIPP.
Proof.
The matrix is row orthogonal since
[TABLE]
Assume that and have the SIPP. Suppose that
[TABLE]
where and are symmetric. Then
[TABLE]
Post-multiplying (11) by gives . This, (11) and the linear independence of the rows of imply that . By Proposition 3.9, has the SIPP. Hence (10) implies that . Note Z\left[\begin{array}[]{@{}c|c@{}}\mathbf{b}&B\end{array}\right]=\left[\begin{array}[]{@{}c|c@{}}\mathbf{0}&BZ\end{array}\right]. So (Z\left[\begin{array}[]{@{}c|c@{}}\mathbf{b}&B\end{array}\right])\circ\left[\begin{array}[]{@{}c|c@{}}\mathbf{b}&B\end{array}\right])=O. Since \left[\begin{array}[]{@{}c|c@{}}\mathbf{b}&B\end{array}\right] has the SIPP, . Thus, we have shown has the SIPP.
Now assume that has the SIPP. Let and by symmetric matrices satisfying and . Note and . Thus,
[TABLE]
Since has the SIPP, and . Therefore, and have the SIPP. By Proposition 3.9, has the SIPP. ∎
For us, a hollow matrix is a square matrix with zeros along the diagonal and nonzero entries off the diagonal. A signature matrix is a diagonal matrix each of whose diagonal entries are either 1 or . Two matrices and are signature equivalent if , where and are signature matrices.
Theorem 5.7**.**
Let be hollow. Then has the SIPP if and only if is not signature equivalent to a symmetric hollow matrix.
Proof.
We begin by proving that if is signature equivalent to a symmetric hollow matrix then does not have the SIPP. By Lemma 3.4 it suffices to assume is a symmetric hollow matrix. Then is symmetric and . Thus, does not have the SIPP.
Conversely, assume does not have the SIPP. Then there exists a nonzero such that and is symmetric. Since is nonzero and we know with some . Then some has the largest magnitude amongst . Since is symmetric for . Further, since is orthogonal
[TABLE]
Thus, must have the same magnitude, say . It follows that where is a signature matrix. Since is symmetric, is symmetric. Thus, is signature equivalent to a symmetric hollow matrix. ∎
Hollow orthogonal matrices can be used to demonstrate that a matrix having the SIPP depends on more than just its sign pattern.
Example 5.8**.**
Consider the symmetric hollow, orthogonal matrix
[TABLE]
and the hollow orthogonal matrix
[TABLE]
By Theorem 5.7 does not have the SIPP. It is not difficult to verify that is a hollow orthogonal matrix with the same sign pattern as . Further, one can see that is not signature equivalent to a symmetric matrix and therefore has the SIPP.
By Theorem 4.5 we have the following corollary.
Corollary 5.9**.**
Let have sign pattern . If is not signature equivalent to a symmetric hollow matrix, then every super pattern of allows orthogonality.
Recently hollow orthogonal matrices were used in [13] to study the minimum number of distinct eigenvalues of certain families of symmetric matrices. In doing so they used the following construction.
Lemma 5.10** (Bailey et al. [13]).**
Let
[TABLE]
be hollow orthogonal matrices of order and respectively. Then
[TABLE]
is a hollow orthogonal matrix of order .
Proposition 5.11 is useful for verifying that matrices constructed using Lemma 5.10 have the SIPP.
Proposition 5.11**.**
Let
[TABLE]
be row orthogonal matrices with and nowhere zero. Then
[TABLE]
is row orthogonal. Moreover, if both and have the SIPP, then has the SIPP.
Proof.
The matrix is row orthogonal since
[TABLE]
Assume and have the SIPP. Let
[TABLE]
be a symmetric matrix such that . Since , and and are nowhere zero
[TABLE]
Postmultiply (14) by to get
[TABLE]
Similarly, postmultipying (15) by yields
[TABLE]
Equations (13), (17) and (18) imply
[TABLE]
Since has the SIPP, and . Similarly, equations (16), (17) and (18) imply . Having established , (17) implies X_{2}\left[\begin{array}[]{@{}c|c@{}}\mathbf{y}&B\end{array}\right]=O. Since the rows of \left[\begin{array}[]{@{}c|c@{}}\mathbf{y}&B\end{array}\right] are linearly independent, . Therefore, and so has the SIPP. ∎
The following lemma is a slight modification of Theorem 2.3 in [13].
Lemma 5.12**.**
There exists a hollow orthogonal matrix of order that is not signature equivalent to a symmetric matrix if and only if .
Proof.
The proof is by induction on . It is easy to verify that hollow orthogonal matrices of order do not exist and that a non-symmetric hollow orthogonal matrix of order does not exist. Examples of hollow orthogonal matrices, not equivalent to a symmetric matrix, of order are provided in [13]. In particular, for we have
[TABLE]
and for we have
[TABLE]
where and .
Suppose that there exist hollow orthogonal matrices, that are not signature equivalent to a symmetric matrix, for every order (except ), where . Let be such a matrix of order . By Theorem 5.7, and have the SIPP. Allowing and to play the role of and in Lemma 5.10 and Proposition 5.11 produces a hollow orthogonal matrix of order that is not signature equivalent to a symmetric matrix. ∎
In order to understand the role of hollow orthogonal matrices in [13] we require a few definitions. Let A\in\text{\rm Sym{}_{n}}. The graph of is the simple graph with vertices such that vertex is adjacent to vertex if and only if the entry of is nonzero. The set denotes the set of symmetric matrices with graph . Let denote the the minimum number of distinct eigenvalues of a matrix in . Let and . For a bipartite graph with bipartition let be the set of matrices , with rows and columns indexed by and respectively, such that the entry of is nonzero if and only if and are adjacent in .
Theorem 5.13** (Ahmadi et al. [14]).**
Let be a bipartite graph with bipartition . Then if and only if and there exists an orthogonal matrix .
Let denote the graph obtained from the complete bipartite graph by deleting a perfect matching. Using Lemma 5.10 and Theorem 5.13 the authors of [13] show the following.
Theorem 5.14** (Bailey et al. [13]).**
Where is as above, unless or .
Let denote the bipartite graph obtained by deleting a matching of size from . In order to establish that the authors of [13] constructed many orthogonal matrices. However, this observation is a simple consequence of the SIPP. A partially hollow matrix to be any matrix with no zero entries off the main diagonal.
Theorem 5.15** (Bailey et al. [13]).**
Suppose that and . Let be defined as above. Then if and only if .
Proof.
By Theorem 5.13 if and only if there exists an orthogonal partially hollow matrix of order with exactly zero entries. For values of the result is readily verifiable. The claim now follows from Lemma 5.12 and Corollary 5.9. ∎
6 Verification Matrix and Matrix Liberation
As we have seen, there are orthogonal matrices that do not have the SIPP. Recall that , with sign pattern , has the SIPP if and only if the manifolds and intersect transversally at . In the setting where does not have the SIPP we can replace with an appropriately chosen manifold and apply the techniques of Section 4 to obtain a result similar to Theorem 4.5. This new result, Theorem 6.8, allows us to determine some super patterns of that allow orthogonality.
The choice of manifold replacing has some motivation. The best linear approximation to at is . If we perturb in the direction of a matrix in we can hopefully adjust the entries, all without changing the signs of the nonzero entries, so that we still have an orthogonal matrix. We will need to include a subspace of in our new manifold. Many of the techniques in this section are motivated by the work in [5].
We begin by codifying as the column space of an appropriately chosen matrix. Let satisfy QP^{T}=\left[\begin{array}[]{@{}c|c@{}}I&O\end{array}\right] and for define to be the matrix . By Lemma 4.2 the matrices
[TABLE]
form a basis for . For this choice of , we define the tangent space matrix of to be the matrix whose -column is .
The matrix encodes more information than we need. For any set of pairs satisfying and , is the subvector of of dimension that contains only the entries corresponding to the indices in . Let and . The tangent verification matrix of is the matrix . That is, is the restriction of to the rows corresponding to the zero entries of . If then is uniquely determined and we will write in place of .
We can also represent as the column space of a matrix. By Lemma 4.3 the matrices
[TABLE]
form a basis for . The normal space matrix of is the matrix whose column is . Let . The normal verification matrix of is the matrix .
Observation 6.1*.*
When applying Lemma 6.3 to we require matrices . Observe that if and only if .
We require the following lemma from [10].
Lemma 6.2** (Holst et al. [10]).**
Assume and are manifolds that intersect transversally at and let be a common tangent to each of and with . Then for every there exists a point such that and intersect transversally at , and
[TABLE]
The Matrix Liberation Lemma, below, is named after Lemma 7.3 in [5]. This technical lemma is useful for working with specific matrices. It is also used to prove the more algebraic result Theorem 6.8.
Lemma 6.3** (Matrix Liberation Lemma).**
Let have sign pattern and have sign pattern . Let satisfy QP^{T}=\left[\begin{array}[]{@{}c|c@{}}I&O\end{array}\right] and , where and are the entries of and respectively. Then every super pattern of allows orthogonality provided
- (i)
the complement of the support of corresponds to a linearly independent set of rows in ; or equivalently 2. (ii)
the columns of are linearly independent.
Proof.
Without loss of generality we may assume . Let and denote the entry of and respectively. Define the smooth manifold
[TABLE]
Let denote the entry of . Then the tangent space
[TABLE]
and normal space
[TABLE]
Assume (i) holds. Notice that the complement of the support of is the set . Let . By assumption, the rows in are linearly independent. Hence the columns of span . By (19)
[TABLE]
and so .
Now assume (ii) holds. Let . By (20) the entry of is zero whenever . Notice that . Having assumed the columns of are linearly independent, the only solution to
[TABLE]
is the trivial solution (each ). Since and the vectors form a basis for it follows that . Thus, .
In both cases and intersect transversally at . Observe that is a common tangent to and . Lemma 6.2 guarantees that for every there exists some such that and intersect transversally at and
[TABLE]
Given that it remains to show that . Since it follows that whenever , and whenever . Suppose and . It follows from (21) that , where . For small enough, . Thus, has sign pattern .
It remains to show that every super pattern of allows orthogonality. Since the rows of corresponding to the complement of the support of are linearly independent, every super pattern of is the sign pattern of a matrix in . Further, the rows of corresponding to the complement of the support of are linearly independent. By the preceding argument, allows orthogonality. ∎
The following observations are useful for working with verification matrices and the Matrix Liberation Lemma. Let and be defined as in Lemma 6.3.
Observation 6.4*.*
When computing the verification matrix of it is prudent to label the rows and columns of the verification matrix. The columns correspond to specific basis elements (from either the tangent or normal space) and the rows correspond to specific entries of . Permuting the columns and rows of a verification matrix preserves all relevant data. However, in doing so, it is necessary to record how the labels change.
Observation 6.5*.*
Reducing the columns of to a linearly independent set preserves the linear dependencies amongst the rows of . Similarly, reducing the rows of to a linearly independent set preserves the linear dependencies amongst the columns of .
Theorem 6.6 is a restatement of Theorem 4.5 in terms of the verification matrices. This formulation can be easily implemented with computer software to verify if a given matrix has the SIPP [15].
Theorem 6.6**.**
Let have sign pattern and satisfy QP^{T}=\left[\begin{array}[]{@{}c|c@{}}I&O\end{array}\right].
- (i)
If the rows of are linearly independent, then every super pattern of allows orthogonality. 2. (ii)
If the columns of are linearly independent, then every super pattern of allows orthogonality.
Proof.
Begin by assuming that the rows of are linearly independent. Let denote the number of zero entries in . Then the columns of span . Thus, for every super pattern of there exists some with sign pattern such that . Further, by Lemma 6.3 we know allows orthogonality. Thus, (i) holds.
Now assume that the columns of are linearly independent. Let denote the entry of and . By Theorem 4.5 it suffices to show that . Observe that consists of matrices whose -entry is 0 whenever . Thus, the -entry is 0 whenever . We must show the remaining entries of are also 0.
Suppose the columns of are linearly independent. Let . Then the only solution to
[TABLE]
is the trivial solution. Since the vectors form a basis for , . Thus, (ii) holds. ∎
The following example illustrates how to use the verification matrices and shows that an orthogonal matrix can have as few as eight zero entries and still not have the SIPP.
Example 6.7**.**
Let be nowhere zero. Suppose , , and that is nowhere zero. Let and
[TABLE]
It is routine to check that . By Observations 6.4 and 6.5 we may represent the verification matrix as
[TABLE]
A subset of the rows of are linearly dependent if and only if there exists a vector in the left nullspace of whose support corresponds to the rows. The left nullspace of is spanned by
[TABLE]
Thus, by Theorem 6.6, does not have the SIPP.
Let be the sign pattern of . Since the rows of form a minimal linearly dependent set, we may use any matrix when applying Lemma 6.3. Observe that the column space of is the orthogonal complement of the span of . Further, the sign patterns of vectors which are orthogonal to are precisely those which are potentially orthogonal to . Therefore, every super pattern of allows orthogonality except those of the form , where is nonzero and of the form
[TABLE]
and each and each .
We now apply the Matrix Liberation Lemma to obtain the following result.
Theorem 6.8**.**
Let have sign pattern and have sign pattern . If is the only symmetric matrix satisfying , then every super pattern of allows orthogonality.
Proof.
Suppose that is the only symmetric matrix satisfying . For define the symmetric matrix
[TABLE]
where each . Let , where and are the entries of and respectively. Then the columns of are linearly independent if and only if
[TABLE]
implies . This holds by assumption. Thus, by Lemma 6.3, every super pattern of allows orthogonality. ∎
Notice that the conditions in Theorem 6.8 are very similar to the requirements of having the SIPP. Just as with the SIPP, we have a convenient result when dealing with square matrices.
Corollary 6.9**.**
Let have sign pattern and have sign pattern . If is the only matrix satisfying is symmetric and , then every super pattern of allows orthogonality.
An orthogonal matrix can be obtained from with the direct sum . While such matrices do not have the SIPP (see Lemma 3.6), they do have enough structure to produce the next result.
Corollary 6.10**.**
Let and be nowhere zero. Define the sets
[TABLE]
If , then every super pattern of
[TABLE]
allows orthogonality.
Proof.
Assume . Define and K\in\text{\rm Skew{}_{n+1}} by
[TABLE]
Then
[TABLE]
is in . Let , and . Assume that is symmetric and . Observe that
[TABLE]
Since we know has the form
[TABLE]
where . Then
[TABLE]
and since is symmetric, . Thus, is equivalent to
[TABLE]
Notice that
[TABLE]
Since , and so . By Corollary 6.9, every super pattern of allows orthogonality. ∎
The next example illustrates how to apply Corollary 6.10.
Example 6.11**.**
Consider the orthogonal matrix
[TABLE]
and the vector
[TABLE]
Let , where . Observe that
[TABLE]
Then
[TABLE]
and
[TABLE]
Thus, and by Corollary 6.10 the sign pattern
[TABLE]
allows orthogonality.
In [9] it was asked for which sign patterns is the determinant function constant on ? It was shown that for any sign pattern with order the determinant is constant on . The next example shows that for each there exist orthogonal matrices with the same sign pattern and oppositely signed determinants.
Example 6.12**.**
The sign pattern
[TABLE]
allows orthogonality since is orthogonal. Let
[TABLE]
where each . Observe that . By assuming is symmetric we obtain a homogeneous system of 21 linear equations in whose coefficient matrix can be shown to have nonzero determinant. Thus, each and by Theorem 3.2 the matrix has the SIPP. This can be verified by applying Theorem 6.6 (see [15]).
Observe that is a super pattern of , where is the skew symmetric matrix
[TABLE]
Since the determinant function is continuous and orthogonal matrices have determinant , any orthogonal matrix near will have the same determinant as . In particular, any matrix with sign pattern obtained by applying Theorem 6.6 to will have determinant .
Using the Cayley transform, every matrix , where , is orthogonal. Notice that for
[TABLE]
and is nowhere zero. Thus, if we choose small enough will have sign pattern . Since was obtained using the Cayley transform . Thus, and both have sign pattern and .
Further, by using Corollary 6.10 and induction we can guarantee the existence of irreducible orthogonal matrices of order with the same sign pattern and oppositely signed determinant.
Let , where each . In [9] the implicit function theorem was used to find super patterns of that allow orthogonality. The main result of [9], Theorem 3.14, can be phrased in terms of the SIPP. In fact, using Theorem 6.8 we obtain the following stronger result. Unlike Theorem 3.14 in [9], Corollary 6.13 can produce sign patterns of orthogonal matrices by perturbing the zero entries in the blocks of .
Corollary 6.13**.**
Let have sign pattern and let each where . Let be a block matrix with -block denoted as and . If each , and is the only symmetric matrix satisfying , then allows orthogonality.
Proof.
Suppose that each . Then . Define so that . It follows that is skew symmetric and that . Thus, . The claim now follows from Theorem 6.8. ∎
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] M. Fiedler, Problem 12, in: Proceedings: Theory of Graphs and Its Application, Publishing House of the Czechoslovakia Academy of Sciences, Prague, 1964, p. 160.
- 2[2] L. B. Beasley, R. A. Brualdi, B. L. Shader, Combinatorial and Graph-Theoretical Problems in Linear Algebra, Vol. IMA Vol. Math. Appl. 50, Springer-Verlag, New York, 1993, Ch. Combinatorial Orthogonality, pp. 207 – 218.
- 3[3] L. B. Beasley, D. Scully, Y. Sun, Linear operators which preserve combinatorial orthogonality, Lin. Alg. Appl. 201 (1994) 171 – 180.
- 4[4] W. Barrett, S. Fallat, H. T. Hall, L. Hogben, J. C.-H. Lin, B. L. Shader, Generalizations of the Strong Arnold Property and the minimum number of distinct eigenvalues of a graph, The Electronic Journal of Combinatorics 24 (2) (2017).
- 5[5] W. Barrett, S. Butler, S. M. Fallat, H. T. Hall, L. Hogben, J. C.-H. Lin, B. L. Shader, M. Young, The inverse eigenvalue problem of a graph: Multiplicities and minors, Ar Xiv e-prints (Jul. 2017). ar Xiv:1708.00064 .
- 6[6] G.-S. Cheon, S.-G. Hwang, S.-H. Rim, B. L. Shader, S.-Z. Song, Sparse orthogonal matrices, Linear Algebra and its Applications 373 (2003) 211 – 222, combinatorial Matrix Theory Conference (Pohang, 2002).
- 7[7] Y. Gao, L. Shao, Y. Sun, ± plus-or-minus \pm sign pattern matrices that allow orthogonality, Czech Math J 56 (3) (2006) 969 – 979.
- 8[8] C. R. Johnson, C. Waters, S. Pierce, Sign patterns occurring in orthogonal matrices, Linear and Multilinear Algebra 44 (4) (1998) 287–299.
