The spectral matrices associated with the stochastic Darboux transformations of random walks on the integers
Manuel D. de la Iglesia, Claudia Juarez

TL;DR
This paper explores spectral matrices linked to Darboux transformations of random walks on integers, providing conditions for factorizations, and analyzing how these transformations generate new random walks with altered spectral properties.
Contribution
It introduces conditions for stochastic factorizations of transition matrices and characterizes the spectral matrices resulting from Darboux transformations of random walks on integers.
Findings
Conditions for stochastic factorizations in terms of continued fractions
Identification of spectral matrices as conjugations of Geronimus transformations
Application to random walks with constant transition probabilities
Abstract
We consider UL and LU stochastic factorizations of the transition probability matrix of a random walk on the integers, which is a doubly infinite tridiagonal stochastic Jacobi matrix. We give conditions on the free parameter of both factorizations in terms of certain continued fractions such that this stochastic factorization is always possible. By inverting the order of the factors (also known as a Darboux transformation) we get new families of random walks on the integers. We identify the spectral matrices associated with these Darboux transformations (in both cases) which are basically conjugations by a matrix polynomial of degree one of a Geronimus transformation of the original spectral matrix. Finally, we apply our results to the random walk with constant transition probabilities with or without an attractive or repulsive force.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
The spectral matrices associated with the stochastic Darboux transformations of random walks on the integers
Manuel D. de la Iglesia
Manuel D. de la Iglesia
Instituto de Matemáticas, Universidad Nacional Autónoma de México, Circuito Exterior, C.U., 04510, Ciudad de México, México.
and
Claudia Juarez
Claudia Juarez
Instituto de Matemáticas, Universidad Nacional Autónoma de México, Circuito Exterior, C.U., 04510, Ciudad de México, México.
Abstract.
We consider UL and LU stochastic factorizations of the transition probability matrix of a random walk on the integers, which is a doubly infinite tridiagonal stochastic Jacobi matrix. We give conditions on the free parameter of both factorizations in terms of certain continued fractions such that this stochastic factorization is always possible. By inverting the order of the factors (also known as a Darboux transformation) we get new families of random walks on the integers. We identify the spectral matrices associated with these Darboux transformations (in both cases) which are basically conjugations by a matrix polynomial of degree one of a Geronimus transformation of the original spectral matrix. Finally, we apply our results to the random walk with constant transition probabilities with or without an attractive or repulsive force.
Key words and phrases:
Random walks. LU factorizations. Darboux transformations. Orthogonal polynomials. Geronimus transformation
2010 Mathematics Subject Classification:
60J10, 60J60, 33C45, 42C05
This work was partially supported by PAPIIT-DGAPA-UNAM grant IN104219 (México), UC MEXUS-CONACYT grant CN-16-84 and CONACYT grant A1-S-16202 (México).
1. Introduction
The main goal of this paper is to describe the spectral matrices associated with the discrete Darboux transformations of the one-step transition probability matrix of a random walk on the integers . This transition probability matrix is a doubly infinite tridiagonal stochastic matrix, also known as a Jacobi matrix or Jacobi operator (see (2.1) below) acting on the space for certain sequence . The case of random walks on the nonnegative integers has been recently considered by F.A. Grünbaum and one of the authors of this paper in [11]. The main motivation for this UL and LU stochastic factorization is to divide the probabilistic model associated with the random walk into two different and simpler experiments, and combine them together to obtain a simpler description of the original probabilistic model (see applications to urn models in [11]).
We start by analyzing the conditions under we can perform a stochastic UL factorization of the form or a stochastic LU factorization of the form , where all factors (bidiagonal matrices) are also stochastic matrices. In the case of the UL factorization, as the situation of random walks on , we still have one free parameter. But one important difference now is that for the LU factorization we also have one free parameter, something that did not happen for random walks on , where the factorization was unique. In both cases, the factorization, if it can be achieved in terms of stochastic factors, will represent a family of factorizations of the original transition probability matrix . In [11] it is shown that this free parameter has to be bounded from above by certain continued fraction if we want to guarantee that the factors are still stochastic matrices. In our case, since we are dealing with doubly infinite stochastic matrices, this free parameter (in both cases) has to be not only bounded from above but also bounded from below by another continued fraction which is built from the negative states of the original random walk. This will be the content of Section 2. UL and LU factorizations of stochastic matrices have been considered earlier in the literature (see for instance [5, 6, 18, 30]) but these factorizations are different from the one we try to consider here where all matrices involved are stochastic (see [11] for an extended discussion about this matter).
Once we have a stochastic UL or LU factorization of a tridiagonal stochastic matrix we can make use of the so-called discrete Darboux transformation, consisting of inverting the order of the factors. The new matrices and will also be doubly infinite tridiagonal and stochastic matrices. Since both factorizations come with one free parameter, we will have a family of new random walks different in general from the original one. These discrete Darboux transformations have been studied before in the context of the theory of orthogonal polynomials, in particular in the description of some families of Krall polynomials (see [13, 14, 29, 32, 33]). It has played an important role in the study of integrable systems (see [26]). An important issue that has not been considered before, as far as the authors know, is how to relate the spectral matrix associated with with the spectral matrices or associated with or , respectively. By spectral matrix we mean that the spectral analysis of comes now with three measures (two positive and one signed measure, and due to the symmetry) and they can be written in a spectral matrix of the form
[TABLE]
which turns out to be a proper weight matrix in the context of the theory of matrix-valued orthogonal polynomials. In fact, a random walk in can be viewed as a special type of discrete-time quasi-birth-and-death process with state space . These processes can be defined in general in state spaces of the form for a positive integer (see [24, 27] for general references). The spectral analysis of these processes has been considered for instance in [3, 7, 8, 10, 19] to mention a few.
For random walks on it is very well-known that the spectral measure associated with the Darboux transformation of a UL factorization is given by a so-called Geronimus transformation of the original spectral measure, while for the LU factorization is given by a Christoffel transformation. For random walks on we will show that the spectral matrices associated with these Darboux transformations (in both cases) are conjugations of the form
[TABLE]
where are Geronimus transformations of the original spectral matrix and are certain matrix polynomials of degree one (see Theorems 3.5 and 3.9 in Section 3). In [12] a first attempt has been done to study stochastic Darboux transformations of block tridiagonal stochastic matrices, which are the transition probability matrices of discrete-time quasi-birth-and-death processes. In that paper the authors only consider one (Jacobi type) example previously introduced in [15] (see also [16, 17]). The UL factorization depends now on one free matrix-valued parameter and it is not clear how to transform the corresponding spectral weight matrices associated with the discrete Darboux transformation in general. In the case of random walks on we will only have one free (real) parameter. Our results can give some insights about how to compute the spectral matrix of the Darboux transformations for tridiagonal stochastic block matrices in general. For a different application of the Darboux transformation in the context of the noncommutative bispectral problem see [4, 9, 34] and references therein.
Once we have the spectral matrix it is easy to analyze the corresponding random walk in terms of the two independent families of polynomials which arise as a solution of the eigenvalue equation. For the case of random walks on this was first done in a series of papers by S. Karlin and J. McGregor (inspired by work by W. Feller and H.P. McKean) in the 1950s (see [21, 22, 23]) where they studied first continuous-time birth-and-death processes and then the case of discrete-time random walks. Apart from an explicit expression of the -step transition probabilities and the invariant measure, it is possible to study some other probabilistic properties using spectral methods such as recurrence, absorbing times, first return times or limit theorems. In the last section of [23] one can find the first attempt to perform the spectral analysis of a random walk on using orthogonal polynomials. We will recall this approach at the beginning of Section 3. After that, apart from [1], there are not so many references concerning the spectral analysis of doubly infinite Jacobi operators acting on . In [28], W.E. Pruitt studied the case of birth-and-death processes on (also known as bilateral birth-and-death processes). An example of this approach can be found in the last section of [20]. A more theoretical work about the spectral theory of Jacobi operators acting on was given by D.E. Masson and J. Repka in [25] and revisited recently in [2].
Finally, we will apply our results to two examples in Section 4. The first one is the random walk on with constant transition probabilities, while the second one is the random walk on with constant transition probabilities but allowing an attractive or repulsive force to or from the origin. In both cases we study the conditions under we get a stochastic UL and LU factorization, give the corresponding spectral matrices and the spectral matrices associated with both discrete Darboux transformations. As a final remark we will show that it is possible to choose certain values of the free parameters such that the Darboux transformation (both from the UL or the LU factorization) is invariant, i.e. we get the same random walk after we perform the Darboux transformation. This phenomenon it is not possible for Darboux transformations of random walks on .
2. Stochastic UL and LU factorization on the integers
Let be an irreducible random walk on the integers with transition probability matrix given by
[TABLE]
The matrix is stochastic, i.e. all entries are nonnegative and
[TABLE]
Since the random walk is irreducible then we have that . A diagram of the transitions between the states is given by
Let us perform a UL factorization of in the following way
[TABLE]
where and are also stochastic matrices. This means that all entries of and are nonnegative and
[TABLE]
A direct computation shows that
[TABLE]
By the irreducibility conditions we immediately have that . The Markov chain associated with is a pure birth random walk on with diagram
while is a pure death random walk on with diagram
As in the case of random walks on (see [11]) we can compute all entries of and in terms of only one free parameter, namely . Indeed, for nonnegative values of the indices and fixed we can compute recursively using (2.3) and (2.4). Similarly, for negative values of the indices and fixed we can compute recursively using again (2.3) and (2.4).
Following the same steps as in Lemma 2.1 of [11] we have that for a decomposition like in (2.2), i.e. , the matrix is stochastic if and only if the matrix is stochastic. We also have, following (2.4), the following relations
[TABLE]
Although we can compute all coefficients in terms of one free parameter , we can not infer anything about the positivity of these coefficients. This will be the goal of the next theorem. As it was done in Theorem 2.1 of [11] for random walks on the matrices and are stochastic if and only if , where is the continued fraction given below by (2.5). The difference now for random walks on is that the free parameter will be also bounded below by another number defined by a continued fraction generated by the probabilities of the negative states of the random walk. We recommend the reference [31] for the reader unfamiliar with continued fractions (as well as [11] for the case of random walks on ).
Let and be the continued fractions generated by alternatively choosing and in different directions, i.e.
[TABLE]
In a different notation
[TABLE]
For each continued fraction, consider the corresponding sequence of convergents and , given by
[TABLE]
Recall that the convergents of a continued fraction are the sequence of truncated continued fractions of and these are always rational numbers. In [11] (see also [31]) it is proved that the numbers can be recursively obtained using the following formulas
[TABLE]
In the same way the numbers can be recursively obtained using
[TABLE]
Using these relations it is not hard to prove that
[TABLE]
Then we have the following:
Theorem 2.1**.**
Let and be the continued fractions given by (2.5) and the corresponding convergents and defined by (2.6). Assume that
[TABLE]
Then both and are convergent. Moreover, let as in (2.2). Assume that . Then, both and are stochastic matrices if and only if we choose in the following range
[TABLE]
Proof.
The convergence of and the upper bound for is proved in Theorem 2.1 of [11]. From (2.7) and using the assumptions (2.8) we have that
[TABLE]
Therefore we have
[TABLE]
that is, is a bounded strictly increasing sequence, so it is convergent to .
For the lower bound for , assume first that both and are stochastic matrices, so that . Then we have, using (2.4), that
[TABLE]
and
[TABLE]
Following the same argument we have
[TABLE]
Therefore we always have
[TABLE]
and we get the lower bound for . On the contrary, if (2.9) holds, in particular we have that for every . Following the same steps as before and Theorem 2.1 of [11], using an argument of strong induction, will lead us to the fact that both and are stochastic matrices with the conditions that . ∎
Consider now the LU factorization of the stochastic matrix given by (2.1) in the following way
[TABLE]
where again and are also stochastic matrices, i.e. all entries of and are nonnegative and
[TABLE]
Now, a direct computation shows that
[TABLE]
By the irreducibility condition we have that , , , , . Now there is an important difference if we compare with the case of random walks on , where the LU factorization is unique. In this case there will be also one free parameter, namely , from where we can compute all the coefficients of the matrices and . If we fix , for the nonnegative values of the indices we can compute , , , , , , , , recursively from (2.11) and (2.12), while for the negative values of the indices we can compute , , , , , , , , recursively again from (2.11) and (2.12).
Following the same steps as in Lemma 2.1 of [11] we have that for a decomposition like in (2.10), i.e. , the matrix is stochastic if and only if the matrix is stochastic and by (2.12), the following relations holds
[TABLE]
Although we can compute all coefficients , , and in terms of one free parameter , we can not infer anything about the positivity of these coefficients. However we have an analogue of Theorem 2.1 where now the free parameter will be bounded by the same continued fractions.
Theorem 2.2**.**
Let and be the continued fractions given by (2.5) and the corresponding convergents and defined by (2.6). Assume conditions (2.8). Then both and are convergent. Moreover, let as in (2.10). Assume that . Then, both and are stochastic matrices if and only if we choose in the following range
[TABLE]
Proof.
The proof is similar to the proof of Theorem 2.1 but using (2.12) instead of (2.4). ∎
3. Stochastic Darboux transformations and the associated spectral matrices
In the previous section we have shown under what conditions a doubly infinite stochastic matrix like in (2.1) can be decomposed as a UL (or LU) factorization where both factors are still stochastic matrices. In both factorizations we have one free parameter. We knew about this fact for the UL factorization, but now for the LU factorization the phenomenon is new. Once we have a UL (or LU) factorization we can perform what is called a discrete Darboux transformation. The Darboux transformation has a long history but probably the first reference of a discrete Darboux transformation like we study here appeared in [26] in connection with the Toda lattice. We explain now what a Darboux transformation is in our context.
If as in (2.2), then by inverting the order of the factors we obtain another tridiagonal matrix of the form
[TABLE]
The new coefficients of the matrix are given by
[TABLE]
The matrix is actually stochastic, since the multiplication of two stochastic matrices is again a stochastic matrix. Therefore it gives a family of new random walks on the integers with coefficients , and depending on a free parameter .
The same can be done for the LU factorization (2.10) of the form . Indeed, the new random walk is given by
[TABLE]
where the new coefficients are
[TABLE]
Again, the matrix is stochastic, so we have a family of new random walks on the integers with coefficients , and depending on one free parameter .
In terms of a model driven by urn experiments both factorizations may be thought as two urn experiments, Experiment 1 and Experiment 2, respectively. We first perform the Experiment 1 and with the result we immediately perform the Experiment 2. The model for the Darboux transformation will be reversing the order of both experiments. For more details about these urn models see [11, 12].
Now we will focus in the following question: given the spectrum of the doubly infinite matrix , how can we compute the spectrum of the Darboux transformations and ? It turns out that both transformations will be related with what is called a Geronimus transformation (see below). Before that let us introduce some notation to study the spectral measures associated with the original random walk .
We will follow the last section of [23]. For like in (2.1) consider the eigenvalue equation where . For each real or complex there exist two polynomial families of linearly independent solutions depending on the initial values at and . These polynomials are given by
[TABLE]
Observe that
[TABLE]
From the three-term recurrence relation (3.5) it is possible to compute the leading coefficients of the polynomials . Indeed, for we have
[TABLE]
and
[TABLE]
Let us define the potential coefficients as
[TABLE]
In particular we have that , i.e. is an invariant vector of . In the Hilbert space the matrix gives rise to a self-adjoint operator of norm , which we will denote by , abusing the notation. This result is a consequence of Corollary 2.2 of [25] since the coefficients and are probabilities and therefore . Applying the spectral theorem three times, there exist three unique measures and (since as a consequence of being self-adjoint and the symmetry of the inner product) supported on the interval such that
[TABLE]
The measures and are positive (in fact is a probability measure but is not, since ). The measure is a signed measure satisfying . For simplicity let us assume that the three measures are continuously differentiable with respect to the Lebesgue measure, i.e. , abusing the notation. These 3 measures can be written in matrix form as the matrix
[TABLE]
so that the orthogonality relations (3.10) can be written in matrix form as
[TABLE]
The matrix in (3.11) is called the spectral matrix associated with . The orthogonality conditions are valid for any indexes . With this information we can compute the -step transition probabilities of the random walk , given by the so-called Karlin-McGregor integral representation formula (see [23])
[TABLE]
It is possible to relabel the states in such a way that all the information of can be collected in a semi-infinite block tridiagonal matrix with blocks of size . Indeed, after the new labeling
[TABLE]
we have that (doubly infinite tridiagonal) is equivalent to a matrix (semi-infinite block tridiagonal) of the form
[TABLE]
where
[TABLE]
The random walk generated by can be interpreted as a walk that takes values in the two-dimensional state space These type of processes are called discrete-time quasi-birth-and-death processes. In general these processes allow transitions between all two-dimensional adjacent states (see [24, 27] for a general reference).
If we define the matrix-valued polynomials
[TABLE]
then we have
[TABLE]
where denotes the identity matrix. Observe that and the leading coefficient is a nonsingular matrix (by (3.7) and (3.8)). The matrix orthogonality is defined in terms of the (matrix-valued) inner product
[TABLE]
where is the Hermitian transpose of a matrix and is given by (3.9). In this case we have (see [3, 7]) the Karlin-McGregor integral representation formula where the block entry is given by
[TABLE]
Remark 3.1*.*
In Corollaries 4.1 and 4.2 of [3] one can find some results concerning recurrence for discrete-time quasi-birth-and-death processes. Applying these to the case of random walks on we have that the random walk is recurrent if and only if for some and it is positive recurrent if and only if one of the measures has a jump at the point 1.
In the following lemma we will give a characterization of the orthogonality of the vector-valued polynomials in terms of monomials.
Lemma 3.2**.**
Let be the polynomials defined by (3.5). Then the vector-valued polynomials , are orthogonal in the sense of (3.12) if and only if for we have
[TABLE]
and
[TABLE]
Moreover and .
Proof.
The orthogonality conditions (3.12) are equivalent to the matrix orthogonality (3.15). Since in (3.14) is a matrix polynomial of degree with nonsingular leading coefficient the orthogonality is equivalent to for where denotes the null matrix, and is a nonsingular (diagonal) matrix. Looking at the rows of these expressions we get (3.16) and (3.17). The values of and can be computed using (3.7), (3.8) and (3.9). ∎
Now that we have studied the spectral properties of the doubly infinite matrix in (2.1) let us study the spectral matrices associated with the Darboux transformations in (3.1) and in (3.3). We will analyze both cases separately.
3.1. Darboux transformation for the UL case
Consider the discrete Darboux transformation in (3.1) with probability coefficients , and given by (3.2). Before defining the corresponding polynomials associated with let us introduce an auxiliary family of polynomials given by the relation , where and , i.e.
[TABLE]
From the UL factorization we also have , that is
[TABLE]
Evaluating (3.19) at we get recursively
[TABLE]
where
[TABLE]
The equations (3.20) establish a direct relation between the polynomials given by
[TABLE]
Another useful relation follows using (3.19) and (3.20) which gives the polynomials in terms of . Indeed, for
[TABLE]
since is constant (see (3.21)). Therefore
[TABLE]
Similarly
[TABLE]
Observe that this auxiliary family does not satisfy the same initial conditions as the family since by (3.18) we have
[TABLE]
The degrees of the polynomials are also not the same as the degrees of the polynomials , since
[TABLE]
Therefore the family of matrix polynomials
[TABLE]
has degree and singular leading coefficient. Now we will define a new family of polynomials which will turn out to be the associated family of the Darboux transformation . For define
[TABLE]
where
[TABLE]
Following the same representation as in (3.14) we can define the functions , which turn out to be polynomials, as the following proposition shows.
Proposition 3.3**.**
Let be the matrix function defined by (3.26). Then, for , is a matrix polynomial of degree exactly with nonsingular leading coefficient and .
Proof.
Computing the inverse of we have
[TABLE]
Observe that , so the inverse is not well-defined at . We will show that we can avoid this problem using the properties of the polynomials . Indeed, from (3.26) we have
[TABLE]
A straightforward computation using (3.23), (3.24) and (3.22) gives
[TABLE]
Therefore from these relations we can see that are indeed polynomials. A close look to the degrees of in (3.6) gives that . Therefore from (3.25) we get and . On the other hand . Therefore . Finally, is in principle a polynomial of degree , but we will see that in fact is a polynomial of degree . Indeed, call the coefficient of in . Then, using (3.7), (3.8), (3.18) and (2.4), we have
[TABLE]
Therefore . The fact that comes from the definition (3.26). ∎
Remark 3.4*.*
The previous proposition shows that the Darboux polynomials satisfy the same initial conditions and degree conditions than the original polynomials . They also satisfy the three-term recurrence relation
[TABLE]
where the Darboux coefficients , and are defined by (3.2). This is a consequence of writing the polynomials in terms of (see (3.28)) and the fact that the polynomials satisfy the same three-term recurrence relation (with different initial conditions) by construction (see (3.18)).
We will now show one the the main results of this paper, namely how to compute the spectral matrix associated with the Darboux random walk in (3.1) and prove that are the corresponding orthogonal polynomials. We define first the potential coefficients associated with given by
[TABLE]
Theorem 3.5**.**
Let be the random walk on with transition probability matrix given by (2.1) and the Darboux random walk on with transition probability matrix given by (3.1). Assume that is well-defined (entry by entry), where is the original spectral matrix (see (3.11)). Then the polynomials defined by (3.29) (see also (3.26)) are orthogonal with respect to the following spectral matrix
[TABLE]
where is defined by (3.27) and
[TABLE]
Moreover, we have
[TABLE]
where are the potential coefficients defined by (3.30).
Proof.
Let be the polynomials defined by (3.5), which are orthogonal with respect to the original spectral matrix . By Lemma 3.2 we have the orthogonality conditions (3.16) and (3.17). Since satisfies the same initial and degree conditions than we will use Lemma 3.2 to prove that are orthogonal with respect to in (3.31).
Assume first that . Then we have, using (3.31), (3.26) and (3.32), that
[TABLE]
Now, using (3.18), the above expression can be written as
[TABLE]
Writing , where and are given by
[TABLE]
the above expression can be written as
[TABLE]
Using (3.16) we have that the first term of the sum vanishes for , the second term vanishes for , the third term vanishes for and the fourth term vanishes for . Therefore the above expression vanishes for . For the only term that does not vanish is the fourth one. But in this case we have, using (3.16) and (3.34), that
[TABLE]
For we have, using (3.26) and (3.31), that
[TABLE]
The second term of the sum of the above expression vanishes as a consequence of (3.32), (3.18) and (3.16). Indeed, for we have
[TABLE]
For we can use the same argument as in (3.35) and get again . Now, using (3.23), we can write
[TABLE]
Substituting this in the remaining integral we get
[TABLE]
The third step is a consequence of using (3.22) and the orthogonality properties. Since , , and is given by (3.34) then we have
[TABLE]
as a consequence of (3.22).
For the proof is similar but now using (3.17) and (3.24). Therefore we have proved (3.33) for . Observe that this implies in particular that the family of vector-valued polynomials is also orthogonal (for ) with respect to the weight matrix in (3.32). For , using this fact and (3.26), (3.19), (3.18), (3.31) and (3.32), we have that
[TABLE]
The last step follows using (2.4), (3.2) and the definition of and in (3.9) and (3.30), respectively. ∎
Remark 3.6*.*
The spectral matrix associated with the Darboux transformation given in the previous theorem is a conjugation by a matrix polynomial of degree 1 (namely ) of a Geronimus transformation of the original spectral matrix . This phenomenon was already present, except for the conjugation, in the case of the Darboux transformation of transition probability matrices on for the UL factorization (see [11]).
Remark 3.7*.*
In this paper we have only considered doubly infinite stochastic Jacobi matrices of the form (2.1), i.e. all entries are nonnegative and . Certainly the same approach can be used to more general doubly infinite Jacobi matrices as long as we are in the conditions of Corollary 2.2 of [25], i.e. to guarantee that the Jacobi matrix is self-adjoint. The spectral matrix associated with the Darboux transformation will be similar, up to constants, to the one given in Theorem 3.5.
3.2. Darboux transformation for the LU case
Consider now the discrete Darboux transformation in (3.3) with probability coefficients , and given by (3.4). We will see that this case is similar to the one in the previous subsection, so we will only give the important formulas necessary to prove the main results. As in the UL case we need to introduce the auxiliary family of polynomials given by the relation , where and , i.e.
[TABLE]
From the LU factorization we also have , that is
[TABLE]
Evaluating (3.37) at we get recursively
[TABLE]
where
[TABLE]
The equations (3.38) establish a direct relation between the polynomials given by
[TABLE]
Again, the polynomials can be written in terms of the polynomials as follows
[TABLE]
This auxiliary family does not satisfy the same initial conditions as the family . In fact we have
[TABLE]
The degrees of the polynomials are
[TABLE]
Therefore the family of matrix polynomials
[TABLE]
has degree and singular leading coefficient. Now we will define a new family of polynomials which will turn out to be the associated family of the Darboux transformation . For define
[TABLE]
where
[TABLE]
Following the same representation as in (3.14) we can define the functions , which turn out to be polynomials, as the following proposition shows.
Proposition 3.8**.**
Let be the matrix function defined by (3.41). Then, for , is a matrix polynomial of degree exactly with nonsingular leading coefficient and .
Proof.
Now, since
[TABLE]
we have from (3.41)
[TABLE]
From here the proof follows the same lines as in the proof of Proposition 3.3 but now using (3.39) and (3.40). ∎
Again these new Darboux polynomials satisfy the same initial conditions and degree conditions than the original polynomials as well as a three-term recurrence relation of the form (3.29) but with Darboux coefficients , and given by (3.4).
Let us now prove the analogue of Theorem 3.5 for the spectral matrix for the polynomials . We define first the potential coefficients associated with given by
[TABLE]
Theorem 3.9**.**
Let be the random walk on with transition probability matrix given by (2.1) and the Darboux random walk on with transition probability matrix given by (3.3). Assume that is well-defined (entry by entry), where is the original spectral matrix (see (3.11)). Then the polynomials defined by (3.41) are orthogonal with respect to the following spectral matrix
[TABLE]
where is defined by (3.42) and
[TABLE]
Moreover, we have
[TABLE]
where are the potential coefficients defined by (3.43).
Proof.
The proof follows the same lines as the proof of Theorem 3.5. For and we have, using (3.44), (3.41), (3.45) and (3.36), that
[TABLE]
where and (from ), are given now by
[TABLE]
Using (3.16) we have that the first term of the sum vanishes for , the second term vanishes for , the third term vanishes for and the fourth term vanishes for . Therefore the above expression vanishes for .
For we have, using (3.41) and (3.44), that
[TABLE]
As before, the second term of the sum of the above expression vanishes as a consequence of (3.45), (3.36) and (3.16). Now, using (3.40), we can write
[TABLE]
Substituting this in the remaining integral we get
[TABLE]
The third step is a consequence of using (3.39) and the orthogonality properties. Since , , and is given by (3.46) then we have
[TABLE]
as a consequence of (3.39). For the proof is similar but now using (3.17) and (3.40). Finally, using (3.41), (3.37), (3.36), (3.44) and (3.45), we have that
[TABLE]
The last step follows using (2.4), (3.4) and the definition of and in (3.9) and (3.43), respectively.
∎
Remark 3.10*.*
The spectral matrix associated with the Darboux transformation given in the previous theorem is again a conjugation by a matrix polynomial of degree 1 (namely ) of a Geronimus transformation of the original spectral matrix . This phenomenon is different from a Darboux transformation of a transition probability matrix on for the LU factorization (see [11]), where the associated spectral measure is given by a Christoffel transformation, i.e. multiplying the original measure by the polynomial .
4. Examples
4.1. Random walk on with constant transition probabilities
Consider as in (2.1) with coefficients
[TABLE]
For the UL factorization, the continued fractions (2.5) can be computed explicitly. Indeed, using Proposition 4.1 of [11] we have that
[TABLE]
as long as (to ensure convergence). On the other hand, we have . Therefore we have
[TABLE]
It is also possible to see, under the conditions on the parameters, that . Therefore, according to Theorem 2.1, as long as we always have a stochastic UL factorization where both factors are stochastic matrices. All formulas simplify considerably when (or ). Indeed, in this case we have
[TABLE]
while if we have the same formulas but replacing by . It is also remarkable that in these cases the coefficients of the Darboux transformation (3.2) remain invariant, i.e. the random walk is exactly the same as the original random walk . This phenomenon is not possible for Darboux transformations for random walks on .
As for the LU factorization, following Theorem 2.2, we have a stochastic LU factorization if and only if we choose the free parameter in the range . In this case we also have that if we choose either or then the coefficients of the Darboux transformation (3.4) remain invariant, i.e. the random walk is exactly the same as the original random walk .
The spectral matrix associated with this example appeared for the first time in the last section of [23] (for the case of , i.e. the symmetric random walk) along with a method to compute the spectral matrix using Stieltjes transforms and the spectral measures associated with the positive and negative states of the original random walk. A combination of this method and Proposition 4.2 of [11] shows that the spectral matrix of the original random walk is given by only an absolutely continuous part, i.e.
[TABLE]
Therefore we get the Karlin-McGregor formula (3.13) for the -step transition probabilities of the random walk . Also, using Remark 3.1, we have that the random walk is always transient except for the case . The random walk is never positive recurrent since the spectral matrix (4.2) does not have a jump at the point 1, so for the case the random walk is null recurrent.
A straightforward computation shows that the moment of is given by
[TABLE]
In order for to be well-defined we need to assume that , i.e. , or, in other words , which is the condition for convergence of the continued fractions and . With this information we can compute the spectral matrices associated with the Darboux transformation in (3.1) (for the UL factorization) and in (3.3) (for the LU factorization), both depending on one free parameter.
For the UL case we have, using Theorem 3.5, that
[TABLE]
where
[TABLE]
and
[TABLE]
where and are defined by (4.2) and (4.3), respectively. Observe that the only free parameter is . A straightforward computation gives that
[TABLE]
where
[TABLE]
From here we clearly see that if we choose in the range , then is a positive semidefinite matrix, so is a proper weight matrix. Another interesting case, as we mentioned earlier, is when we choose either or . In these cases we have and following (4.1) we get
[TABLE]
Therefore we recover the original weight matrix (4.2), as we predicted before. From the spectral matrix we get the Karlin-McGregor formula (3.13) for the -step transition probabilities of the random walk . The recurrence of the Darboux random walk is not affected by the transformation.
For the LU case we have, using Theorem 3.9 and after some computations, that
[TABLE]
where
[TABLE]
Again we clearly see that if we choose in the range , then is a positive semidefinite matrix, so is a proper weight matrix. If we choose either or , then we recover the original weight matrix (4.2), as we predicted before. Finally, from the spectral matrix we get the Karlin-McGregor formula (3.13) for the -step transition probabilities of the random walk and the recurrence of the Darboux random walk is not affected by the transformation.
4.2. Random walk on with constant transition probabilities and an attractive or repulsive force
Consider as in (2.1) with
[TABLE]
and, as before, . Observe that the probabilities and are interchanged for nonnegative and negative states of the random walk. Therefore if we have a random walk where the origin is an attractive state. On the contrary, if , then the origin is a repulsive state.
Again, the continued fractions (2.5) can be computed explicitly. is the same as before, i.e.
[TABLE]
as long as (to ensure convergence). On the other hand, we have
[TABLE]
Rationalizing we get
[TABLE]
It is easy to see that if and only if . On the other hand, now it is not true that for all values of the parameters and such that . In fact, as gets closer to 0, we have that there are some values of such that . A closer look to the inequality shows that must be in the following range
[TABLE]
Now, if we choose , we observe that the positive states of the original random walk remain invariant under the Darboux transformation (3.2), while if , then the negative states of the original random walk remain invariant, but the rest of coefficients are difficult to compute.
As for the LU factorization, following Theorem 2.2, we have a stochastic LU factorization if and only if we choose the free parameter in the range . As before, in order for , must be in the range (4.6). Similar behavior holds if we assume either or for the random walk .
The spectral matrix associated with this example appeared for the first time in Section 6 of [8] (for the case of , i.e. the symmetric random walk). As before, we can compute the spectral matrix for the original random walk . Now in this case the spectral matrix is given by an absolutely continuous and a discrete part, which we write as . The absolutely continuous part is given by
[TABLE]
where are defined in (4.2). The discrete part is given by
[TABLE]
where is the indicator function. Therefore we get the Karlin-McGregor formula (3.13) for the -step transition probabilities of the random walk . Also, using Remark 3.1, the random walk is always recurrent and positive recurrent if since for that case the spectral matrix has a jump at the point 1.
Now the computation of the moment of is more complicated since we have an absolutely continuous and a discrete part. Also one of the Dirac deltas of the discrete part can be located at if , so that may have a different expression in that case. Nevertheless, after some computations, we obtain
[TABLE]
where
[TABLE]
In order for to be well-defined we need to assume that , i.e. , or, in other words , which is the condition for convergence of the continued fractions and . For the case of () we obtain
[TABLE]
For the UL case we have, using Theorem 3.5 and after some computations, that
[TABLE]
where
[TABLE]
Here and in are the radical conjugates of and , respectively, and we are implicitly assuming that . If then the Geronimus transformation is not well-defined for the Dirac delta at . However, it is possible to define the spectral matrix in terms of the derivative of the Dirac delta at . Indeed, the spectral matrix for the Darboux transformation is given in this case by
[TABLE]
where and are the same as before writing and and
[TABLE]
If then the moment (4.7) is not well-defined. Observe that in this case we are in the situation of the previous example. From the spectral matrix we get the Karlin-McGregor formula (3.13) for the -step transition probabilities of the random walk . The recurrence of the Darboux random walk is not affected by the transformation.
For the LU case we have, using Theorem 3.9 and after some computations, that
[TABLE]
where
[TABLE]
Similar results hold for the case . From the spectral matrix we get the Karlin-McGregor formula (3.13) for the -step transition probabilities of the random walk and the recurrence of the Darboux random walk is not affected by the transformation.
Observe that if we assume then we recover the previous example and the Darboux transformation is invariant if we choose the free parameter or (same for the LU factorization). We have not found any other choice of the free parameter (or ) such that the Darboux transformation is invariant. Nevertheless there are some values of the parameters where we can guarantee that the Darboux transformation is almost invariant. Indeed, for consider . With this choice we always have . The values of the continued fractions (4.4) and (4.5) depend on the value of . We have two situations:
- •
If , then . Therefore the only choice of the parameter in order to have a stochastic factorization is . For this value we always have
[TABLE]
Therefore the transition probabilities of the Darboux transformation are exactly the same as the original case except for the state 0, where we have
[TABLE]
The random walk generated by is almost the same as the original one except for the state 0. The spectral matrix is given in this case by
[TABLE]
where
[TABLE]
Similar results hold for the LU case.
- •
If , then and . Therefore the parameter can be chosen in the range
[TABLE]
If we take (which satisfies the previous bounds) then we are in the same situation of the previous case, i.e. we have (4.9) for the sequences and the transition probabilities of the Darboux transformation are exactly the same as the original case except for the state 0, where we have again (4.10). The spectral matrix is then given by (4.11). If then we get invariance on the positive states of the Darboux random walk but not on the negative states nor state 0. On the contrary, if , then we get invariance on the negative states of the Darboux random walk but not on the nonnegative states. The spectral matrix can be computed from (4.8). Similar results hold for the LU case.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] Berezans’kii, Ju M., Expansions in Eigenfunctions of Selfadjoint Operators , Translations of Mathematical Monographs 17 , American Mathematical Society, Rhode Island, 1968.
- 2[2] Dai, D., Ismail, M.E.H. and Wang, X., Doubly infinite Jacobi matrices revisited: resolvent and spectral measure , Adv. Math. 343 (2019), 157–192.
- 3[3] Dette, H., Reuther, B., Studden, W. and Zygmunt, M., Matrix measures and random walks with a block tridiagonal transition matrix , SIAM J. Matrix Anal. Applic. 29 (2006), 117–142.
- 4[4] Geiger, J., Horozov, E. and Yakimov, M., Noncommutative bispectral Darboux transformations , Trans. Amer. Math. Soc. 369 (2017), 5889–5919.
- 5[5] Grassmann, W.K., Means and variances of time averages in Markovian environments , Eur. J. Oper. Res. 31 (1987), 132–139.
- 6[6] Grassmann, W.K., Means and variances in Markov reward systems , in Linear Algebra, Markov Chains and Queueing Models, ed. C.D. Meyer and R.J. Plemmons. Springer-Verlag, NY, 1993.
- 7[7] Grünbaum, F.A., Random walks and orthogonal polynomials: some challenges , Probability, Geometry and Integrable Systems, MSRI Publication, volumen 55 , 2007.
- 8[8] Grünbaum, F.A., QBD processes and matrix orthogonal polynomials: some new explicit examples , Numerical Methods for Structured Markov Chains, eds. D. Bini, B. Meini, V. Ramaswami, M.A. Remiche and P. Taylor, Dagstuhl Seminar Proceedings, 2008.
