On non-stationary solutions to MSDDEs: representations and the cointegration space
Mikkel Slot Nielsen

TL;DR
This paper explores solutions to multivariate stochastic delay differential equations with stationary increments, establishing their relation to cointegration, error correction models, and defining cointegrated MCARMA processes.
Contribution
It provides a comprehensive characterization of the cointegration space for MSDDEs and links these solutions to error correction forms and multivariate CARMA processes.
Findings
MSDDE solutions with stationary increments can be expressed in error correction form.
Complete characterization of the cointegration vectors for MSDDEs.
Introduction of cointegrated MCARMA processes and their relation to existing models.
Abstract
In this paper we study solutions to multivariate stochastic delay differential equations (MSDDEs) which have stationary increments, and we show that this modeling framework is in many ways similar to the discrete-time cointegrated VAR model. In particular, we observe that an MSDDE can always be written in an error correction form and, under suitable conditions, we argue that a process with stationary increments is a solution to the MSDDE if and only if it admits a certain Granger type representation. As a direct implication of these results we obtain a complete characterization of the set of cointegration vectors (the cointegration space). Finally, we exploit the relation between MSDDEs and invertible multivariate CARMA equations to define cointegrated MCARMA processes, and we discuss how this definition is related to earlier literature.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
On non-stationary solutions to MSDDEs: representations and the cointegration space
Mikkel Slot Nielsen
(February 25, 2019; Department of Mathematics
Aarhus University
Abstract
In this paper we study solutions to multivariate stochastic delay differential equations (MSDDEs) which have stationary increments, and we show that this modeling framework is in many ways similar to the discrete-time cointegrated VAR model. In particular, we observe that an MSDDE can always be written in an error correction form and, under suitable conditions, we argue that a process with stationary increments is a solution to the MSDDE if and only if it admits a certain Granger type representation. As a direct implication of these results we obtain a complete characterization of the set of cointegration vectors (the cointegration space). Finally, we exploit the relation between MSDDEs and invertible multivariate CARMA equations to define cointegrated MCARMA processes, and we discuss how this definition is related to earlier literature.
*MSC 2010 subject classifications: 60G10, 60G12, 60H05, 60H10, 91G70
Keywords: Cointegration, error correction form, Granger representation theorem, multivariate CARMA processes, multivariate SDDEs, non-stationary processes*
1 Introduction and main results
Cointegration refers to the phenomenon that some linear combinations of non-stationary time series are stationary. This concept goes at least back to Engle and Granger [9] who used the notion of cointegration to formalize the idea of a long run equilibrium between two or more non-stationary time series. Several models have been shown to be able to embed this idea, and one of the most popular among them is the VAR model:
[TABLE]
Here is an -dimensional, say, i.i.d. sequence with and invertible, and are matrices. If one is searching for a solution which is only stationary in its differences, , one often rephrases (1.1) in error correction form
[TABLE]
where and . (Here denotes the identity matrix.) Properties of solutions to (1.1) concerning existence, uniqueness and stationarity are determined by the characteristic polynomial . Let be the rank of and, if , let be matrices of rank satisfying . Standard existence and uniqueness results for VAR models and the Granger representation theorem yield the following:
Theorem 1.1**.**
Suppose that implies or . Moreover, suppose either that , or and (\alpha^{\perp})^{T}\bigl{(}I_{n}-\sum_{j=1}^{p-1}\Pi_{j}\bigr{)}\beta^{\perp} is invertible. Then a process with and stationary differences is a solution to (1.1) if and only if
[TABLE]
where:
- (i)
* is a random vector satisfying and .* 2. (ii)
C_{0}=\begin{cases}0&\text{if }r=n\\ \beta^{\perp}\bigl{[}(\alpha^{\perp})^{T}\bigl{(}I_{n}-{\textstyle\sum_{j=1}^{p-1}\Pi_{j}}\bigr{)}\beta^{\perp}\bigr{]}^{-1}(\alpha^{\perp})^{T}&\text{if }r<n\end{cases}. 3. (iii)
* is the -th coefficient in the Taylor expansion of at for .*
(We use the conventions and when , and denotes the Euclidean norm on .) The representation (1.3) has several immediate consequences: (i) any solution with stationary differences can be decomposed into an initial value, a unique stationary part and a unique non-stationary part, (ii) if the solution is stationary and unique, and (iii) if the process is stationary if and only if belongs to the row space of . In particular, cointegration is present in the VAR model when has rank , and the cointegration space is spanned by the rows of . There exists a massive literature on (cointegrated) VAR models, which have been applied in various fields. We refer to [9, 13, 14, 15, 20, 24] for further details.
In many ways, the multivariate stochastic delay differential equation (MSDDE)
[TABLE]
may be viewed as a continuous-time version of the (possibly infinite order) VAR equation (1.1). Here , , is a Lévy process with and , is an matrix such that each entry is a signed measure on satisfying
[TABLE]
for some , and denotes convolution. (For more on the notation used in this paper, see Section 2.) Moreover, will be required to satisfy and be given such that has stationary increments. The precise meaning of (1.4) is that
[TABLE]
almost surely for any . The model (1.4) results in the multivariate Ornstein-Uhlenbeck process when choosing , being the Dirac measure at [math] and , and stationary invertible multivariate CARMA (MCARMA) processes with a non-trivial moving average component can be represented as an MSDDE with infinite delay. Stationary solutions to equations of the type (1.4), MCARMA processes and their relations have been studied in [4, 5, 12, 17, 18]. Similarly to for the VAR model, questions concerning solutions to (1.4) are tied to the function
[TABLE]
In particular, it was shown that if implies , then the unique stationary solution to (1.4) with takes the form
[TABLE]
where is characterized by its Laplace transform:
[TABLE]
It follows that this result is an analogue to Theorem 1.1 when . To the best of our knowledge, there is no literature on solutions to (1.4) which are non-stationary, and hence no counterpart to Theorem 1.1 exists for the case .
The main result of this paper is a complete analogue of Theorem 1.1. In the following we will set
[TABLE]
In Proposition 3.1 we show that (1.4) admits the following error correction form:
[TABLE]
To make (1.8) comparable to (1.2), one can formally apply the derivative operator to the equation and obtain
[TABLE]
with . We can now formulate the counterpart to Theorem 1.1. In the following, refers to the rank of and in case , then are matrices of rank which satisfy .
Theorem 1.2**.**
Suppose that implies or . Moreover, suppose either that the rank of is , or strictly less than and is invertible. Then a process is a solution to (1.4) if and only if
[TABLE]
where the following holds:
- (i)
* is a random vector satisfying and .* 2. (ii)
C_{0}=\begin{cases}0&\text{if }r=n\\ \beta^{\perp}\bigl{[}(\alpha^{\perp})^{T}(I_{n}-\Pi([0,\infty)))\beta^{\perp}\bigr{]}^{-1}(\alpha^{\perp})^{T}&\text{if }r<n\end{cases}. 3. (iii)
* is characterized by*
[TABLE]
Similarly to the VAR model, Theorem 1.2 shows that cointegration occurs in the MSDDE model when is of reduced rank , and the rows of span the cointegration space. It follows as well that we always have uniqueness up to the discrepancy term , and the restrictions on depend ultimately on the rank of . Since an invertible MCARMA equation may be rephrased as an MSDDE, the notion of cointegrated invertible MCARMA processes can be studied in the MSDDE framework by relying on Theorem 1.2 (see Section 4 for details).
In Section 2 we will introduce some notation which will be used throughout the paper, and which already has been used in the introduction. The purpose of Section 3 is to develop a general theory for non-stationary solutions to MSDDEs with stationary increments, some of which will later be used to prove Theorem 1.2. In this section we will also put some emphasis on the implications of the representation (1.10), both in terms of stationary properties and concrete examples. Section 4 discusses how one can rely on the relation between invertible MCARMA equations and MSDDEs to define cointegrated MCARMA processes. In particular, under conditions similar to those imposed in [10, Theorem 4.6], we show existence and uniqueness of a cointegrated solution to the MSDDE associated to the MCARMA() equation. This complements the result of [10], which ensures existence of cointegrated MCARMA() processes when . Finally, Section 5 contains the proofs of all the statements presented in the paper together with a few technical results.
2 Preliminaries
Let be a measurable function and a matrix where each is a measure on . Then, provided that
[TABLE]
for , and , we set
[TABLE]
The definition of is defined in a similar (obvious) manner when either or is one-dimensional. Moreover, we will say that is a signed measure if it takes the form for two mutually singular measures and , where at least one of them is finite. The definition of the integral (2.1) extends naturally to signed matrix measures provided that the integrand is integrable with respect to the variation measure (simply referred to as being integrable with respect to ). For a given point , if is integrable with respect to , we define the convolution as
[TABLE]
For a measurable function and an signed matrix measure, if is integrable with respect to , we set . Also, if is a given signed matrix measure and is such that for all and , the -th entry of the Laplace transform of at is defined by
[TABLE]
Eventually, if is finite, we will also use the notation , , referring to the Fourier transform of . When for some measurable function we write and instead.
Finally, a stochastic process , , is said to be stationary, respectively have stationary increments, if the finite dimensional marginal distributions of , respectively , do not depend on .
3 General results on existence, uniqueness and representations of solutions to MSDDEs
Suppose that , , is an -dimensional measurable process with , stationary increments and , and let be a signed matrix measure which satisfies (1.5) for some . We will say that a stochastic process , , is a solution to the corresponding multivariate stochastic delay differential equation (MSDDE) if it meets the following requirements:
- (i)
is measurable and for all . 2. (ii)
has stationary increments. 3. (iii)
The relations
[TABLE]
hold true almost surely for each .
As indicated in the introduction, (iii) may be compactly written as
[TABLE]
We start with the observation that (3.1) can always be written in an error correction form (as noted in (1.8)):
Proposition 3.1**.**
Let and be defined by (1.7), and suppose that is given such that (1.5) is satisfied. Then for all , and (3.1) can be written as
[TABLE]
so if is a solution to (3.1), then is stationary.
Remark 3.2*.*
Using the notation , we do the following observations in relation to Proposition 3.1:
- (i)
If is invertible, a solution must be stationary itself. 2. (ii)
If the statement does not provide any further insight. Observe, however, the equation (3.2) depends in this case only on the increments of so a solution needs not to be stationary in this case. 3. (iii)
If the rank of satisfies , there exist non-trivial linear combinations of the entries of which are stationary
At this point we have not argued whether or not can be stationary even when and, ultimately, it depends on the structure of the noise process . However, it is not too difficult to verify from Theorem 3.5 that if is a Lévy process such that is invertible and , is stationary if and only if for some . In case of (iii), one often considers a rank factorization of ; that is, one chooses of rank such that . In this way one can identify the columns of as cointegrating vectors spanning the cointegration space, and as the adjustment matrix determining how deviations from a long run equilibrium affect short run dynamics. This type of intuition is well-known for the cointegrated VAR models, so we refer to [9] for details.
In the following we will search for a solution to (3.1). To this end, let be chosen such that (1.5) holds, set and define by
[TABLE]
Since is analytic on and as , is meromorphic on . Recall that if is a pole of , there exists such that is analytic and non-zero in a neighborhood of . If the pole is called simple.
Condition 3.3**.**
For the function in (3.3) it holds that
- (i)
for all and 2. (ii)
has either no poles at all or a simple pole at [math].
For convenience, we have chosen to work with Condition 3.3 rather than the assumptions of Theorem 1.2. The following result shows that they are essentially the same.
Proposition 3.4**.**
Suppose that, for some ,
[TABLE]
The following two statements are equivalent:
- (i)
There exists such that (1.5) and Condition 3.3 are satisfied. 2. (ii)
The assumptions of Theorem 1.2 hold true.
We will construct a solution to (3.1) in a similar way as in [4], namely by applying a suitable filter (i.e., a finite signed matrix measure) to . Theorem 3.5 reveals that the appropriate filter to apply is for a suitable function . This result may be viewed as a Granger type representation theorem for solutions to MSDDEs and as a general version of Theorem 1.2.
Theorem 3.5**.**
Suppose that Condition 3.3 holds. Then there exists a unique function satisfying
[TABLE]
and the function belongs to almost surely for each . Moreover, a process is a solution to (3.1) if and only if
[TABLE]
where , and .
Concerning the function of Theorem 3.5, it can also be obtained as a solution to a certain multivariate delay differential equation; we refer to Lemma 5.1 for more on its properties.
Remark 3.6*.*
Let the situation be as described in Theorem 3.5 and note that
[TABLE]
Hence, if the rank of is equal to we have that , and if is strictly less than , can be computed by the residue formula given in [23]. Specifically, , where are matrices of rank satisfying (note that the inverse matrix in the expression of does indeed exist by Proposition 3.4).
In the special case where has no poles at all, it was shown in [4, Theorem 3.1] that there exists a unique stationary solution to (3.1). The same conclusion can be reached by Theorem 3.5 using that is invertible. Indeed, in this case any solution is stationary, and (the first two implications follow from Remark 3.2 and 3.6, respectively). While there exist several solutions when is singular, Theorem 3.5 any two solutions always have the same increments. The term reflects how much solutions may differ and its possible values are determined by the relation .
In view of Proposition 3.4 and Remark 3.6, Theorem 1.2 is an obvious consequence of Theorem 3.5 if
[TABLE]
Clearly, the right-hand side of (3.6) requires that we can define integration with respect to . Although this is indeed possible if is a Lévy process (for instance, in the sense of [19]), we will here put the less restrictive assumption that is a regular integrator as defined in [4, Proposition 4.1]:
Corollary 3.7**.**
Suppose that Condition 3.3 holds. Assume also that, for each , there exists a linear map which satisfies
- (i)
* for all , and* 2. (ii)
for all finite measures on with ,
[TABLE]
where .
Then the statement of Theorem 1.2 holds true with
[TABLE]
In Theorem 1.2 the function is characterized through its Laplace transform , but one can also obtain it as a solution to a certain multivariate delay differential equation. This follows by using the similar characterization given for in Lemma 5.1; the details are discussed in Remark 5.3. It should also be stressed that the conditions for being a regular integrator (i.e., for to exist) are mild; many semimartingales with stationary increments (in particular, Lévy processes) and fractional Lévy processes, as studied in [16], are regular integrators. For more on regular integrators, see [4, Section 4.1].
Remark 3.8*.*
Suppose that Condition 3.3 is satisfied, let be a regular integrator, and let be a solution to (3.1). Since and (the latter by Remark 3.6), Corollary 3.7 implies that the stationary process is unique and given by
[TABLE]
If is not a regular integrator one can instead rely on Theorem 3.5 to replace by in (3.8).
We end this section by giving two examples. In both examples we suppose for convenience that is a regular integrator.
Example 3.9** (The univariate case).**
Consider the case where and is a measure which admits an exponential moment in the sense of (1.5) and satisfies for all . In this setup Condition 3.3 can be satisfied in two ways which ultimately determine the class of solutions characterized in Corollary 3.7:
- (i)
If . In this case, the solution to (3.1) is unique and given by
[TABLE]
where for with . This is consistent with the literature on stationary solutions to univariate SDDEs (see [3, 12]). 2. (ii)
If and . In this case, a process is a solution to (3.1) if and only if
[TABLE]
where can be any random variable with and for with .
Suppose that we are in case (ii) and fix . Using the notation , it follows from Proposition 3.1 that is a stationary solution to the equation
[TABLE]
Existence and uniqueness of stationary solutions to equations of the type (3.9) were studied in [3, Section 3] (when is a suitable Lévy-driven moving average), and it was shown how these sometimes can be used to construct stationary increment solutions to univariate SDDEs.
Example 3.10** (Ornstein-Uhlenbeck).**
Suppose that for some , for which its spectrum satisfies
[TABLE]
With this specification, the MSDDE (3.1) reads
[TABLE]
Under the assumption (3.10) we have that
[TABLE]
Since the set of zeroes of coincides with , it follows immediately that Condition 3.3 is satisfied for some if . This is the stationary case where the solution to (3.11) takes the well-known form
[TABLE]
If instead , let be the rank of and choose of rank such that . We can now rely on Proposition 3.4 and the observation that to conclude that Condition 3.3 is satisfied if is invertible. This is the cointegrated case where the solution takes the form
[TABLE]
with , and C_{0}=\beta^{\perp}\bigl{[}(\alpha^{\perp})^{T}\beta^{\perp}\bigr{]}^{-1}(\alpha^{\perp})^{T}. In particular, the stationary process takes the form
[TABLE]
Stationary Ornstein-Uhlenbeck processes have been widely studied in the literature (see, e.g., [2, 21, 22]). Cointegrated solutions to (3.11) have also received some attention, for instance, in [6].
4 Cointegrated multivariate CARMA processes
In [4, Theorem 4.8] it was shown that any stationary MCARMA process satisfying a certain invertibility assumption can be characterized as the unique solution to a suitable MSDDE. This may be viewed as the continuous-time analogue of representing a discrete-time ARMA process as an infinite order AR equation. In this section we will rely on this idea and the results obtained in Section 3 to define cointegrated MCARMA processes. The focus will only be on MCARMA() processes for a given . However, the analysis should also be doable for MCARMA() processes for a general with by extending the theory developed in the former sections to higher order MSDDEs. This was done in [4] in the stationary case. For convenience we will also assume that is a regular integrator in the sense of Corollary 3.7.
We start by introducing some notation. Define by
[TABLE]
for . Essentially, any definition of the MCARMA process aims at rigorously defining the solution to the formal differential equation
[TABLE]
Since for any random vector , one should only expect solutions to be unique up to translations belonging to the null space of . To solve (4.1) it is only necessary to impose assumptions on , but since we will be interested in an autoregressive representation of the equation, we will also impose an invertibility assumption on :
Condition 4.1** (Stationary case).**
If or , then .
Under Condition 4.1 it was noted in [17, Remark 3.23] that one can find which belongs to with
[TABLE]
Consequently, by heuristically applying the Fourier transform to (4.1) and rearranging terms, one arrives at the conclusion
[TABLE]
As should be the case, any definition used in the literature results in this process (although is sometimes restricted to being a Lévy process). In Proposition 4.2 we state two characterizations without proofs; these are consequences of [17, Definition 3.20] and [4, Theorem 4.8], respectively.
Proposition 4.2**.**
Suppose that Condition 4.1 is satisfied and let be defined by (4.2)-(4.3).
- (i)
Choose such that is at most of order , and set
[TABLE]
Then , where and is the unique stationary process satisfying for . 2. (ii)
Set and let be characterized by
[TABLE]
Then is the unique stationary process satisfying
[TABLE]
It follows from Proposition 4.2 that can either be defined in terms of a state-space model using the triple or by an MSDDE of the form (3.1) with
[TABLE]
While given by (4.3) is stationary by definition, it does indeed make sense to search for non-stationary, but cointegrated, processes satisfying (i) or (ii) of Proposition 4.2 also when Condition 4.1 does not hold. Fasen-Hartmann and Scholz [10] follow this idea by first characterizing cointegrated solutions to state-space equations and, next, define the cointegrated MCARMA process as a cointegrated solution corresponding to the specific triple . Their definition applies to any MCARMA() process and they give sufficient conditions on and for the cointegrated MCARMA process to exist when . We will use the results from the former sections to define the cointegrated MCARMA() process as the solution to an MSDDE.
Condition 4.3** (Cointegrated case).**
The following statements are true:
- (i)
If , then either or . 2. (ii)
The rank of is reduced . 3. (iii)
The matrix is invertible, where are of rank and satisfy . 4. (iv)
If then .
The assumptions (i)-(iii) of Condition 4.3 are also imposed in [10], and (iv) is imposed to ensure that (4.1) admits an MSDDE representation. In [10] they impose an additional assumption, namely that the polynomials and are so-called left coprime, which is used to ensure that the pole of at [math] is also a pole of . However, in our case this is implied by (iv).
Theorem 4.4**.**
Suppose that Condition 4.3 holds. Then the measure in (4.5) is well-defined and satisfies (1.5) as well as Condition 3.3 for a suitable , and the rank of is . In particular, a process is a solution to the corresponding MSDDE if and only if
[TABLE]
where , , C_{0}=\beta^{\perp}\bigl{[}(\alpha^{\perp})^{T}P_{p-1}\beta^{\perp}\bigr{]}^{-1}(\alpha^{\perp})^{T}Q_{p-1} and for with .
Remark 4.5*.*
Suppose that Condition 4.3 is satisfied and define by (4.5). In this case, Theorem 4.4 shows that given by (4.6) defines a solution to the corresponding MSDDE. As noted right after the formal CARMA equation (4.1), the initial value should not affect whether can be thought of as a solution (since ). Hence, suppose that . By heuristically computing from (4.6) we obtain
[TABLE]
for which, by multiplication of , shows that solves (4.1).
5 Proofs
Proof of Proposition 3.1.
We start by arguing that
[TABLE]
for a given . Note that, for any given finite signed matrix-valued measure on ,
[TABLE]
for all with using integration by parts. Consequently,
[TABLE]
using the notation . On the other hand, is analytic on (by (1.5)), and since , is also analytic on , and we deduce that
[TABLE]
for an arbitrary . Hence, we find that
[TABLE]
and it follows by [3, Lemma 4.1] (or a slight modification of [8, Theorem 1 (Section 3.4)]) and (5.3) that belongs to . For (5.1) to be satisfied it suffices to argue that , where refers to an arbitrarily chosen entry of . Using integration by parts we find that
[TABLE]
It is clear that the first term on the right-hand side of (5.4) is finite, and the same holds for the second term by (1.5). For the last term we use the Cauchy-Schwarz inequality and the fact that to deduce
[TABLE]
and this ultimately allows us to conclude that (5.1) holds. To show (3.2) it suffices to argue that
[TABLE]
almost surely for each . Using that coincides with the Lebesgue-Stieltjes measure of , together with integration by parts on the functions and , we obtain
[TABLE]
By [1, Corollary A.3], since has stationary increments and , there exist such that for all . Consequently, we may as well find (depending on and ) which satisfy
[TABLE]
From this inequality, and due to (5.1), each entry of converges to [math] in as . The same type of reasoning gives that
[TABLE]
showing that each entry of is almost surely integrable with respect to the Lebesgue measure and, hence, (5.6) implies (5.5). Finally, we need to argue that if is a solution to (3.1), is stationary. Since has stationary increments it follows immediately from (3.2) that , , is a stationary process for any . Since has stationary increments and , it is continuous in (see [1, Corollary A.3]), and hence converges to in as for any . Consequently, is stationary as well, and this finishes the proof.
∎
Proof of Proposition 3.4.
Assume that we are in case (i). If has no poles at all, then implies and the rank of is , and thus case (ii) is satisfied as well. If has a simple pole at [math], the rank of is strictly less than , and the residue formula in [23] implies that is invertible, where
[TABLE]
is the derivative of at [math], and are any two matrices of rank satisfying . Conversely, if we are in case (ii), the facts that the zeroes of are isolated points in and for sufficiently large ensure the existence of a such that for all . If the rank of is , has no poles at all on , and if and is invertible, the residue formula in [23] implies that has a simple pole at [math]. ∎
We will now turn to the construction of a solution to (3.1). Lemma 5.1 concerns the existence of the function introduced in Theorem 3.5 and its properties.
Lemma 5.1**.**
Suppose that Condition 3.3 holds. Then there exists a unique function enjoying the following properties:
- (i)
* for all .* 2. (ii)
* for all .* 3. (iii)
* for and for .*
Proof.
First note that, by assumption, is an analytic function on . For any we will argue that
[TABLE]
If this is the case, a slight extension of the characterization of Hardy spaces (see [3, Lemma 4.1] or [8, Theorem 1 (Section 3.4)]) ensures the existence of a function , vanishing on , such that each entry of belongs to and for all with . Since was arbitrary and, by uniqueness of the Laplace transform, the relation holds true for all . Moreover, since for all ( denoting the complex conjugate of ), takes values in . To show (5.7) observe initially that
[TABLE]
since is a finite measure for all . The same fact ensures that
- (i)
the absolute value of the determinant of behaves as as , and 2. (ii)
the dominating cofactors of as are those on the diagonal (the -th cofactor, ) and their absolute values behave as as .
In particular, behaves as as and, hence,
[TABLE]
Consequently, for any with ,
[TABLE]
and
[TABLE]
using and that is a submultiplicative norm. This verifies (5.7) and, hence, proves the existence of a function with for and for (in particular, verifying (ii)). To show (iii), note that
[TABLE]
for . By using the observation in (5.2) on the measures and together with (5.9) we establish that
[TABLE]
for almost all . Since we can choose to satisfy (5.10) for all without modifying its Laplace transform, we have established (iii). By the càdlàg property of , the uniqueness part follows as well. Finally, we need to argue that (i) holds, and for this it suffices to argue that for all where refers to an arbitrarily chosen entry of . From (5.10) it follows that the Lebesgue-Stieltjes measure of is given by . Therefore, integration by parts yields
[TABLE]
so to prove the result we only need to argue that each term on right-hand side of (5.11) is finite. The assumption (1.5) implies immediately that . As noted in the beginning of the proof, belongs to for an arbitrary . In particular, for ,
[TABLE]
Finally, since , it follows by the former arguments that this term is finite as well, and this concludes the proof. ∎
Remark 5.2*.*
Suppose that for all so that Condition 3.3 is satisfied and has no poles. Under this assumption it was argued in [4, Proposition 5.1] that there exists a function , which is vanishing on , is absolutely continuous on and decays exponentially fast at , such that for . Since property (ii) implies , it must be the case that .
Proof of Theorem 3.5.
The existence of is covered by Lemma 5.1. According to [1, Corollary A.3] and by equivalence of matrix norms, we may choose such that for all and for all . Using this together with property Lemma 5.1(i), we obtain that
[TABLE]
In particular, this shows that belongs to almost surely and, hence, given by (3.5) is a well-defined process. We will now split the proof in two parts: first, we argue that given by (3.5) is indeed a solution to (3.1) (existence) and, next, we show that any other solution necessarily admits this representation (uniqueness).
Existence: Note that for all and suitable by [1, Corollary A.3], so we may use similar reasoning as above to deduce that for all . Moreover, since solves (3.1) if and only if it solves (3.2), we may and do assume so that
[TABLE]
To show that satisfies (3.1), we need to argue that
[TABLE]
for . To this end, note that
[TABLE]
and
[TABLE]
using Lemma 5.1(iii) and (3.5), respectively. Moreover, by comparing their Laplace transforms, one can verify that and, thus,
[TABLE]
It follows by combining (5.13)-(5.15) that (5.12) is satisfied. Recall that, for to be a solution, we need to argue that has stationary increments. However, since
[TABLE]
and the distribution of does not depend on , it follows that the distribution of does not depend on . A rigorous argument can be carried out by approximating the above Lebesgue integral by Riemann sums in ; since this procedure is similar to the one used in the proof of [4, Theorem 3.1], we omit the details here.
Uniqueness: Suppose that satisfies (3.1), for all , and has stationary increments. In addition, suppose for the moment that we have already shown that
[TABLE]
Then it follows from (3.2) that almost surely for all . On the other hand, since and have stationary increments, they are continuous in and, hence, in as . This shows that belongs to the null space of almost surely and, consequently, is necessarily of the form (3.5). The remaining part of the proof concerns showing (5.16) or, equivalently, the process , , is unique for any . We will rely on the same type of ideas as in the proof of [6, Proposition 7] and [10, Proposition 4.5]. Suppose first that has reduced rank and let be a rank decomposition of as in Remark 3.2. Moreover, let be matrices of rank such that . Then it follows from Theorem 3.1 that
[TABLE]
for each . Define the stationary processes and V_{t}=\bigl{(}(\beta^{\perp})^{T}\beta^{\perp}\bigr{)}^{-1}(\beta^{\perp})^{T}\Delta_{h}Y_{t} (cf. Theorem 3.1). By using that and rearranging terms, (5.17) can be written as
[TABLE]
where
[TABLE]
and . Now, note that the Fourier transform of takes the form
[TABLE]
In particular, it follows that
[TABLE]
which is non-zero by Proposition 3.4. Consequently, it follows from (5.18) that the means of and are uniquely determined by the one of , . For this reason we may without loss of generality assume that , and are all zero mean processes so that they admit spectral representations. Recall that the spectral representation of a stationary, square integrable and zero mean process is given by , , where is a complex-valued spectral process which is square integrable and continuous in , and which has orthogonal increments. (Integration with respect to can be defined as in [11, pp 388-390] for all functions in , being the spectral distribution of .) Consequently, by letting , and be the spectral processes corresponding to , and , equation (5.18) can be rephrased as
[TABLE]
Here we have used a stochastic Fubini result for spectral processes, e.g., [7, Proposition A.1]. Since the functions , , are dense in for any finite measure (cf. [25, p. 150]), the relation (5.19) remains true when is replaced by any measurable and, say, bounded function . In particular, we will choose
[TABLE]
for and . Note that by (5.8), is indeed bounded. After observing that
[TABLE]
for , it is easy to verify that for all . Consequently, it follows from (5.19) that
[TABLE]
showing that the process is uniquely determined by . Now we only need to ague that this type of uniqueness also holds when is invertible and . If is invertible, must in fact be stationary (cf. Remark 3.2), and by [4, Theorem 3.1] there is only one process enjoying this property. If , the case is simpler than if , since here we only need to consider the second equation of (5.17) with and the spectral representation of . To avoid too many repetitions we leave out the details. ∎
Proof of Corollary 3.7.
As noted right before the statement we only need to argue that (3.6) is satisfied with respect to the definition (3.7). In order to do so, note that
[TABLE]
where for and for . Now observe that, for with ,
[TABLE]
using Remark 3.6 and Lemma 5.1(ii). Since both sides of (5.20) are analytic functions on , the equality holds true on . This proves that can be characterized as in the statement of Theorem 1.2 and, thus, finishes the proof.
∎
Remark 5.3*.*
As was the case for the function of Lemma 5.1, can also be obtained as a solution to a multivariate delay differential equation. Specifically, the shifted function , , satisfies
[TABLE]
By Theorem 3.5 the initial condition is . To see that (5.21) holds note that, for fixed , Lemma 5.1(iii) implies
[TABLE]
and
[TABLE]
by Fubini’s theorem. In the same way as in the proof of Theorem 3.1, one can rely on integration by parts to write (5.21) in error correction form:
[TABLE]
Proof of Theorem 1.2.
In view of Proposition 3.4 we may assume that Condition 3.3 is satisfied. Consequently, by using [4, Example 4.2], which states that an -dimensional Lévy process with finite first moments is a regular integrator (that is, there exist satisfying Corollary 3.7(i)-(ii)), the result is an immediate consequence of Corollary 3.7. ∎
Proof of Theorem 4.4.
Note that, by Condition 4.3(iv), we can choose such that whenever . To show that (4.5) is well-defined and satisfies (1.5) for some it suffices to establish
[TABLE]
(See, e.g., the beginning of the proof of Lemma 5.1.) It is straightforward to verify that is chosen such that is a polynomial of at most order . Consequently, the integrand in (5.22) is of the form , where is of strictly larger degree than , and hence it follows by sub-multiplicativity of that it decays at least as fast as when . Since the integrand is also bounded on compact subsets of we conclude that (5.22) is satisfied.
Next, we will show that the assumptions of Theorem 1.2 are satisfied (which, by Proposition 3.4, is equivalent to showing that Condition 3.3 holds). Observe that when , so by (i) and (iv) in Condition 4.3 it follows that implies or . Now, a Taylor expansion of around [math] yields
[TABLE]
and hence
[TABLE]
Let and , and note that these matrices are of rank and satisfy . Thanks to Condition 4.3(iii), the matrix
[TABLE]
is invertible, so the assumptions of Theorem 1.2 are satisfied. The remaining statements are now simply consequences of Corollary 3.7. ∎
Acknowledgments
I would like to thank Andreas Basse-O’Connor and Jan Pedersen for helpful comments. This work was supported by the Danish Council for Independent Research (Grant DFF - 4002–00003).
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1Barndorff-Nielsen et al. [2011] Barndorff-Nielsen, O. E., A. Basse-O’Connor, et al. (2011). Quasi Ornstein–Uhlenbeck processes. Bernoulli 17 (3), 916–941.
- 2Barndorff-Nielsen et al. [1998] Barndorff-Nielsen, O. E., J. L. Jensen, and M. Sørensen (1998). Some stationary processes in discrete and continuous time. Advances in Applied Probability 30 (4), 989–1007.
- 3Basse-O’Connor et al. [2018 a] Basse-O’Connor, A., M. S. Nielsen, J. Pedersen, and V. Rohde (2018 a). Continuous-time models with an autoregressive structure. ar Xiv preprint ar Xiv:1704.08574 v 2 .
- 4Basse-O’Connor et al. [2018 b] Basse-O’Connor, A., M. S. Nielsen, J. Pedersen, and V. Rohde (2018 b). Multivariate stochastic delay differential equations and CAR representations of CARMA processes. To appear in Stochastic Processes and their Applications .
- 5Brockwell [2014] Brockwell, P. (2014). Recent results in the theory and applications of CARMA processes. Annals of the Institute of Statistical Mathematics 66 (4), 647–685.
- 6Comte [1999] Comte, F. (1999). Discrete and continuous time cointegration. Journal of Econometrics 88 (2), 207–226.
- 7Davis et al. [2018] Davis, R. A., M. S. Nielsen, and V. Rohde (2018). Stochastic differential equations with a fractionally filtered delay: a semimartingale model for long-range dependent processes. To appear in Bernoulli .
- 8Dym and Mc Kean [1972] Dym, H. and H. P. Mc Kean (1972). Fourier series and integrals . Academic Press, New York-London. Probability and Mathematical Statistics, No. 14.
