Filtering of Gaussian processes in Hilbert spaces
Vit Kubelka, Bohdan Maslowski

TL;DR
This paper develops filtering techniques for infinite-dimensional Gaussian processes, deriving integral equations for the filter and error covariance, and applies these results to linear SPDEs driven by Gauss-Volterra processes observed at finite points.
Contribution
It introduces a new filtering framework for infinite-dimensional Gaussian processes and derives integral equations, with applications to SPDEs driven by Gauss-Volterra processes.
Findings
Derived integral equations for the filter and error covariance.
Applied results to linear SPDEs with finite-point observations.
Extended filtering theory to infinite-dimensional Gaussian processes.
Abstract
Linear filtering problem for infinite-dimensional Gaussian processes is studied, the observation process being finite-dimensional. Integral equations for the filter and for covariance of the error are derived. General results are applied to linear SPDEs driven by Gauss-Volterra process observed at finitely many points of the domain.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Filtering of Gaussian processes in Hilbert spaces
V. Kubelka
[email protected] Faculty of Mathematics and Physics, Charles University, Sokolovská 83, 186 75 Prague 8, Czech Republic
B. Maslowski11footnotemark: 1
Abstract
Linear filtering problem for infinite-dimensional Gaussian processes is studied, the observation process being finite-dimensional. Integral equations for the filter and for covariance of the error are derived. General results are applied to linear SPDEs driven by Gauss-Volterra process observed at finitely many points of the domain.
†† Keywords: Kalman - Bucy filter, stochastic evolution equations, Gaussian processes
Introduction
The aim of this paper is to study the linear filtering problem for infinite-dimensional Gaussian processes with finite-dimensional observation. Typically, the signal process may be governed by a linear SPDE driven by noise that is not white in time, like a Gaussian Volterra noise or, in particular, fractional Brownian motion (FBM).
An analogous problem for finite-dimensional (or scalar) processes have been studied by Kleptsyna and Le Breton [16] for the case of general Gaussian process observed through a linear channel driven by standard Brownian motion; this problem has been revisited in [14]. A rather general approach to filtering with fractional Brownian motion is presented in [15] and specified in more concrete situations, for example, in [14].
In infinite dimensions, a pioneering result belongs to Falb [12], where Kalman-Bucy (KB) type theorem has been established. In this case, both observed process and observation live in a Hilbert space and are governed by linear evolution equation with a -Wiener process. We are not aware of any analogous result in infinite dimensions for general Gaussian processes that would cover, for example, linear SPDEs driven by fractional noise (however, we would like to point out that a ”dual” LQ control problem has been treated, for instance, in [10] and [9], while related statistical inference problems were addressed in numerous papers, like [20], [2] or [17]).
In the present paper, integral equations for the filter and for covariance of observation error on a rigged Hilbert space are derived and the general results are applied to stochastic parabolic equation perturbed by Gauss-Volterra noise, observed at finitely many points of the domain. In this case, comparing to the classical KB theorem, there are two major obstacles: the fact that the noise does not have independent increments and the need to apply the results to linear SPDEs with space-dependent noise and observation at specific points in the domain of the equation. While the first problem is treated similarly as in the finite-dimensional papers quoted above, the second one is overcome by posing the equation on a rigged Hilbert space. The larger space (which is usually a Lebesgue space on the domain) is suitable for the definition of the noise term and the stochastic integral, while the smaller space is contained in the space of continuous functions (for which values at given points are well defined).
The paper is divided into four Sections. In section 1 the problem is posed and the main result (Theorem 1.1) is stated and proved. It is shown that the filter and observation error satisfy certain integral equations. In Section 2, uniqueness of solutions to the (nonlinear) integral equation for the error covariance (Theorem 2.1) is shown. Section 3 is devoted to Examples. At first it is demonstrated that if the signal process is governed by linear evolution equation driven by a standard cylindrical Wiener process, our result stated in Theorem 1.1 reduces to an infinite-dimensional analogue of the classical Kalman-Bucy Theorem (Theorem 3.2). Then, following [4], [5] and [6], some basic concepts concerning the infinite-dimensional Gauss-Volterra processes and SPDEs driven by them are recalled. Finally, in Example 3.4 the general results are applied to -th order stochastic parabolic equation on a bounded domain (and further specified in the case of stochastic heat equation). In Corollary 3.5 the main results is specified to the case of pointwise observation of solution to such equation.
Bounded linear operator mapping a Banach space to a a Banach space is denoted as , . The space of Hilbert-Schmidt operators on a Hilbert space H is denoted by .
1 Solution of the filtering problem
Let be a rigged separable Hilbert space, where and are separable Hilbert spaces such that , is dense in and identifying with the dual the embeddings
[TABLE]
are continuous and dense. The duality pairing between and is defined by the inner product on , that is for and .
For arbitrary we define tensor product , , .
Let us consider stochastic basis and the signal that is a centered Gaussian mean - square continuous measurable process in . Let denote an - valued observation process given as
[TABLE]
where is a family of linear operators such that mapping is strongly measurable and , for some . Here is a standard - valued Wiener process independent of the signal .
Further, assume that for each operator can be decomposed into functionals such that for all . Note that the dual operator : then satisfies for all .
We are dealing with the optimal filter , which is defined as
[TABLE]
where is the filtration generated by the observation process .
Set , . Notice that the mean - square continuity of the process implies that the mapping is strongly continuous and bounded.
Theorem 1.1**.**
Let . The filter satisfies the stochastic integral equation
[TABLE]
where operator : defined as for all is strongly continuous and satisfies the integral equation
[TABLE]
Moreover, for all , is the covariance of the estimation error at time , that is,
[TABLE]
holds.
In the proof of theorem (1.1)the following lemma will be useful.
Lemma 1.2**.**
Let us consider an - valued process of diffusion type on probability space with the differential
[TABLE]
where is an - progresively measurable - valued process and is a standard - Wiener process in . If
[TABLE]
for every , then any one - dimensional - martingale X, forming together with a Gaussian system can be represented in the form
[TABLE]
where are deterministic square integrable measurable functions.
Proof.
Note that by (1.5) is also - Wiener process.
According to Theorem 3.1 in [13] there is a representation
[TABLE]
where is - progresively measurable - valued process and
[TABLE]
for every .
Using Gaussianity of the process and Theorem on Normal Correlation (cf. Theorem 13.1 in [19]) it can be shown, analogously to the proof of Theorem 5.21 in [18], that for all and for all
[TABLE]
holds.
Furter, using Itô formula and the fact that mixed variation for and for we have
[TABLE]
Now, using (1.10), (1.11) and martingale property of Itô integral for all we get
[TABLE]
Taking into account (1.9) we can use Fubini’s theorem to obtain
[TABLE]
for all .
We can use (1.12) piecewise on a sequence of decompositions of interval such that to obtain
[TABLE]
where , .
Analogously to the proof of Theorem 5.21 in [18], using continuity of the filtration which follows from Theorem 5.19 in [18] and the uniform integrability of we get
[TABLE]
From this, for all and each , we have
[TABLE]
and, therefore, for all and for almost all
[TABLE]
Equality (1.13) together with (1.8) proves the representation (1.7). ∎
Now, let us prove of theorem (1.1).
Proof.
According to Lemma 2.2 in [13] process defined as
[TABLE]
is - valued - standard Wiener process called innovation process. The formula (1.14) reads
[TABLE]
and the process satisfies the condition (1.6) of Lemma 1.2 hence the observation process takes the form (1.5).
Further, define the square integrable - valued process as
[TABLE]
for all . Note that and the proces is - martingale.
Let be an orthonormal basis on . Then we have
[TABLE]
where . Process is one - dimensional - martingale for all and all . The triple forms a Gaussian system, therefore, in virtue of Lemma 1.2
[TABLE]
where are deterministic square integrable measurable functions, holds for every and every . From equations (1.17) and (1.18) we obtain
[TABLE]
Using Itô isometry
[TABLE]
where is square integrable - valued deterministic function such that for all .
Therefore, swaping the sums and the integral in (1.19) we finally obtain
[TABLE]
Now, for every , we can consider an arbitrary square integrable measurable - valued deterministic function to show
[TABLE]
Indeed, using (1.16) for arbitrary we have
[TABLE]
Further, we show that
[TABLE]
Note that to prove equality of two arbitrary operators it is sufficient to show for all elements , . We have that
[TABLE]
Using Itô isometry and the fact that mixed variation we obtain
[TABLE]
which concludes the proof of equality (1.22).
Next, we show equality
[TABLE]
Using (1.1), (1.14) and independence of and we have
[TABLE]
To complete the proof of equality (1.23) it is sufficient to show
[TABLE]
By the definition of tensor product we obtain
[TABLE]
for all , . Similarly we get
[TABLE]
Which proves equality (1.24) and, therefore, completes the proof of (1.23).
Combining equalities (1.21), (1.22) and (1.23) we obtain
[TABLE]
The formula (1.25) holds for any arbitrary square integrable - valued deterministic function hence
[TABLE]
for all and for almost all .
From (1.20) and (1.26), by the choice and taking into account (1.14) we have
[TABLE]
which concludes the proof of stochastic integral equation (1.2).
Let us verify the formula (1.3). Notice that
[TABLE]
Using the above proved representation of , (1.1), (1.14) and independence of and , we have
[TABLE]
For arbitrary , we have that
[TABLE]
By (1.28) it follows that
[TABLE]
This, together with (1.27), proves the formula (1.3).
By (1.27) the mapping is strongly continuous on uniformly with respect to hence the representation (1.29) implies the mean - square continuity of the proces in . By (1.29) and (1.27) the mapping : is strongly continuous.
It remains to prove equality (1.4). For every it holds
[TABLE]
therefore, we obtain
[TABLE]
which completes the proof of Theorem 1.1. ∎
2 Uniqueness of the covariance equation
In the present section we prove uniqueness of solutions to the integral equation (1.3) in the class of operators
[TABLE]
More generally, we prove the following.
Theorem 2.1**.**
Let be a strongly continuous mapping such that for each .
Then the integral equation
[TABLE]
has at most one solution in the class .
Proof.
First, we show that every satisfying the equation (2.1) is bounded on .
Using Cauchy - Schwarz inequality we obtain for arbitrary
[TABLE]
In the last inequality we can increase the upper bound of the first integral from to because the integrand is nonnegative. Thus all we need is to estimate the term
[TABLE]
for all and . Using (2.1) and the boundedness of the family in (which follows by the Resonance Theorem) we obtain
[TABLE]
Now, by (2.1), (2.2), (2.3) and again by the boundedness of the family we have that
[TABLE]
for all and , which proves that the family of operators is bounded in .
Assume that are solutions to the equation (2.1) and using essential supremum set , . In virtue of (2.1) we have
[TABLE]
Now, by the Gronwall lemma we obtain for all and the proof is complete.
∎
Remark 2.2*.*
Note that if the signal takes its values in the Hilbert space , the family of observation operators can be characterised by functionals from the dual space of and no embedding is needed. In this case the equation (1.3) can be expressed using adjoint operators and as
[TABLE]
Indeed we have
[TABLE]
for all and all .
3 Examples
Example 3.1**.**
*Linear Stochastic Evolution Equation driven by Wiener Process
*Let the signal be an - valued random process defined by stochastic evolution equation
[TABLE]
where is the infinitesimal generator of a strongly continuous semigroup in , and is an - valued standard cylindrical Wiener process defined on a stochastic basis .
Assume , and for some . Then the equation (3.1) has a unique mean - square continuous solution (cf. [8]). The observation is given by the equation (1.1) where , is a -valued Wiener process on independent of and is strongly measurable and bounded.
For all the process satisfies
[TABLE]
where is a well defined centered Gaussian variable in and is independent of (see [8]).
In this case the equations (1.2) and (1.3) simplify to the infinte - dimensional analogue of standard Kalman - Bucy filter as shown in the following theorem.
Theorem 3.2**.**
The filter satisfies the stochastic differential equation
[TABLE]
where the solution to (3.3) is understood in the mild sense, i.e. solves the equation
[TABLE]
The family of operators : defined as for all satisfies the differential equation
[TABLE]
in the weak sense, that is
[TABLE]
for all .
Proof.
Note that the operator is in fact the operator defined in theorem (1.1) when and is selfadjoint. Set and on .
Using (1.2), (3.2), the independence of and for all and the definition of operator in theorem (1.1) we obtain
[TABLE]
for all which is exactly (3.4).
Using the same arguments as above, equation (2.4) and self - adjointness of the operator , we have
[TABLE]
Since the covariance operator is a mild solution to the equation
[TABLE]
which takes the form
[TABLE]
we obtain
[TABLE]
which is known to be equivalent to the weak form of the equation (3.5) (cf. [7]). ∎
Now, let us consider a signal defined by linear stochastic evolution equation driven by a regular Gauss - Volterra noise. First, we summarise a few basic facts from the infinte - dimensional theory of such processes (see [4], [5], [3] for more details, see also [6] for a brief survey).
By scalar Gauss - Volterra process (called also - regular Volterra process) we understand a centered Gaussian process , , the covariance of which takes the form
[TABLE]
where the kernel satisfies
[TABLE]
Note that in virtue of the Kolmogorov continuity criterion the process has an
- Hölder version for (cf. [5], Remark 2.1).
An important example of - regular Gauss - Volterra process is the fractional Brownian motion with the Hurst parameter , in which case and
[TABLE]
where is a suitable constant (see [1]).
Another example is the multifractional Brownian motion where the Hurst parameter is a function of time. For the definition and conditions on which ensure that the process satisfies the above assumptions see [4], Example 2.14.
Now, given a separable Hilbert space and a stochastic basis , the cylindrical Gauss - Volterra process on is defined by the formal series
[TABLE]
where is an orthonormal basis in and is a sequence of independent scalar - regular Gauss - Volterra processes with the same kernel . The series (3.6) does not converge in the space but defines the system of scalar processes ,
[TABLE]
(for definitions and basic properties of cylindrical Volterra processes and stochastic integrals driven by them see [4], [5]).
Suppose that the signal satisfies the equation
[TABLE]
where is infinitesimal generator of a strongly continuous semigroup in and .
By the analyticity of semigroup there exists such that the operator is strictly positive. Therefore, for , we can define the Hilbert space
[TABLE]
equipped with the graph norm topology.
The solution to the equation (3.7) is understood in the mild sense, that is,
[TABLE]
As a particular case of Corollary 4.1. in [5] we obtain the following statement.
Theorem 3.3**.**
Assume , , and let there exist a such that
[TABLE]
for a constant . Then has a continuou version in the space for
[TABLE]
If (which corresponds to the case when the driving noise in (3.7) may be represented by a genuine -valued Gauss-Volterra process), the condition (3.8) is satisfied with and (3.9) reads (for the fractional Brownian motion ).
Note that for fractional Brownian motion the proposition holds true even if (cf. [11]).
Example 3.4**.**
Consider the signal given by the following parabolic equation
[TABLE]
on with initial condition and with the Dirichlet boundary condition
[TABLE]
where denotes the conormal derivative. The domain is open and bounded with smooth boundary and is a differential operator uniformly elliptic of order ,
[TABLE]
with . The noise is Gauss - Volterra in time and may be white (if is identity operator) or correlated in space. This system can be reformulated as the stochastic evolution equation (3.7) in . Indeed, the noise is formally given as
[TABLE]
where is a Gauss - Volterra process on and \mathcal{A}=L_{2m}\big{|}_{Dom(\mathcal{A})} where
[TABLE]
The operator generates an analytic semigroup on .
If the observation is given by the equation (1.1) where , is independent of and is strongly measurable and bounded, Theorems 1.1, 2.1 and Remark 2.2 may be applied.
However, it may be interesting to consider the case when the only accessible information comes from observation of the signal at given points . Then the signal process has to be more regular.
For simplicity, assume that , i.e. (3.10) is a stochastic heat equation. If the condition (3.9) is satisfied and, moreover
[TABLE]
then the signal has a continuous version in (cf. [4], [5]) that is continuously embedded into by the Sobolev theorem. This follows from the fact that (cf. [21]). Such a choice of is possible if
[TABLE]
(note that if we may put and, on the other hand, for we may consider arbitrary ).
Then in Theorems 1.1 and 2.1 we may put and as an example of observation operator we may take defined as
[TABLE]
where , which corresponds to pointwise observation of the signal process .
In this case the equations (1.2) and (1.3) can be rewritten according to the following theorem.
Corollary 3.5**.**
Let the signal satisfy the stochastic evolution equation
[TABLE]
where is a Gauss - Volterra process on , and \mathcal{A}=L_{2}\big{|}_{Dom(\mathcal{A})} is given by (3.11) and (3.12). Further assume that condition (3.13) holds. Consider the observation process given by (1.1) with operator defined by (3.14). Then the filter satisfies stochastic integral equation
[TABLE]
where : is defined as for all , and integral equation
[TABLE]
is satisfied.
Proof.
From (1.2), the definition of operator , the continuous embedding and (3.14) we have
[TABLE]
which concludes the proof of (3.15).
Analogously, using (1.3) we obtain
[TABLE]
which concludes the proof of (3.16). ∎
Note that if the driving process is a fractional Brownian motion the condition (3.13) reads
[TABLE]
(cf. [5]).
It may be interesting to specify the covariances that appear in the equation (3.16). Suppose, for simplicity, that the driving process is a fractional Brownian motion with the Hurst parameter , (i.e. the process is observed at a single point ) and the noise term is Hilbert-Schmidt, i.e. it may be expressed as
[TABLE]
where . It is also well known that the semigroup may be represented by a Green function , that is,
[TABLE]
Therefore, the composition may be written as
[TABLE]
where the composition kernel is given by
[TABLE]
Now it is standard to compute the covariance
[TABLE]
for , , where and .
Acknowledgements: This research was partially suported by GAUK Grant no. 980218, Czech Science Foundation (GAČR) Grant no. 19-07140S and by the SVV Grant No. 260454.
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] E. Alòs and D. Nualart , Stochastic integration with respect to the fractional Brownian motion, Stochastics and Stochastic Reports 75 (2003) 129–152.
- 2[2] I. Cialenco, S. V. Lototsky and J. Pospíšil , Asymptotic properties of the maximum likelihood estimator for stochastic parabolic equations with additive fractional Brownian motion, Stochastics and Dynamics 9 (2009) 169–185.
- 3[3] P. Čoupek , Limiting measure and stationarity of solutions to stochastic evolution equations with Volterra noise, Stochastic Analysis and Applications 36 (2018) 393–412.
- 4[4] P. Čoupek and B. Maslowski , Stochastic evolution equations with Volterra noise, Stochastic Processes and their Applications 127 (2017) 877–900.
- 5[5] P. Čoupek, B. Maslowski and M. Ondreját , L p superscript 𝐿 𝑝 {L}^{p} -valued stochastic convolution integral driven by Volterra noise, Stochastics and Dynamics 18 (2018), no. 1850048.
- 6[6] P. Čoupek, B. Maslowski and J. Šnupárková , SPD Es with Volterra noise, in International Conference on Stochastic Partial Differential Equations and Related Fields , Springer, (2016), 147–158.
- 7[7] R. F. Curtain and A. J. Pritchard, Infinite Dimensional Linear Systems Theory, Lecture Notes in Control and Information Sciences 8, (Springer, Berlin, 1978).
- 8[8] G. Da Prato and J. Zabczyk, Stochastic Equations in Infinite Dimensions , vol. 152 (Cambridge University Press, 2014).
