Average case tractability of additive random fields with Korobov kernels
Jia Chen, Heping Wang

TL;DR
This paper studies the average case complexity of approximating additive random fields with Korobov kernels, establishing polynomial tractability and conditions for strong polynomial tractability under different error criteria.
Contribution
It provides the first comprehensive analysis of tractability for these fields, including necessary and sufficient conditions for strong polynomial tractability.
Findings
Problem is always polynomially tractable under ABS and NOR
Derived necessary and sufficient conditions for strong polynomial tractability
Analyzed non-homogeneous cases with Korobov kernels
Abstract
We investigate average case tractability of approximation of additive random fields with marginal random processes corresponding to the Korobov kernels for the non-homogeneous case. We use the absolute error criterion (ABS) or the normalized error criterion (NOR). We show that the problem is always polynomially tractable for ABS or NOR, and give sufficient and necessary conditions for strong polynomial tractability for ABS or NOR.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMathematical Approximation and Integration · Advanced Mathematical Modeling in Engineering · Advanced Numerical Methods in Computational Mathematics
Average case tractability of additive random fields with Korobov kernels
Jia Chen, Heping Wang
School of Mathematical Sciences, Capital Normal University, Beijing 100048, China.
[email protected]; [email protected].
Abstract.
We investigate average case tractability of approximation of additive random fields with marginal random processes corresponding to the Korobov kernels for the non-homogeneous case. We use the absolute error criterion (ABS) or the normalized error criterion (NOR). We show that the problem is always polynomially tractable for ABS or NOR, and give sufficient and necessary conditions for strong polynomial tractability for ABS or NOR.
Key words and phrases:
Additive random fields; Tractability; Korobov kernels
1. Introduction
Let be a sequence of independent random processes, where . Suppose that every random element has zero mean and a covariance function . Let be the covariance operator with the covariance kernel for every . Then for any and , we have
[TABLE]
We consider the random field
[TABLE]
with the following zero-mean covariance function
[TABLE]
and covariance operator
[TABLE]
where This random field is called an additive random field. There are many papers which investigated this random field, see [1, 3, 4, 5].
In this paper, we investigate the average case approximation of , as a random element of the space equipped with inner product and norm , by a finite rank random field.
The th minimal 2-average case error, for , is defined by
[TABLE]
Here is the class of all linear algorithms with rank defined by
[TABLE]
The so-called initial average case error is given by
[TABLE]
We use either the absolute error criterion (ABS) or the normalized error criterion (NOR). For any , we study information complexity of approximation of the random fields defined by
[TABLE]
where ,
[TABLE]
Let . First we consider average case tractability of . Various notions of tractability have been discussed for multivariate problems. We recall some of the basic tractability notions (see [7, 8, 9, 10]).
For , say is
strongly polynomially tractable (SPT) iff there exist non-negative numbers and such that for all ,
[TABLE]
The infimum of satisfying the above inequality is called the exponent of strong polynomial tractability and is denoted by .
polynomially tractable (PT) iff there exist non-negative numbers and such that for all ,
[TABLE]
quasi-polynomially tractable (QPT) iff there exist two constants such that for all ,
[TABLE]
uniformly weakly tractable (UWT) iff for all ,
[TABLE]
weakly tractable (WT) iff
[TABLE]
This paper is devoted to studying average case tractability of the additive random field under ABS and NOR. For additive random fields similar problems were investigated in [2, 5, 6, 11] in various settings for the homogeneous case and in [3, 4] for the non-homogeneous case. Here, the homogeneous case means that approximated additive random fields are constructed (in a special way) from copies of one marginal process, while the non-homogeneous case means that the random fields are composed of a whole sequence of marginal random processes with generally different covariance functions. Specifically, the authors in [3] obtained the growth of for arbitrary fixed and for the non-homogeneous case and gave application to the additive random fields with marginal random processes corresponding to the Korobov kernels.
It should be noted, however, that all these works deal only with NOR. In this paper, we consider average case tractability of the problem of the additive random fields with marginal random processes corresponding to the Korobov kernels under ABS and NOR. We shall show that the problem is always polynomially tractable for ABS or NOR. Obviously, PT implies all QPT, UWT, WT. We also give sufficient and necessary conditions for which is SPT for ABS or NOR.
The paper is organized as follows. In Section 2 we give preliminaries about the additive random fields with marginal random processes corresponding to the Korobov kernels and introduce main results, i.e., Theorems 2.1-2.3. Section 3 is devoted to proving Theorems 2.1-2.3.
2. Preliminaries and main results
Let us consider the sequence of additive random fields , , , defined by (1.1). Let \big{\{}(\lambda_{k}^{X_{j}},\,\psi_{k}^{X_{j}})\big{\}}_{k\in\mathbb{N}} be the sequence of eigenpairs of the covariance operator of . Under the additive structure (1.2), the eigenvalues , are generally unknown or not easily depend on . However, under the following condition, we can explicitly describe the eigenvalues .
For every there exist such that for all . We denote by the eigenvalues corresponding to eigenvector
- Let and be the non-increasing sequence of the remaining eigenvalues and the corresponding sequence of eigenvectors of , respectively. It is known that the family of eigenvectors
[TABLE]
is an orthogonal system in for every , see [3]. Hence the identical 1 is an eigenvector of with the eigenvalue , and the pairs , for all and , are the remaining eigenpairs of .
Let and be the non-increasing sequence of the eigenvalues and the corresponding sequence of eigenvectors of defined by (1.3). Then the average case information complexity can also be described in terms of eigenvalues of by
[TABLE]
where
[TABLE]
see [7].
Particularly, we study additive random fields with marginal random processes corresponding to the Korobov kernels. Let , be a zero-mean random field with the following covariance function
[TABLE]
Here , and . Let be the covariance operator with kernel of , and for any and ,
[TABLE]
The eigenpairs of the covariance operator are known, see [7]. The identical 1 is an eigenvector of with the eigenvalue . The other eigenpairs of have the following form:
[TABLE]
for any .
Suppose that is a sequence of independent zero-mean random fields with covariance functions , respectively. Let , , be the sequence of zero-mean random fields with the covariance functions
[TABLE]
where , , and the parameters , for all , and .
Let be the covariance operator of . We have
[TABLE]
for any and . Then the identical 1 is an eigenvector of with the eigenvalue
[TABLE]
and the remaining eigenvalues and eigenvectors are
[TABLE]
and
[TABLE]
respectively. Let be the sequence of non-increasing rearrangement of the eigenvalues of . Then we have
[TABLE]
and for any and ,
[TABLE]
where , is the Riemann zeta-function.
In the sequel we always assume that the sequences satisfy
[TABLE]
In this paper, we consider the tractability of the problem
[TABLE]
under ABS and NOR, where the sequences satisfy (2.6). Our main results can be formulated as follows.
Theorem 2.1**.**
Let the sequences satisfy (2.6). Then the problem
(i) is always PT for ABS or NOR;
(ii) is SPT for ABS iff
[TABLE]
The exponent of SPT is
[TABLE]
In order to investigate the strong polynomial tractability of the problem for NOR, we consider two cases.
Theorem 2.2**.**
Let satisfy (2.6) and
[TABLE]
where is a constant. Then for NOR the problem is SPT iff
[TABLE]
The exponent of SPT is
[TABLE]
Theorem 2.3**.**
Let satisfy (2.6). Further assume that
[TABLE]
and there exists a constant such that for every ,
[TABLE]
Then the problem is SPT for NOR iff
[TABLE]
The exponent of SPT is
[TABLE]
In particular, if for , then the problem is SPT for NOR iff
[TABLE]
Remark 2.4*.*
In [3], Khartov and Zani investigated for arbitrary fixed and of the above problem with the parameters
[TABLE]
where , , and . They obtained the following results.
(1) For and either , or , . Then
[TABLE]
(2) For , and ,
[TABLE]
where
[TABLE]
(3) For , and , then
[TABLE]
We remark that in some sense the above results give the tractability results of the problem for NOR under the condition (2.11). Specifically, the above result (1) corresponds to SPT of for NOR, and results (2) and (3) relate to PT of for NOR, but more explicitly. Comparing with [3], we obtain the tractability of the problem with general parameters satisfying (2.6) for ABS and NOR. Also we get the exponent of SPT for ABS and NOR.
Remark 2.5*.*
For the above problem , let be the additive random fields with marginal random processes corresponding to the Korobov covariance functions
[TABLE]
with parameters satisfying
[TABLE]
Let and be the sequences of non-increasing rearrangement of the eigenvalues of the covariance operators and , respectively. Then for some ,
[TABLE]
and
[TABLE]
From the above equalities we obtain that
[TABLE]
It follows from (2.1) and the inequality that for ,
[TABLE]
On the other hand, we note that for ,
[TABLE]
where . This gives that
[TABLE]
which means that
[TABLE]
Hence we have for ,
[TABLE]
It follows that the problems
[TABLE]
have the same tractability for ABS and the same exponent of SPT for ABS if the problem is SPT for ABS.
Remark 2.6*.*
Let the sequences satisfy (2.6). If the problem is SPT (or PT) for ABS, then it is also SPT (or PT) for NOR.
Indeed, it follows from (2.4) that
[TABLE]
By (2.1) we have
[TABLE]
which means
[TABLE]
Therefore if the problem is SPT (or PT) for ABS, then it is also SPT (or PT) for NOR.
3. Proofs of Theorems 2.1-2.3
Proof of Theorem 2.1.
(i) From Remark 2.6, it is sufficient to show that is PT for ABS. By Remark 2.5 we get that is PT for ABS iff is PT for ABS. Hence it suffices to prove that is PT for ABS.
We note
[TABLE]
and
[TABLE]
It follows that for ,
[TABLE]
where in the last inequality we used for all . This forces
[TABLE]
Due to [7, Theorem 6.1] we obtain that is PT for ABS. Therefore the problem is always PT for ABS or NOR.
(ii) From Remark 2.5, it is sufficient to prove that the problem
[TABLE]
is SPT for ABS iff (2.7) holds, and that the exponent of satisfies (2.8).
Assume that (2.7) holds, i.e.,
[TABLE]
We want to prove that is SPT for ABS. Indeed, by (3.1) we have for any ,
[TABLE]
Next, we shall prove that for any ,
[TABLE]
Indeed, for such , there exists a for which
[TABLE]
Since
[TABLE]
there exists a such that
[TABLE]
which means
[TABLE]
It follows that
[TABLE]
for any . Hence we obtain
[TABLE]
for any \tau\in\big{(}\max\{\frac{1}{\sigma_{1}},\frac{1}{A_{*}}\},1\big{)}. We note that \tau\in\big{(}\max\{\frac{1}{\sigma_{1}},\frac{1}{A_{*}}\},1) is equivalent to
[TABLE]
due to the monotonicity of the function
[TABLE]
It follows from [7, Theorem 6.1] that if (2.7) holds, then is SPT for ABS, and the exponent of SPT satisfies
[TABLE]
On the other hand, assume that is SPT for ABS. Then there exist positive and such that
[TABLE]
where we used
[TABLE]
in the above inequalities. Obviously, by (3) we have
[TABLE]
It follows from (3) that
[TABLE]
where , which yields that
[TABLE]
Letting we get
[TABLE]
which means
[TABLE]
Hence if is SPT for ABS, then we have
[TABLE]
and the exponent of SPT satisfies
[TABLE]
Therefore is SPT for ABS iff
[TABLE]
and the exponent of SPT is
[TABLE]
Theorem 2.1 is proved.
Proof of Theorem 2.2.
From Remark 2.6, we note that if is SPT for ABS, then it is SPT for NOR. If holds, by Theorem 2.1 we get that is SPT for ABS, and hence is SPT for NOR. It suffices to prove that if is SPT for NOR, then
Assume that is SPT for NOR. Then by [7, Theorem 6.2] there exists a such that
[TABLE]
It follows that
[TABLE]
Using (3.1) and for all , we get
[TABLE]
Assume that . Then for the above we have
[TABLE]
By the Stolz theorem we get
[TABLE]
where
[TABLE]
Since
[TABLE]
and
[TABLE]
for any we have
[TABLE]
where as means that . Substituting (3.8) into (3) yields
[TABLE]
contrary to (3).
Hence we have , and thence C_{1}:=\big{(}\sum_{j=1}^{\infty}\beta_{j}^{\tau}\big{)}^{\frac{1}{\tau}}<+\infty. It follows that
[TABLE]
We obtain further
[TABLE]
This gives
[TABLE]
which implies . Hence we conclude that if is SPT for NOR, then
[TABLE]
and the exponent of SPT for NOR satisfies
[TABLE]
Theorem 2.2 is proved.
Proof of Theorem 2.3.
First we assume that SPT holds for NOR. By [7, Theorem 6.2] there exists a such that
[TABLE]
It follows that
[TABLE]
We get for all ,
[TABLE]
where we used
[TABLE]
and in the last inequality. It follows that
[TABLE]
This means
[TABLE]
Letting we get
[TABLE]
Hence if is SPT for NOR, then we have , and the exponent of SPT for NOR satisfies
[TABLE]
On the other hand, we assume
[TABLE]
Then for any we shall prove
[TABLE]
Indeed, we have
[TABLE]
where in the first inequality we used
[TABLE]
and (3.1). It suffices to prove that
[TABLE]
We suppose that for some . Since
[TABLE]
there exists a such that
[TABLE]
It follows that
[TABLE]
Note that
[TABLE]
Hence we get
[TABLE]
It follows from the Hölder inequality that
[TABLE]
Hence for any we have
[TABLE]
which means that SPT holds with the exponent of SPT for NOR satisfying
[TABLE]
Therefore SPT holds for NOR iff
[TABLE]
and the exponent of SPT for NOR is
[TABLE]
The proof of Theorem 2.2 is finished.
Acknowledgments
The authors were supported by the National Natural Science Foundation of China (Project no. 11671271), the Beijing Natural Science Foundation (1172004).
The reference list from the paper itself. Each links out to its DOI / PubMed record.
- 1[1] X. Chen, W. V. Li, Small deviation estimates for some additive processes, Proceedings of the Conference on High Dimensional Probability III, Progress in Probability, 55 (2003) 225-238.
- 2[2] F. J. Hickernell, G. W. Wasilkowski, H. Woźniakowski, Tractability of linear multivariate problems in the average-case setting, in: A. Keller, S. Heinrich, H. Niederreiter (Eds.), Monte Carlo and Quasi-Monte Carlo Methods 2006, Springer, Berlin, 2008, pp. 461-493.
- 3[3] A. A. Khartov, M. Zani, Asymptotic analysis of average case approximation complexity of additive random fields, J. Complexity 52 (2019) 24-44.
- 4[4] A. A. Khartov, M. Zani, Approximation complexity of sums of random processes, J. Complexity, in press.
- 5[5] M. A. Lifshitsa, M. Zani, Approximation complexity of additive random fields, J. Complexity 24 (2008) 362-379.
- 6[6] M. A. Lifshits, M. Zani, Approximation of additive random fields based on standard information: Average case and probabilistic settings, J. Complexity 31 (5) (2015) 659-674.
- 7[7] E. Novak, H. Woźniakowski, Tractability of Multivariate Problems, Volume I: Liner Information, EMS, Zürich, 2008.
- 8[8] E. Novak, H. Woźniakowski, Tractability of Multivariate Problems, Volume II: Standard Information for Functionals, EMS, Zürich, 2010.
