On the error rate of importance sampling with randomized quasi-Monte Carlo

TL;DR

This paper analyzes the convergence rates of randomized quasi-Monte Carlo methods combined with importance sampling for Gaussian and t-distribution integrals, providing conditions for improved accuracy and highlighting potential pitfalls.

Contribution

It establishes sufficient conditions under which randomized QMC with importance sampling achieves near-optimal convergence rates for Gaussian and t-distribution proposals.

Findings

Randomized QMC with Gaussian proposals can achieve $O(N^{-1+\\epsilon})$ error under certain conditions.

Laplace importance sampling may produce less favorable integrands for QMC due to eigenvalue issues.

Using t-distribution proposals with QMC is more robust than Gaussian proposals.

Abstract

Importance sampling (IS) is valuable in reducing the variance of Monte Carlo sampling for many areas, including finance, rare event simulation, and Bayesian inference. It is natural and obvious to combine quasi-Monte Carlo (QMC) methods with IS to achieve a faster rate of convergence. However, a naive replacement of Monte Carlo with QMC may not work well. This paper investigates the convergence rates of randomized QMC-based IS for estimating integrals with respect to a Gaussian measure, in which the IS measure is a Gaussian or $t$ distribution. We prove that if the target function satisfies the so-called boundary growth condition and the covariance matrix of the IS density has eigenvalues no smaller than 1, then randomized QMC with the Gaussian proposal has a root mean squared error of $O(N^{-1+\epsilon})$ for arbitrarily small $\epsilon>0$. Similar results of $t$ distribution as the proposal are also established. These sufficient conditions help to assess the effectiveness of IS in QMC. For some particular applications, we find that the Laplace IS, a very general approach to approximate the target function by a quadratic Taylor approximation around its mode, has eigenvalues smaller than 1, making the resulting integrand less favorable for QMC. From this point of view, when using Gaussian distributions as the IS proposal, a change of measure via Laplace IS may transform a favorable integrand into unfavorable one for QMC although the variance of Monte Carlo sampling is reduced. We also give some examples to verify our propositions and warn against naive replacement of MC with QMC under IS proposals. Numerical results suggest that using Laplace IS with $t$ distributions is more robust than that with Gaussian distributions.