A Non-asymptotic Analysis for Learning and Applying a Preconditioner in MCMC

TL;DR

This paper provides a non-asymptotic analysis of learning and applying preconditioners in MCMC algorithms, demonstrating efficiency improvements and theoretical guarantees for preconditioned Langevin methods.

Contribution

It introduces non-asymptotic bounds for preconditioned MCMC schemes that learn their preconditioners, bridging modern theory with classical heuristics.

Findings

Preconditioned ULA with learned preconditioner has non-asymptotic guarantees.

Learning preconditioners reduces finite-time computational costs.

Results extend to underdamped Langevin algorithms with contraction conditions.

Abstract

Preconditioning is a common method applied to modify Markov chain Monte Carlo algorithms with the goal of making them more efficient. In practice it is often extremely effective, even when the preconditioner is learned from the chain. We analyse and compare the finite-time computational costs of schemes which learn a preconditioner based on the target covariance or the expected Hessian of the target potential with that of a corresponding scheme that does not use preconditioning. We apply our results to the Unadjusted Langevin Algorithm (ULA) for an appropriately regular target, establishing non-asymptotic guarantees for preconditioned ULA which learns its preconditioner. Our results are also applied to the unadjusted underdamped Langevin algorithm in the supplementary material. To do so, we establish non-asymptotic guarantees on the time taken to collect $N$ approximately independent samples from the target for schemes that learn their preconditioners under the assumption that the underlying Markov chain satisfies a contraction condition in the Wasserstein-2 distance. This approximate independence condition, that we formalize, allows us to bridge the non-asymptotic bounds of modern MCMC theory and classical heuristics of effective sample size and mixing time, and is needed to amortise the costs of learning a preconditioner across the many samples it will be used to produce.