Anisotropic multidimensional smoothing using Bayesian tensor product P-splines

TL;DR

This paper presents a scalable Bayesian method for anisotropic multidimensional smoothing using tensor product P-splines, overcoming computational challenges in high dimensions with closed-form expressions for pseudo-determinants.

Contribution

The authors derive closed-form expressions for the log-pseudo-determinant in arbitrary dimensions, enabling efficient Bayesian MCMC sampling for high-dimensional tensor product smooths.

Findings

Outperforms existing methods in accuracy and scalability

Efficiently handles high-dimensional smoothing problems

Demonstrated on a spatio-temporal temperature data example

Abstract

We introduce a highly efficient fully Bayesian approach for anisotropic multidimensional smoothing. The main challenge in this context is the Markov chain Monte Carlo update of the smoothing parameters as their full conditional posterior comprises a pseudo-determinant that appears to be intractable at first sight. As a consequence, most existing implementations are computationally feasible only for the estimation of two-dimensional tensor product smooths, which is, however, too restrictive for many applications. In this paper, we break this barrier and derive closed-form expressions for the log-pseudo-determinant and its first and second order partial derivatives. These expressions are valid for arbitrary dimension and very efficient to evaluate, which allows us to set up an efficient MCMC sampler with adaptive Metropolis-Hastings updates for the smoothing parameters. We investigate different priors for the smoothing parameters and discuss the efficient derivation of lower-dimensional effects such as one-dimensional main effects and two-dimensional interactions. We show that the suggested approach outperforms previous suggestions in the literature in terms of accuracy, scalability and computational cost and demonstrate its applicability by consideration of an illustrating temperature data example from spatio-temporal statistics.