Well-posed Bayesian Inverse Problems with Infinitely-Divisible and Heavy-Tailed Prior Measures

TL;DR

This paper introduces a new class of heavy-tailed, infinitely divisible prior measures based on generalized Gamma distributions for Bayesian inverse problems, ensuring well-posedness and offering alternatives to traditional priors.

Contribution

It develops a framework linking tail behavior of prior measures with well-posedness, introducing new prior classes using Lévy processes and analyzing their application in inverse problems.

Findings

Prior measures are heavy-tailed, non-convex, and infinitely divisible.

Well-posedness depends on the balance between likelihood growth and prior tail behavior.

Concrete examples demonstrate the applicability of heavy-tailed and Lévy process priors.

Abstract

We present a new class of prior measures in connection to $\ell_p$ regularization techniques when $p \in(0,1)$ which is based on the generalized Gamma distribution. We show that the resulting prior measure is heavy-tailed, non-convex and infinitely divisible. Motivated by this observation we discuss the class of infinitely divisible prior measures and draw a connection between their tail behavior and the tail behavior of their L{\'evy} measures. Next, we use the laws of pure jump L{\'e}vy processes in order to define new classes of prior measures that are concentrated on the space of functions with bounded variation. These priors serve as an alternative to the classic total variation prior and result in well-defined inverse problems. We then study the well-posedness of Bayesian inverse problems in a general enough setting that encompasses the above mentioned classes of prior measures. We establish that well-posedness relies on a balance between the growth of the log-likelihood function and the tail behavior of the prior and apply our results to special cases such as additive noise models and linear problems. Finally, we discuss some of the practical aspects of Bayesian inverse problems such as their consistent approximation and present three concrete examples of well-posed Bayesian inverse problems with heavy-tailed or stochastic process prior measures.