Deep generative models in inversion: a review and development of a new approach based on a variational autoencoder

TL;DR

This paper reviews the use of deep generative models in geophysical inversion, identifies challenges due to nonlinearity, and proposes a variational autoencoder-based approach to improve inversion feasibility and accuracy.

Contribution

It introduces a new method using variational autoencoders to balance pattern accuracy and inversion feasibility in geophysical problems.

Findings

Tradeoff between pattern accuracy and inversion feasibility identified.

Training parameters of VAE can be tuned for better inversion results.

Test case demonstrates improved inversion with the proposed approach.

Abstract

When solving inverse problems in geophysical imaging, deep generative models (DGMs) may be used to enforce the solution to display highly structured spatial patterns which are supported by independent information (e.g. the geological setting) of the subsurface. In such case, inversion may be formulated in a latent space where a low-dimensional parameterization of the patterns is defined and where Markov chain Monte Carlo or gradient-based methods may be applied. However, the generative mapping between the latent and the original (pixel) representations is usually highly nonlinear which may cause some difficulties for inversion, especially for gradient-based methods. In this contribution we review the conceptual framework of inversion with DGMs and study the principal causes of the nonlinearity of the generative mapping. As a result, we identify a conflict between two goals: the accuracy of the generated patterns and the feasibility of gradient-based inversion. In addition, we show how some of the training parameters of a variational autoencoder, which is a particular instance of a DGM, may be chosen so that a tradeoff between these two goals is achieved and acceptable inversion results are obtained with a stochastic gradient-descent scheme. A test case using truth models with channel patterns of different complexity and cross-borehole traveltime tomographic data involving both a linear and a nonlinear forward operator is used to assess the performance of the proposed approach.