UVTomo-GAN: An adversarial learning based approach for unknown view X-ray tomographic reconstruction

TL;DR

This paper introduces UVTomo-GAN, an adversarial learning framework that simultaneously reconstructs images and estimates unknown projection angles and their distribution in X-ray tomography, without prior angle knowledge.

Contribution

It presents a novel adversarial approach that recovers both the image and the unknown projection distribution using distribution matching and Gumbel-softmax approximation.

Findings

Successfully recovers images and projection distributions in simulations

Handles unknown projection angles and distributions effectively

Generalizable to other inverse problems

Abstract

Tomographic reconstruction recovers an unknown image given its projections from different angles. State-of-the-art methods addressing this problem assume the angles associated with the projections are known a-priori. Given this knowledge, the reconstruction process is straightforward as it can be formulated as a convex problem. Here, we tackle a more challenging setting: 1) the projection angles are unknown, 2) they are drawn from an unknown probability distribution. In this set-up our goal is to recover the image and the projection angle distribution using an unsupervised adversarial learning approach. For this purpose, we formulate the problem as a distribution matching between the real projection lines and the generated ones from the estimated image and projection distribution. This is then solved by reaching the equilibrium in a min-max game between a generator and a discriminator. Our novel contribution is to recover the unknown projection distribution and the image simultaneously using adversarial learning. To accommodate this, we use Gumbel-softmax approximation of samples from categorical distribution to approximate the generator's loss as a function of the unknown image and the projection distribution. Our approach can be generalized to different inverse problems. Our simulation results reveal the ability of our method in successfully recovering the image and the projection distribution in various settings.