Cauchy-Schwarz Regularized Autoencoder
Linh Tran, Maja Pantic, Marc Peter Deisenroth

TL;DR
This paper introduces a novel autoencoder framework with a Cauchy-Schwarz divergence-based objective, enabling the use of Gaussian mixture priors for improved density estimation, clustering, and semi-supervised learning.
Contribution
It develops an analytical solution for GMM priors in autoencoders using a Cauchy-Schwarz divergence, enhancing the model's ability to represent complex data distributions.
Findings
Improved density estimation over standard VAEs.
Enhanced clustering and semi-supervised learning performance.
Better face analysis results with richer priors.
Abstract
Recent work in unsupervised learning has focused on efficient inference and learning in latent variables models. Training these models by maximizing the evidence (marginal likelihood) is typically intractable. Thus, a common approximation is to maximize the Evidence Lower BOund (ELBO) instead. Variational autoencoders (VAE) are a powerful and widely-used class of generative models that optimize the ELBO efficiently for large datasets. However, the VAE's default Gaussian choice for the prior imposes a strong constraint on its ability to represent the true posterior, thereby degrading overall performance. A Gaussian mixture model (GMM) would be a richer prior, but cannot be handled efficiently within the VAE framework because of the intractability of the Kullback-Leibler divergence for GMMs. We deviate from the common VAE framework in favor of one with an analytical solution for Gaussian…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsGenerative Adversarial Networks and Image Synthesis · Face recognition and analysis · Bayesian Methods and Mixture Models
MethodsUSD Coin Customer Service Number +1-833-534-1729
