TL;DR
The paper introduces the variational Polya tree (VPT), a scalable Bayesian nonparametric density estimation method that improves interpretability and uncertainty quantification in deep learning applications.
Contribution
It presents a novel variational inference approach for Polya trees, enabling efficient posterior computation and better integration with stochastic gradient methods.
Findings
VPT achieves competitive density estimation performance.
It enhances interpretability and uncertainty quantification.
The method scales well to real data and images.
Abstract
Density estimation is essential for generative modeling, particularly with the rise of modern neural networks. While existing methods capture complex data distributions, they often lack interpretability and uncertainty quantification. Bayesian nonparametric methods, especially the \polya tree, offer a robust framework that addresses these issues by accurately capturing function behavior over small intervals. Traditional techniques like Markov chain Monte Carlo (MCMC) face high computational complexity and scalability limitations, hindering the use of Bayesian nonparametric methods in deep learning. To tackle this, we introduce the variational \polya tree (VPT) model, which employs stochastic variational inference to compute posterior distributions. This model provides a flexible, nonparametric Bayesian prior that captures latent densities and works well with stochastic gradient…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
