Hamiltonian ABC
Edward Meeds, Robert Leenders, and Max Welling

TL;DR
Hamiltonian ABC (HABC) introduces likelihood-free algorithms leveraging Hamiltonian Monte Carlo and stochastic gradients to improve sampling efficiency in high-dimensional simulation-based models.
Contribution
The paper presents HABC, a novel approach combining HMC and stochastic gradients for scalable likelihood-free inference in ABC.
Findings
HABC effectively approximates ABC gradients with few simulations.
HABC samples comparably to true gradient Bayesian inference in high-dimensional problems.
Incorporating random seeds reduces HABC's random walk behavior.
Abstract
Approximate Bayesian computation (ABC) is a powerful and elegant framework for performing inference in simulation-based models. However, due to the difficulty in scaling likelihood estimates, ABC remains useful for relatively low-dimensional problems. We introduce Hamiltonian ABC (HABC), a set of likelihood-free algorithms that apply recent advances in scaling Bayesian learning using Hamiltonian Monte Carlo (HMC) and stochastic gradients. We find that a small number forward simulations can effectively approximate the ABC gradient, allowing Hamiltonian dynamics to efficiently traverse parameter spaces. We also describe a new simple yet general approach of incorporating random seeds into the state of the Markov chain, further reducing the random walk behavior of HABC. We demonstrate HABC on several typical ABC problems, and show that HABC samples comparably to regular Bayesian inference…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMarkov Chains and Monte Carlo Methods · Bayesian Methods and Mixture Models · Machine Learning and Algorithms
