Vectorized Online POMDP Planning
Marcus Hoerger, Muhammad Sudrajat, Hanna Kurniawati

TL;DR
VOPP is a highly parallelized online POMDP solver that significantly improves efficiency by vectorizing planning computations, enabling near-optimal solutions with much less planning time.
Contribution
The paper introduces VOPP, a novel tensor-based, fully vectorized online POMDP planner that eliminates synchronization bottlenecks and greatly enhances parallel computation efficiency.
Findings
VOPP is at least 20 times faster than existing parallel solvers.
VOPP outperforms state-of-the-art sequential solvers with 1000 times less planning budget.
VOPP achieves near-optimal solutions with high computational efficiency.
Abstract
Planning under partial observability is an essential capability of autonomous robots. The Partially Observable Markov Decision Process (POMDP) provides a powerful framework for planning under partial observability problems, capturing the stochastic effects of actions and the limited information available through noisy observations. POMDP solving could benefit tremendously from massive parallelization on today's hardware, but parallelizing POMDP solvers has been challenging. Most solvers rely on interleaving numerical optimization over actions with the estimation of their values, which creates dependencies and synchronization bottlenecks between parallel processes that can offset the benefits of parallelization. In this paper, we propose Vectorized Online POMDP Planner (VOPP), a novel parallel online solver that leverages a recent POMDP formulation which analytically solves part of the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsReinforcement Learning in Robotics · Robotic Path Planning Algorithms · Autonomous Vehicle Technology and Safety
