Asymptotically Optimal Belief Space Planning in Discrete Partially-Observable Domains

TL;DR

This paper introduces an improved path tree optimization (PTO) method for belief space planning in discrete partially observable domains, enhancing contingency computation with a camera-based state sampler and supporting non-euclidean spaces, demonstrated through realistic scenarios.

Contribution

The paper presents PTO with a novel camera-based state sampler and support for non-euclidean spaces, advancing belief space planning efficiency and success rates.

Findings

Camera-based sampler improves success in 3 out of 4 scenarios.

PTO reduces memory footprint compared to baseline methods.

Supports non-euclidean state spaces in belief planning.

Abstract

Robots often have to operate in discrete partially observable worlds, where the states of world are only observable at runtime. To react to different world states, robots need contingencies. However, computing contingencies is costly and often non-optimal. To address this problem, we develop the improved path tree optimization (PTO) method. PTO computes motion contingencies by constructing a tree of motion paths in belief space. This is achieved by constructing a graph of configurations, then adding observation edges to extend the graph to belief space. Afterwards, we use a dynamic programming step to extract the path tree. PTO extends prior work by adding a camera-based state sampler to improve the search for observation points. We also add support to non-euclidean state spaces, provide an implementation in the open motion planning library (OMPL), and evaluate PTO on four realistic scenarios with a virtual camera in up to 10-dimensional state spaces. We compare PTO with a default and with the new camera-based state sampler. The results indicate that the camera-based state sampler improves success rates in 3 out of 4 scenarios while having a significant lower memory footprint. This makes PTO an important contribution to advance the state-of-the-art for discrete belief space planning.