LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimation

TL;DR

LaPose introduces a probabilistic shape modeling framework using Laplacian mixtures to improve RGB-based category-level object pose estimation, effectively handling shape uncertainty and scale ambiguity, and achieving state-of-the-art results.

Contribution

The paper proposes LaPose, a novel Laplacian mixture model for shape representation that enhances RGB-only pose estimation by explicitly modeling shape uncertainty and scale ambiguity.

Findings

Achieves state-of-the-art performance on NOCS datasets.

Effectively models shape uncertainty with Laplacian mixtures.

Robustly estimates pose without depth data.

Abstract

While RGBD-based methods for category-level object pose estimation hold promise, their reliance on depth data limits their applicability in diverse scenarios. In response, recent efforts have turned to RGB-based methods; however, they face significant challenges stemming from the absence of depth information. On one hand, the lack of depth exacerbates the difficulty in handling intra-class shape variation, resulting in increased uncertainty in shape predictions. On the other hand, RGB-only inputs introduce inherent scale ambiguity, rendering the estimation of object size and translation an ill-posed problem. To tackle these challenges, we propose LaPose, a novel framework that models the object shape as the Laplacian mixture model for Pose estimation. By representing each point as a probabilistic distribution, we explicitly quantify the shape uncertainty. LaPose leverages both a generalized 3D information stream and a specialized feature stream to independently predict the Laplacian distribution for each point, capturing different aspects of object geometry. These two distributions are then integrated as a Laplacian mixture model to establish the 2D-3D correspondences, which are utilized to solve the pose via the PnP module. In order to mitigate scale ambiguity, we introduce a scale-agnostic representation for object size and translation, enhancing training efficiency and overall robustness. Extensive experiments on the NOCS datasets validate the effectiveness of LaPose, yielding state-of-the-art performance in RGB-based category-level object pose estimation. Codes are released at https://github.com/lolrudy/LaPose