Industrial Application of 6D Pose Estimation for Robotic Manipulation in Automotive Internal Logistics

TL;DR

This paper evaluates a 6D pose estimation pipeline for automotive parts in industrial robotics, highlighting current limitations in industry requirements and analyzing the impact of data generation methods and sensor modalities.

Contribution

It presents a comprehensive evaluation of a 6D pose estimation pipeline using synthetic data and compares RGB and RGB-D approaches, revealing key challenges in industry deployment.

Findings

Performance promising but not meeting industry standards

Estimators lack reliable uncertainty estimates

RGB and RGB-D approaches have different domain gap vulnerabilities

Abstract

Despite the advances in robotics a large proportion of the of parts handling tasks in the automotive industry's internal logistics are not automated but still performed by humans. A key component to competitively automate these processes is a 6D pose estimation that can handle a large number of different parts, is adaptable to new parts with little manual effort, and is sufficiently accurate and robust with respect to industry requirements. In this context, the question arises as to the current status quo with respect to these measures. To address this we built a representative 6D pose estimation pipeline with state-of-the-art components from economically scalable real to synthetic data generation to pose estimators and evaluated it on automotive parts with regards to a realistic sequencing process. We found that using the data generation approaches, the performance of the trained 6D pose estimators are promising, but do not meet industry requirements. We reveal that the reason for this is the inability of the estimators to provide reliable uncertainties for their poses, rather than the ability of to provide sufficiently accurate poses. In this context we further analyzed how RGB- and RGB-D-based approaches compare against this background and show that they are differently vulnerable to the domain gap induced by synthetic data.