ClutterNav: Gradient-Guided Search for Efficient 3D Clutter Removal with Learned Costmaps

TL;DR

ClutterNav is a reinforcement learning framework that efficiently removes dense clutter to access target objects by dynamically estimating removal costs and prioritizing actions, achieving near-human performance in simulation and real-world tests.

Contribution

It introduces a novel RL-based decision-making method with learned costmaps and integrated gradients for clutter removal, surpassing rule-based and traditional RL approaches.

Findings

Real-time, occlusion-aware decision-making demonstrated in simulation and real-world experiments.

Near human-like strategic sequencing achieved without predefined heuristics.

Effective in complex, partially observable cluttered environments.

Abstract

Dense clutter removal for target object retrieval presents a challenging problem, especially when targets are embedded deep within densely-packed configurations. It requires foresight to minimize overall changes to the clutter configuration while accessing target objects, avoiding stack destabilization and reducing the number of object removals required. Rule-based planners when applied to this problem, rely on rigid heuristics, leading to high computational overhead. End-to-end reinforcement learning approaches struggle with interpretability and generalizability over different conditions. To address these issues, we present ClutterNav, a novel decision-making framework that can identify the next best object to be removed so as to access a target object in a given clutter, while minimising stack disturbances. ClutterNav formulates the problem as a continuous reinforcement learning task, where each object removal dynamically updates the understanding of the scene. A removability critic, trained from demonstrations, estimates the cost of removing any given object based on geometric and spatial features. This learned cost is complemented by integrated gradients that assess how the presence or removal of surrounding objects influences the accessibility of the target. By dynamically prioritizing actions that balance immediate removability against long-term target exposure, ClutterNav achieves near human-like strategic sequencing, without predefined heuristics. The proposed approach is validated extensively in simulation and over real-world experiments. The results demonstrate real-time, occlusion-aware decision-making in partially observable environments.