PANav: Toward Privacy-Aware Robot Navigation via Vision-Language Models

TL;DR

This paper introduces PANav, a privacy-aware robot navigation framework that uses vision-language models to plan paths minimizing exposure to human activities, enhancing privacy in public environments.

Contribution

It presents a novel integration of vision-language models with A* path planning for privacy-aware navigation in robots, addressing a gap in current social and path planning research.

Findings

Significantly improves privacy awareness in robot navigation.

Successfully applied in real-world office environments.

Demonstrates effectiveness on the S3DIS dataset.

Abstract

Navigating robots discreetly in human work environments while considering the possible privacy implications of robotic tasks presents significant challenges. Such scenarios are increasingly common, for instance, when robots transport sensitive objects that demand high levels of privacy in spaces crowded with human activities. While extensive research has been conducted on robotic path planning and social awareness, current robotic systems still lack the functionality of privacy-aware navigation in public environments. To address this, we propose a new framework for mobile robot navigation that leverages vision-language models to incorporate privacy awareness into adaptive path planning. Specifically, all potential paths from the starting point to the destination are generated using the A* algorithm. Concurrently, the vision-language model is used to infer the optimal path for privacy-awareness, given the environmental layout and the navigational instruction. This approach aims to minimize the robot's exposure to human activities and preserve the privacy of the robot and its surroundings. Experimental results on the S3DIS dataset demonstrate that our framework significantly enhances mobile robots' privacy awareness of navigation in human-shared public environments. Furthermore, we demonstrate the practical applicability of our framework by successfully navigating a robotic platform through real-world office environments. The supplementary video and code can be accessed via the following link: https://sites.google.com/view/privacy-aware-nav.