Robots that Suggest Safe Alternatives
Hyun Joe Jeong, Rosy Chen, Andrea Bajcsy

TL;DR
This paper introduces SALT, a framework that enables robots to assess when they can safely execute user-specified goals and to suggest safe alternatives when they cannot, enhancing safety and reliability in goal-conditioned policies.
Contribution
The paper proposes a novel safety filtering approach in goal space using reachability analysis, allowing robots to suggest safe goal alternatives based on a pre-computed safety model.
Findings
SALT accurately predicts successful and failed executions.
It provides less pessimistic safety monitoring than open-loop uncertainty.
The framework's suggested alternatives align well with human preferences.
Abstract
Goal-conditioned policies, such as those learned via imitation learning, provide an easy way for humans to influence what tasks robots accomplish. However, these robot policies are not guaranteed to execute safely or to succeed when faced with out-of-distribution requests. In this work, we enable robots to know when they can confidently execute a user's desired goal, and automatically suggest safe alternatives when they cannot. Our approach is inspired by control-theoretic safety filtering, wherein a safety filter minimally adjusts a robot's candidate action to be safe. Our key idea is to pose alternative suggestion as a safe control problem in goal space, rather than in action space. Offline, we use reachability analysis to compute a goal-parameterized reach-avoid value network which quantifies the safety and liveness of the robot's pre-trained policy. Online, our robot uses the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsEthics and Social Impacts of AI
