Safe Control using Learned Safety Filters and Adaptive Conformal Inference

TL;DR

This paper introduces ACoFi, an adaptive safety filtering method that combines learned reachability safety filters with conformal inference to provide soft safety guarantees and improve safety performance in control systems.

Contribution

The paper proposes ACoFi, a novel adaptive safety filter that dynamically adjusts based on observed errors, offering probabilistic safety guarantees in high-dimensional control systems.

Findings

ACoFi outperforms fixed-threshold methods in safety and safety violations.

It provides asymptotic upper bounds on safety quantification errors.

Demonstrated effectiveness in Dubins car and Safety Gymnasium environments.

Abstract

Safety filters have been shown to be effective tools to ensure the safety of control systems with unsafe nominal policies. To address scalability challenges in traditional synthesis methods, learning-based approaches have been proposed for designing safety filters for systems with high-dimensional state and control spaces. However, the inevitable errors in the decisions of these models raise concerns about their reliability and the safety guarantees they offer. This paper presents Adaptive Conformal Filtering (ACoFi), a method that combines learned Hamilton-Jacobi reachability-based safety filters with adaptive conformal inference. Under ACoFi, the filter dynamically adjusts its switching criteria based on the observed errors in its predictions of the safety of actions. The range of possible safety values of the nominal policy's output is used to quantify uncertainty in safety assessment. The filter switches from the nominal policy to the learned safe one when that range suggests it might be unsafe. We show that ACoFi guarantees that the rate of incorrectly quantifying uncertainty in the predicted safety of the nominal policy is asymptotically upper bounded by a user-defined parameter. This gives a soft safety guarantee rather than a hard safety guarantee. We evaluate ACoFi in a Dubins car simulation and a Safety Gymnasium environment, empirically demonstrating that it significantly outperforms the baseline method that uses a fixed switching threshold by achieving higher learned safety values and fewer safety violations, especially in out-of-distribution scenarios.