Gameplay Filters: Robust Zero-Shot Safety through Adversarial Imagination
Duy P. Nguyen, Kai-Chieh Hsu, Wenhao Yu, Jie Tan, Jaime F., Fisac

TL;DR
The paper introduces the gameplay filter, a novel predictive safety mechanism that uses adversarial simulation to enhance robustness and safety of complex robot control policies in unpredictable real-world conditions.
Contribution
It presents the first full-order safety filter for high-dimensional quadrupedal robots that employs adversarial imagination to improve zero-shot robustness.
Findings
Demonstrates superior safety performance under large perturbations.
Successfully applies to 36-D quadrupedal dynamics.
Shows effectiveness in real-world experiments on different platforms.
Abstract
Despite the impressive recent advances in learning-based robot control, ensuring robustness to out-of-distribution conditions remains an open challenge. Safety filters can, in principle, keep arbitrary control policies from incurring catastrophic failures by overriding unsafe actions, but existing solutions for complex (e.g., legged) robot dynamics do not span the full motion envelope and instead rely on local, reduced-order models. These filters tend to overly restrict agility and can still fail when perturbed away from nominal conditions. This paper presents the gameplay filter, a new class of predictive safety filter that continually plays out hypothetical matches between its simulation-trained safety strategy and a virtual adversary co-trained to invoke worst-case events and sim-to-real error, and precludes actions that would cause failures down the line. We demonstrate the…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Malware Detection Techniques · Adversarial Robustness in Machine Learning
