Joint Inference of Trajectory and Obstacle in Mean-Field Games via Bilevel Optimization
Han Huang, Jiajia Yu, Tianyi Chen, Rongjie Lai

TL;DR
This paper introduces a novel bilevel optimization approach using normalizing flows to jointly infer agent trajectories and hidden obstacles in mean field games, demonstrating robustness and high fidelity in obstacle recovery.
Contribution
It formulates the inverse MFG problem as a bilevel optimization using normalizing flows, enabling joint inference of trajectories and obstacles with improved generalization.
Findings
Effective in various MFG scenarios including complex obstacles
Recovers hidden obstacles with high accuracy in low-data settings
Enhances trajectory learning by regularizing with MFG assumptions
Abstract
Mean field game (MFG) is an expressive modeling framework for systems with a continuum of interacting agents. While many approaches exist for solving the forward MFG, few have studied its \textit{inverse} problem. In this work, we seek to recover optimal agent trajectories and the unseen spatial obstacle given partial observation on the former. To this end, we use a special type of generative models, normalizing flow, to represent the trajectories and propose a novel formulation of inverse MFG as a bilevel optimization (BLO) problem. We demonstrate the effectiveness of our approach across various MFG scenarios, including those involving multi-modal and disjoint obstacles, highlighting its robustness with respect to obstacle complexity and dimensionality. Alternatively, our formulation can be interpreted as regularizing maximum likelihood trajectory learning with MFG assumptions, which…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsReinforcement Learning in Robotics · Model Reduction and Neural Networks · Robot Manipulation and Learning
