Data-Scarce Identification of Game Dynamics via Sum-of-Squares Optimization
Iosif Sakos, Antonios Varvitsiotis, Georgios Piliouras

TL;DR
This paper introduces SIAR, a novel framework using sum-of-squares optimization to identify game dynamics from limited data, incorporating side-information to improve accuracy in complex multiplayer games.
Contribution
The paper presents SIAR, a new method that leverages side-information and SOS optimization to recover game dynamics from minimal observational data.
Findings
Accurately predicts player behavior in various normal-form games.
Effective even with chaotic or limited data scenarios.
Provably converges to true system dynamics.
Abstract
Understanding how players adjust their strategies in games, based on their experience, is a crucial tool for policymakers. It enables them to forecast the system's eventual behavior, exert control over the system, and evaluate counterfactual scenarios. The task becomes increasingly difficult when only a limited number of observations are available or difficult to acquire. In this work, we introduce the Side-Information Assisted Regression (SIAR) framework, designed to identify game dynamics in multiplayer normal-form games only using data from a short run of a single system trajectory. To enhance system recovery in the face of scarce data, we integrate side-information constraints into SIAR, which restrict the set of feasible solutions to those satisfying game-theoretic properties and common assumptions about strategic interactions. SIAR is solved using sum-of-squares (SOS)…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsReinforcement Learning in Robotics
