Aspiration Learning in Coordination Games
Georgios C. Chasparis, Ari Arapostathis, Jeff S. Shamma

TL;DR
This paper analyzes aspiration learning dynamics in coordination games, showing how players converge to efficient and fair outcomes, with explicit characterization of long-term behavior and practical implications for network formation and resource sharing.
Contribution
It provides a novel analysis of aspiration learning in coordination games, including explicit characterization of asymptotic behavior and demonstration of convergence to efficient and fair outcomes.
Findings
Aspiration learning leads to high frequency of efficient actions in coordination games.
The asymptotic behavior of the learning process is characterized by an equivalent finite-state Markov chain.
Aspiration learning establishes fair outcomes in symmetric coordination games, including common-pool games.
Abstract
We consider the problem of distributed convergence to efficient outcomes in coordination games through dynamics based on aspiration learning. Under aspiration learning, a player continues to play an action as long as the rewards received exceed a specified aspiration level. Here, the aspiration level is a fading memory average of past rewards, and these levels also are subject to occasional random perturbations. A player becomes dissatisfied whenever a received reward is less than the aspiration level, in which case the player experiments with a probability proportional to the degree of dissatisfaction. Our first contribution is the characterization of the asymptotic behavior of the induced Markov chain of the iterated process in terms of an equivalent finite-state Markov chain. We then characterize explicitly the behavior of the proposed aspiration learning in a generalized version of…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
