Heterogeneous Explore-Exploit Strategies on Multi-Star Networks
Udari Madhushani, Naomi Leonard

TL;DR
This paper explores how heterogeneity in explore-exploit strategies among agents in multi-star networks can enhance group performance, providing theoretical analysis and simulations to validate the benefits over homogeneous strategies.
Contribution
The paper introduces and analyzes novel heterogeneous explore-exploit strategies tailored for multi-star networks, demonstrating improved group rewards over homogeneous approaches.
Findings
Heterogeneous strategies outperform homogeneous ones in irregular networks.
Center agents exploring more benefits peripheral agents' data collection.
Theoretical guarantees confirm performance improvements.
Abstract
We investigate the benefits of heterogeneity in multi-agent explore-exploit decision making where the goal of the agents is to maximize cumulative group reward. To do so we study a class of distributed stochastic bandit problems in which agents communicate over a multi-star network and make sequential choices among options in the same uncertain environment. Typically, in multi-agent bandit problems, agents use homogeneous decision-making strategies. However, group performance can be improved by incorporating heterogeneity into the choices agents make, especially when the network graph is irregular, i.e. when agents have different numbers of neighbors. We design and analyze new heterogeneous explore-exploit strategies, using the multi-star as the model irregular network graph. The key idea is to enable center agents to do more exploring than they would do using the homogeneous strategy,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
