Bayesian tit-for-tat fosters cooperation in evolutionary stochastic games

TL;DR

This paper demonstrates that Bayesian tit-for-tat strategies can promote cooperation and sustain resource-rich states in stochastic games, showing resilience against reactive strategies under certain environmental transition rules.

Contribution

It introduces a Bayesian tit-for-tat approach in stochastic games and analyzes its resilience and effectiveness in fostering cooperation under different environmental transition rules.

Findings

Bayesian strategies resist invasion by reactive strategies in stochastic games.

Bayesian tit-for-tat promotes cooperation and sustains resource-rich states.

Effectiveness depends on transition rules and strategy composition.

Abstract

Learning from experience is a key feature of decision-making in cognitively complex organisms. Strategic interactions involving Bayesian inferential strategies can enable us to better understand how evolving individual choices to be altruistic or selfish can affect collective outcomes in social dilemmas. Bayesian strategies are distinguished, from their reactive opponents, in their ability to modulate their actions in the light of new evidence. We investigate whether such strategies can be resilient against reactive strategies when actions not only determine the immediate payoff but can affect future payoffs by changing the state of the environment. We use stochastic games to mimic the change in environment in a manner that is conditioned on the players' actions. By considering three distinct rules governing transitions between a resource-rich and a resource-poor states, we ascertain the conditions under which Bayesian tit-for-tat strategy can resist being invaded by reactive strategies. We find that the Bayesian strategy is resilient against a large class of reactive strategies and is more effective in fostering cooperation leading to sustenance of the resource-rich state. However, the extent of success of the Bayesian strategies depends on the other strategies in the pool and the rule governing transition between the two different resource states.