Crafting desirable climate trajectories with RL explored socio-environmental simulations
James Rudd-Jones, Fiona Thendean, Mar\'ia P\'erez-Ortiz

TL;DR
This paper explores the use of multi-agent reinforcement learning in socio-environmental simulations to model complex stakeholder interactions and identify pathways toward desirable climate futures, highlighting the importance of cooperation versus competition.
Contribution
It introduces a multi-agent RL framework to simulate socio-environmental interactions in climate policy modeling, extending traditional IAM approaches with a focus on agent cooperation and competition.
Findings
Cooperative agents can find pathways to reduce emissions and improve economy.
Competitive agents often fail to reach desirable climate outcomes.
Visualisation of states reveals causes of uncertainty and algorithm failure.
Abstract
Climate change poses an existential threat, necessitating effective climate policies to enact impactful change. Decisions in this domain are incredibly complex, involving conflicting entities and evidence. In the last decades, policymakers increasingly use simulations and computational methods to guide some of their decisions. Integrated Assessment Models (IAMs) are one of such methods, which combine social, economic, and environmental simulations to forecast potential policy effects. For example, the UN uses outputs of IAMs for their recent Intergovernmental Panel on Climate Change (IPCC) reports. Traditionally these have been solved using recursive equation solvers, but have several shortcomings, e.g. struggling at decision making under uncertainty. Recent preliminary work using Reinforcement Learning (RL) to replace the traditional solvers shows promising results in decision making…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
Topicsdemographic modeling and climate adaptation
