Mini Honor of Kings: A Lightweight Environment for Multi-Agent Reinforcement Learning

TL;DR

Mini Honor of Kings is a lightweight, customizable, and efficient environment based on the popular game, designed to facilitate multi-agent reinforcement learning research on personal computers.

Contribution

This paper introduces the first publicly available map editor and a lightweight environment for Honor of Kings, enabling accessible and challenging MARL experiments.

Findings

MARL algorithms do not yet find optimal solutions in Mini HoK.

Mini HoK runs efficiently on personal computers.

The environment encourages development of new MARL methods.

Abstract

Games are widely used as research environments for multi-agent reinforcement learning (MARL), but they pose three significant challenges: limited customization, high computational demands, and oversimplification. To address these issues, we introduce the first publicly available map editor for the popular mobile game Honor of Kings and design a lightweight environment, Mini Honor of Kings (Mini HoK), for researchers to conduct experiments. Mini HoK is highly efficient, allowing experiments to be run on personal PCs or laptops while still presenting sufficient challenges for existing MARL algorithms. We have tested our environment on common MARL algorithms and demonstrated that these algorithms have yet to find optimal solutions within this environment. This facilitates the dissemination and advancement of MARL methods within the research community. Additionally, we hope that more researchers will leverage the Honor of Kings map editor to develop innovative and scientifically valuable new maps. Our code and user manual are available at: https://github.com/tencent-ailab/mini-hok.