A Distributed Multi Agents Based Platform for High Performance Computing Infrastructures

TL;DR

This paper presents a modular, web-based platform for managing and monitoring machine learning experiments on grid-based high-performance computing infrastructures, facilitating experiment development and analysis.

Contribution

It introduces a novel layered platform integrating grid communication, administration, and web interfaces, specifically supporting machine learning experiments in game playing.

Findings

Successful demonstration with two different game experiments

Facilitates development of web-based interfaces for distributed computing

Enhances management and monitoring of machine learning experiments

Abstract

This work introduces a novel, modular, layered web based platform for managing machine learning experiments on grid-based High Performance Computing infrastructures. The coupling of the communication services offered by the grid, with an administration layer and conventional web server programming, via a data synchronization utility, leads to the straightforward development of a web-based user interface that allows the monitoring and managing of diverse online distributed computing applications. It also introduces an experiment generation and monitoring tool particularly suitable for investigating machine learning in game playing. The platform is demonstrated with experiments for two different games.