Microservice Deployment in Space Computing Power Networks via Robust Reinforcement Learning

TL;DR

This paper proposes a robust reinforcement learning-based framework for deploying microservices on space computing networks, optimizing real-time remote sensing inference with minimal resource use despite data uncertainties.

Contribution

It introduces a novel deployment framework using microservice architecture combined with robust reinforcement learning for space-based remote sensing applications.

Findings

Effective microservice deployment reduces resource consumption.

Robust optimization handles data uncertainty in space computing.

Simulation confirms improved inference performance and resource efficiency.

Abstract

With the growing demand for Earth observation, it is important to provide reliable real-time remote sensing inference services to meet the low-latency requirements. The Space Computing Power Network (Space-CPN) offers a promising solution by providing onboard computing and extensive coverage capabilities for real-time inference. This paper presents a remote sensing artificial intelligence applications deployment framework designed for Low Earth Orbit satellite constellations to achieve real-time inference performance. The framework employs the microservice architecture, decomposing monolithic inference tasks into reusable, independent modules to address high latency and resource heterogeneity. This distributed approach enables optimized microservice deployment, minimizing resource utilization while meeting quality of service and functional requirements. We introduce Robust Optimization to the deployment problem to address data uncertainty. Additionally, we model the Robust Optimization problem as a Partially Observable Markov Decision Process and propose a robust reinforcement learning algorithm to handle the semi-infinite Quality of Service constraints. Our approach yields sub-optimal solutions that minimize accuracy loss while maintaining acceptable computational costs. Simulation results demonstrate the effectiveness of our framework.