Edge Intelligence for Satellite-based Earth Observation: Scheduling Image Acquisition and Processing

TL;DR

This paper presents an energy-aware, task-agnostic framework for real-time semantic processing in satellite constellations, optimizing observation and processing schedules to improve target detection while reducing power use.

Contribution

It introduces a novel coupled optimization approach for observation and processing scheduling in satellite edge computing, applicable to various inference tasks.

Findings

Turbulence-aware scheduling improves image quality for vessel detection.

Edge processing reduces power consumption compared to downlink-only methods.

The framework enhances responsiveness and autonomy of EO satellite systems.

Abstract

Modern Earth Observation (EO) missions generate massive volumes of imagery that challenge existing downlink and ground-processing capabilities, particularly for time-critical applications. This work investigates how a low Earth orbit (LEO) satellite constellation equipped with heterogeneous edge computing resources can enable real-time semantic processing of data acquired by EO satellites. We introduce an energy-aware framework that optimizes the use of resources accounting for data acquisition, computing, and communication constraints. Although we focus on maritime surveillance, the formulation is task-agnostic and accommodates a broad class of semantic and goal-oriented inference problems. Specifically, we formulate two coupled optimization problems: (i) observation scheduling, which selects image acquisition opportunities while accounting for turbulence-induced image degradation and energy budget, and (ii) processing scheduling, which allocates semantic workloads across onboard and ground processors. We evaluate these mechanisms for the task of detection and localization of vessels, for which we quantify the benefits of turbulence-aware observation scheduling for preserving image quality and experimentally characterize the execution-time distribution of YOLOv8 on different computing platforms. Results demonstrate that task- and turbulence-aware observation scheduling can significantly improve the quality and quantity of observed targets. Furthermore, cooperative edge processing within the constellation substantially reduces power consumption compared to traditional downlink-centric architectures. These findings highlight the potential of distributed edge intelligence to enhance the responsiveness and autonomy of future satellite-based EO systems.