FM-CAC: Carbon-Aware Control for Battery-Buffered Edge AI via Time-Series Foundation Models

TL;DR

FM-CAC is a proactive control framework that uses time-series foundation models and battery buffering to significantly reduce carbon emissions in edge AI deployments while maintaining high QoS.

Contribution

It introduces a novel control framework combining TSFMs and battery management to optimize energy use and reduce carbon footprint in edge AI systems.

Findings

Reduces carbon emissions by up to 65.6%

Maintains near-maximum inference accuracy

Leverages zero-shot carbon forecasting with TSFMs

Abstract

As edge AI deployments scale to billions of devices running always-on, real-time compound AI pipelines, they represent a massive and largely unmanaged source of energy consumption and carbon emissions. To reduce carbon emissions while maximizing Quality-of-Service (QoS), this paper proposes FM-CAC, a proactive carbon-aware control framework that leverages a battery as an active temporal buffer. By decoupling energy acquisition from energy consumption, FM-CAC can maximize the use of low-carbon energy, substantially reducing carbon emissions. At each control step, FM-CAC jointly optimizes the software pipeline variant, the hardware operating point, and the battery charging and discharging actions. To support this decision process, FM-CAC leverages edge-friendly Time-Series Foundation Models (TSFMs) for zero-shot carbon forecasting and integrates these forecasts into a dynamic programming solver with deferred cost attribution to prevent myopic battery depletion. Results show that FM-CAC reduces carbon emissions by up to 65.6% while maintaining near-maximum inference accuracy.