HyperLoad: A Cross-Modality Enhanced Large Language Model-Based Framework for Green Data Center Cooling Load Prediction

TL;DR

HyperLoad leverages pre-trained large language models and cross-modality techniques to improve green data center cooling load prediction, especially in data-scarce scenarios, enhancing sustainability and operational efficiency.

Contribution

The paper introduces HyperLoad, a novel framework that uses cross-modality knowledge alignment and adaptive prefix-tuning with LLMs for accurate load forecasting in green data centers.

Findings

Outperforms state-of-the-art baselines in both data-rich and data-scarce settings.

Effectively addresses cold start and data fragmentation issues.

Provides a new benchmark dataset for green data center load prediction.

Abstract

The rapid growth of artificial intelligence is exponentially escalating computational demand, inflating data center energy use and carbon emissions, and spurring rapid deployment of green data centers to relieve resource and environmental stress. Achieving sub-minute orchestration of renewables, storage, and loads, while minimizing PUE and lifecycle carbon intensity, hinges on accurate load forecasting. However, existing methods struggle to address small-sample scenarios caused by cold start, load distortion, multi-source data fragmentation, and distribution shifts in green data centers. We introduce HyperLoad, a cross-modality framework that exploits pre-trained large language models (LLMs) to overcome data scarcity. In the Cross-Modality Knowledge Alignment phase, textual priors and time-series data are mapped to a common latent space, maximizing the utility of prior knowledge. In the Multi-Scale Feature Modeling phase, domain-aligned priors are injected through adaptive prefix-tuning, enabling rapid scenario adaptation, while an Enhanced Global Interaction Attention mechanism captures cross-device temporal dependencies. The public DCData dataset is released for benchmarking. Under both data sufficient and data scarce settings, HyperLoad consistently surpasses state-of-the-art (SOTA) baselines, demonstrating its practicality for sustainable green data center management.