From Barrier to Bridge: The Case for AI Data Center/Power Grid Co-Design

TL;DR

This paper advocates for integrated co-design of AI data centers and power grids due to their entangled demands, proposing new principles, operational strategies, and research directions for sustainable AI infrastructure.

Contribution

It highlights the need for explicit co-development between data centers and power grids, introducing design principles and research directions for their integrated management.

Findings

AI training data centers challenge traditional load assumptions.

Coordinated design can improve sustainability and reliability.

Identifies key research areas for joint capacity planning and control.

Abstract

For over a century, the electric grid has relied on a single statistical assumption: \emph{load diversity}, the principle that the uncorrelated demands of millions of small consumers produce a smooth, predictable aggregate. AI training data centers break that assumption. A single hyperscale training campus can draw power comparable to a mid-sized city, driven by one tightly synchronized job whose demand swings by hundreds of megawatts in seconds. This paper argues that the resulting entanglement of compute and power infrastructure requires a shift from implicit coexistence to explicit co-development between the historically decoupled data center and electric power industries. We introduce the distinct design principles, operational philosophies, and economic incentives of each sector, and show why their cultural and technical misalignment makes coordination difficult. We identify key research directions, from joint capacity planning, multi-timescale control, a compute--power protocol stack, to market innovation, that must be pursued to power the future of AI sustainably and reliably.