Scaling to 32 GPUs on a Novel Composable System Architecture

TL;DR

This paper introduces a novel composable system architecture capable of scaling up to 32 GPUs on a single node, providing flexible resource allocation and dynamic hardware management for data center efficiency.

Contribution

It presents a new composable architecture with dynamic resource distribution mechanisms, enabling scalable and flexible GPU allocation within data centers.

Findings

Supports up to 32 GPUs on a single node

Enables dynamic GPU resource reallocation

Improves resource utilization flexibility

Abstract

The development of composable systems architecture marks a significant shift in resource allocation and utilization within data centers. This paper presents a composable architecture scaling up to 32 GPUs on a single node, addressing the technical challenges encountered and the innovative solutions implemented. This design introduces a flexible and dynamic resource distribution mechanism, particularly for GPUs, enabling tailored allocation to meet varying node demands. The architecture's dynamic nature allows for the flexible assignment and reassignment of hardware resources, such as GPUs, to different nodes as required, offering unprecedented capability and flexibility.