ABCI 3.0: Evolution of the leading AI infrastructure in Japan

TL;DR

ABCI 3.0 is a major upgrade to Japan's leading AI infrastructure, significantly enhancing computational power and storage to support advanced AI research, especially in generative AI.

Contribution

This paper introduces ABCI 3.0, the latest version with substantial hardware improvements, marking a significant advancement in AI infrastructure in Japan.

Findings

Peak performance of 6.22 exaflops in half precision

More than doubled storage capacity and read/write performance

Enhanced support for generative AI research

Abstract

ABCI 3.0 is the latest version of the ABCI, a large-scale open AI infrastructure that AIST has been operating since August 2018 and will be fully operational in January 2025. ABCI 3.0 consists of computing servers equipped with 6128 of the NVIDIA H200 GPUs and an all-flash storage system. Its peak performance is 6.22 exaflops in half precision and 3.0 exaflops in single precision, which is 7 to 13 times faster than the previous system, ABCI 2.0. It also more than doubles both storage capacity and theoretical read/write performance. ABCI 3.0 is expected to accelerate research and development, evaluation, and workforce development of cutting-edge AI technologies, with a particular focus on generative AI.