Record Acceleration of the Two-Dimensional Ising Model Using High-Performance Wafer Scale Engine

TL;DR

This paper demonstrates a highly optimized implementation of the 2D Ising model on a Cerebras Wafer-Scale Engine, achieving unprecedented simulation speeds and parallelism, showcasing the WSE's potential for scientific computing.

Contribution

The authors developed a novel, highly efficient implementation of the 2D Ising model on the Cerebras WSE, enabling massive parallelism and significant speed improvements over previous hardware.

Findings

Achieved over 61.8 trillion flip attempts per second.

Handled up to 754 simulations in parallel.

Outperformed NVIDIA V100 and H100 implementations significantly.

Abstract

The versatility and wide-ranging applicability of the Ising model, originally introduced to study phase transitions in magnetic materials, have made it a cornerstone in statistical physics and a valuable tool for evaluating the performance of emerging computer hardware. Here, we present a novel implementation of the two-dimensional Ising model on a Cerebras Wafer-Scale Engine (WSE), a revolutionary processor that is opening new frontiers in computing. In our deployment of the checkerboard algorithm, we optimized the Ising model to take advantage of the unique WSE architecture. Specifically, we employed a compressed bit representation storing 16 spins on each int16 word, and efficiently distributed the spins over the processing units enabling seamless weak scaling and limiting communications to only immediate neighboring units. Our implementation can handle up to 754 simulations in parallel, achieving an aggregate of over 61.8 trillion flip attempts per second for Ising models with up to 200 million spins. This represents a gain of up to 148 times over previously reported single-device with a highly optimized implementation on NVIDIA V100 and up to 88 times in productivity compared to NVIDIA H100. Our findings highlight the significant potential of the WSE in scientific computing, particularly in the field of materials modeling.