Distributed Shared Layered Storage Quantum Simulator: A novel quantum simulation system for efficient scaling and cost optimization

TL;DR

This paper introduces DSLSQS, a distributed layered storage quantum simulator that significantly improves scalability and reduces costs, enabling efficient simulation of complex quantum algorithms on multiple nodes.

Contribution

The paper presents a novel distributed architecture with shared data storage and layered technology, overcoming bottlenecks and lowering costs in quantum simulation clusters.

Findings

Over 350% performance improvement compared to existing systems

Successful implementation of layered storage in a 27-qubit simulation

Identification of distributed networking as the main performance bottleneck

Abstract

Quantum simulators are essential tools for developing and testing quantum algorithms. However, the high-frequency traversal characteristic of quantum simulators represents an unprecedented demand in the history of IT, and existing distributed technologies is unable to meet this requirement, resulting in a single-node bottleneck of quantum simulator. To overcome this limitation, this paper introduces a novel Distributed Shared Layered Storage Quantum Simulator (DSLSQS). By leveraging an innovative distributed architecture in which multiple computational nodes share data storage directly, together with De-TCP/IP networking technology, DSLSQS effectively eliminates East-West data flow in distributed systems. This approach mitigates the bottleneck of distributed quantum simulation clusters and enhances the scalability. Moreover, the system employs layered storage technology, which reduces usage of expensive high-performance memory and substantially lowers simulation costs. Furthermore, this paper systematically analyzes the performance and cost constraints of distributed quantum simulator cluster, identifying distributed networking as the primary performance bottleneck and highlighting that minimizing storage costs is crucial to reducing the total cost. Finally, experimental evaluations with a 27-qubit simulation confirm the successful implementation of layered storage within the quantum simulator. DSLSQS significantly enhances simulation efficiency, yielding a performance improvement of over 350% compared to existing distributed technologies. These results underscore the superior performance and scalability of the proposed architecture in managing complex quantum computing tasks. This paper provides crucial insights for the practical deployment of quantum computing and presents an effective framework for the development of distributed quantum simulation clusters.