SLURM Heterogeneous Jobs for Hybrid Classical-Quantum Workflows

TL;DR

This paper introduces a scheduling method for hybrid classical-quantum workflows on supercomputers, aiming to reduce idle quantum time and overall workflow duration with minimal user intervention.

Contribution

It presents a practical scheduling approach leveraging standard supercomputer tools, enabling efficient hybrid workflow execution with simple implementation.

Findings

Significantly reduces quantum resource idle time

Decreases overall workflow wall time

Provides pseudo-code and scripts for implementation

Abstract

A method for efficient scheduling of hybrid classical-quantum workflows is presented, based on standard tools available on common supercomputer systems. Moderate interventions by the user are required, such as splitting a monolithic workflow in to basic building blocks and ensuring the data flow. This bares the potential to significantly reduce idle time of the quantum resource as well as overall wall time of co-scheduled workflows. Relevant pseudo-code samples and scripts are provided to demonstrate the simplicity and working principles of the method.