Pushing the Limits of LLMs in Quantum Operations

TL;DR

This study benchmarks popular AI Large Language Models to determine which is fastest at generating quantum gate designs, revealing Google Gemini as the leading platform and demonstrating the potential for AI to accelerate quantum computing development.

Contribution

First benchmarking comparison of multiple AI LLMs for quantum operation generation, assessing speed and success rate in quantum gate synthesis.

Findings

Gemini is the fastest AI LLM for quantum gate design.

AI LLMs achieved 80% success in generating working quantum operations.

Publicly available LLMs can effectively assist in quantum gate synthesis.

Abstract

What is the fastest Artificial Intelligence Large Language Model (AI LLM) for generating quantum operations? To answer this, we present the first benchmarking study comparing popular and publicly available AI models tasked with creating quantum gate designs. The Wolfram Mathematica framework was used to interface with the 4 AI LLMs, including WolframLLM, OpenAI ChatGPT, Google Gemini, and DeepSeek. This comparison evaluates both the time taken by each AI LLM platform to generate quantum operations (including networking times), as well as the execution time of these operations in Python, within Jupyter Notebook. Our results show that overall, Gemini is the fastest AI LLM in producing quantum gate designs. At the same time, the AI LLMs tested achieved working quantum operations 80% of the time. These findings highlight a promising horizon where publicly available Large Language Models can become fast collaborators with quantum computers, enabling rapid quantum gate synthesis and paving the way for greater interoperability between two remarkable and cutting-edge technologies.