Quantum Combinatorial Reasoning for Large Language Models

TL;DR

This paper introduces a quantum combinatorial reasoning framework for large language models that leverages quantum computing to improve reasoning accuracy and efficiency, demonstrating experimental benefits on benchmark tasks.

Contribution

It presents the first experimental quantum-assisted reasoning framework for large language models, integrating quantum optimization into reasoning processes.

Findings

QCR-LLM improves reasoning accuracy by up to 9 percentage points.

The framework is approximately five times more energy-efficient than traditional systems.

Experimental results show quantum-assisted reasoning enhances coherence, interpretability, and sustainability.

Abstract

We design and implement a quantum combinatorial reasoning framework for large language models (QCR-LLM), integrating a real quantum computer in the hybrid workflow. QCR-LLM reformulates reasoning aggregation as a higher-order unconstrained binary optimization (HUBO) problem. In this sense, reasoning fragments are represented as binary variables and their interactions encode statistical relevance, logical coherence, and semantic redundancy. We tackle the resulting high-order optimization problem both classically, via simulated annealing, and quantumly through the bias-field digitized counterdiabatic quantum optimizer (BF-DCQO) executed on IBM's superconducting digital quantum processors. Experiments on BIG-Bench Extra Hard (BBEH) benchmarks demonstrate that our QCR-LLM consistently improves reasoning accuracy across multiple LLM backbones, surpassing reasoning-native systems such as o3-high and DeepSeek R1 by up to $+9\,$pp. Despite requiring multiple reasoning samples per query, our QCR-LLM remains approximately five times more energy-efficient than o3-high, owing to the low per-token energy footprint of its GPT-4o backbone. These results constitute the first experimental evidence of quantum-assisted reasoning, showing that hybrid quantum-classical optimization can efficiently enhance reasoning coherence, interpretability, and sustainability in large-scale language models. We have opened the doors to the emergence of quantum intelligence, where harder prompts require quantum optimizers at quantum-advantage level.