ALIGN: Aligned Delegation with Performance Guarantees for Multi-Agent LLM Reasoning

TL;DR

ALIGN introduces a multi-agent reasoning framework with formal guarantees, improving LLM performance on complex tasks by structured delegation and selection, outperforming existing methods.

Contribution

The paper proposes ALIGN, a novel multi-agent delegation approach with theoretical performance guarantees for LLM reasoning tasks.

Findings

ALIGN outperforms single-agent baselines on reasoning benchmarks.

Theoretical analysis shows guaranteed performance improvements.

Empirical results validate effectiveness across diverse tasks.

Abstract

LLMs often underperform on complex reasoning tasks when relying on a single generation-and-selection pipeline. Inference-time ensemble methods can improve performance by sampling diverse reasoning paths or aggregating multiple candidate answers, but they typically treat candidates independently and provide no formal guarantees that ensembling improves reasoning quality. We propose a novel method, Aligned Delegation for Multi-Agent LLM Reasoning (ALIGN), which formulates LLM reasoning as an aligned delegation game. In ALIGN, a principal delegates a task to multiple agents that generate candidate solutions under designed incentives, and then selects among their outputs to produce a final answer. This formulation induces structured interaction among agents while preserving alignment between agent and principal objectives. We establish theoretical guarantees showing that, under a fair comparison with equal access to candidate solutions, ALIGN provably improves expected performance over single-agent generation. Our analysis accommodates correlated candidate answers and relaxes independence assumptions that are commonly used in prior work. Empirical results across a broad range of LLM reasoning benchmarks consistently demonstrate that ALIGN outperforms strong single-agent and ensemble baselines.