DPC: Training-Free Text-to-SQL Candidate Selection via Dual-Paradigm Consistency

TL;DR

DPC introduces a training-free, multi-agent framework that improves Text-to-SQL candidate selection by verifying logical consistency through a deterministic, adversarial micro-environment, outperforming existing methods.

Contribution

It proposes a novel dual-paradigm consistency approach with collaborative agents to enhance SQL candidate verification without training.

Findings

DPC outperforms existing selection baselines by up to 2.2% accuracy.

The method effectively exposes logical discrepancies using a minimal distinguishing database.

Experiments on BIRD and Spider datasets validate the robustness of DPC across multiple LLMs.

Abstract

While Large Language Models (LLMs) demonstrate impressive proficiency in generating SQL queries, they fundamentally lack the capability to self-evaluate correctness without an execution oracle. This limitation creates a stark Generation-Selection Gap, where high potential accuracy (Pass@K) fails to translate into execution accuracy (Pass@1). Although supervised verifiers offer mitigation, they incur prohibitive annotation costs and suffer from domain fragility. Consequently, recent research has pivoted to the training-free setting. However, existing methods--such as Self-Consistency or LLM-as-a-Judge--remain hampered by systematic bias (consensus on hallucinations) and symbolic blindness (inability to simulate execution states). We introduce DPC (Dual-Paradigm Consistency), a multi-agent framework that reformulates SQL selection from a probabilistic guessing task on hidden data into a deterministic verification task on visible data. Specifically, DPC employs a SLICER and a TESTER agent to collaboratively construct a Minimal Distinguishing Database (MDD)--an adversarial, fully observable micro-environment engineered to expose logical discrepancies between candidates. To break the self-correction bias, a SOLVER agent then verifies the SQL candidates by cross-referencing their execution against a parallel Python/Pandas solution. By validating execution consistency between declarative (SQL) and imperative (Python) paradigms, DPC robustly discriminates correct logic from systematic hallucinations. Experiments on BIRD and Spider across multiple LLMs demonstrate that our method consistently outperforms existing selection baselines, achieving absolute accuracy improvements of up to 2.2% over strong competitors like Self-Consistency.