NL2LOGIC: AST-Guided Translation of Natural Language into First-Order Logic with Large Language Models

TL;DR

NL2LOGIC is a novel framework that uses an abstract syntax tree to improve the translation of natural language into first-order logic with large language models, achieving high syntactic accuracy and better semantic faithfulness.

Contribution

It introduces an AST-guided translation approach combining semantic parsing and deterministic code generation, significantly enhancing logic translation accuracy and interpretability.

Findings

Achieves 99% syntactic accuracy on benchmarks.

Improves semantic correctness by up to 30%.

Enhances downstream reasoning accuracy by 31%.

Abstract

Automated reasoning is critical in domains such as law and governance, where verifying claims against facts in documents requires both accuracy and interpretability. Recent work adopts structured reasoning pipelines that translate natural language into first-order logic and delegate inference to automated solvers. With the rise of large language models, approaches such as GCD and CODE4LOGIC leverage their reasoning and code generation capabilities to improve logic parsing. However, these methods suffer from fragile syntax control due to weak enforcement of global grammar constraints and low semantic faithfulness caused by insufficient clause-level semantic understanding. We propose NL2LOGIC, a first-order logic translation framework that introduces an abstract syntax tree as an intermediate representation. NL2LOGIC combines a recursive large language model based semantic parser with an abstract syntax tree guided generator that deterministically produces solver-ready logic code. Experiments on the FOLIO, LogicNLI, and ProofWriter benchmarks show that NL2LOGIC achieves 99 percent syntactic accuracy and improves semantic correctness by up to 30 percent over state-of-the-art baselines. Furthermore, integrating NL2LOGIC into Logic-LM yields near-perfect executability and improves downstream reasoning accuracy by 31 percent compared to Logic-LM's original few-shot unconstrained translation module.