SolAgent: A Specialized Multi-Agent Framework for Solidity Code Generation

TL;DR

SolAgent is a multi-agent framework that improves Solidity smart contract code generation by combining code correctness and security checks, outperforming existing models and reducing vulnerabilities.

Contribution

We introduce SolAgent, a novel multi-agent system with dual-loop refinement for secure, correct Solidity code generation, leveraging compiler and static analysis tools.

Findings

Achieves up to 64.39% Pass@1 rate on SolEval+ Benchmark

Reduces security vulnerabilities by up to 39.77% compared to human-written code

Outperforms state-of-the-art LLMs and AI IDEs in smart contract generation

Abstract

Smart contracts are the backbone of the decentralized web, yet ensuring their functional correctness and security remains a critical challenge. While Large Language Models (LLMs) have shown promise in code generation, they often struggle with the rigorous requirements of smart contracts, frequently producing code that is buggy or vulnerable. To address this, we propose SolAgent, a novel tool-augmented multi-agent framework that mimics the workflow of human experts. SolAgent integrates a \textbf{dual-loop refinement mechanism}: an inner loop using the \textit{Forge} compiler to ensure functional correctness, and an outer loop leveraging the \textit{Slither} static analyzer to eliminate security vulnerabilities. Additionally, the agent is equipped with file system capabilities to resolve complex project dependencies. Experiments on the SolEval+ Benchmark, a rigorous suite derived from high-quality real-world projects, demonstrate that SolAgent achieves a Pass@1 rate of up to \textbf{64.39\%}, significantly outperforming state-of-the-art LLMs ($\sim$25\%), AI IDEs (e.g., GitHub Copilot), and existing agent frameworks. Moreover, it reduces security vulnerabilities by up to \textbf{39.77\%} compared to human-written baselines. Finally, we demonstrate that the high-quality trajectories generated by SolAgent can be used to distill smaller, open-source models, democratizing access to secure smart contract generation. We release our data and code at https://github.com/openpaperz/SolAgent.