# Symphony: A Decentralized Multi-Agent Framework for Scalable Collective Intelligence

## TL;DR

Symphony is a decentralized multi-agent framework that enables scalable, privacy-preserving coordination of lightweight LLMs on consumer GPUs, improving reasoning accuracy and robustness over centralized systems.

## Contribution

It introduces a novel decentralized architecture with ledger, beacon protocol, and weighted voting, enhancing scalability and fault tolerance in multi-agent LLM systems.

## Key findings

- Outperforms existing baselines on reasoning benchmarks
- Achieves significant accuracy improvements
- Demonstrates robustness across different model sizes

## Abstract

Most existing Large Language Model (LLM)-based agent frameworks rely on centralized orchestration, incurring high deployment costs, rigid communication topologies, and limited adaptability. To address these challenges, we introduce Symphony, a decentralized multi-agent system which enables lightweight LLMs on consumer-grade GPUs to coordinate. Symphony introduces three key mechanisms: (1) a decentralized ledger that records capabilities, (2) a Beacon-selection protocol for dynamic task allocation, and (3) weighted result voting based on CoTs. This design forms a privacy-saving, scalable, and fault-tolerant orchestration with low overhead. Empirically, Symphony outperforms existing baselines on reasoning benchmarks, achieving substantial accuracy gains and demonstrating robustness across models of varying capacities.