Maxing Out the SVM: Performance Impact of Memory and Program Cache Sizes in the Agave Validator

TL;DR

This study investigates how memory and cache sizes affect the performance of Solana's Agave validator, revealing critical thresholds and proposing strategies to optimize hardware use and reduce latency.

Contribution

It provides empirical analysis of memory and cache bottlenecks in the validator, offering practical hardware guidance and caching improvements.

Findings

Performance drops below 256 GB RAM

Program cache inefficiencies identified

Latency reduced by 90% with proposed improvements

Abstract

In this paper we analyze some of the bottlenecks in the execution pipeline of Solana's Agave validator client, focusing on RAM and program cache usage under mainnet conditions. Through a series of controlled experiments, we measure the validator's throughput and resource efficiency as RAM availability ranges between 128 GB to 1,536 GB (1.5 TB). We discover that the validator performance degrades significantly below 256 GB, with transaction processing falling behind real-time block production. Additionally, we study the program cache behavior, identifying inefficiencies in program eviction and load latency. Our results provide practical guidance for hardware provisioning and suggest improvements to the Solana execution and caching strategy, reducing latency due to the program cache by 90%.