LoPace: A Lossless Optimized Prompt Accurate Compression Engine for Large Language Model Applications

TL;DR

LoPace is a lossless prompt compression engine for LLM applications that combines multiple techniques to achieve high compression ratios, fast speeds, and scalability, making prompt storage more efficient in production environments.

Contribution

LoPace introduces a hybrid compression framework combining Zstandard and BPE tokenization for efficient, lossless prompt compression tailored for large language model applications.

Findings

Average compression ratio of 4.89x

Saves up to 72.2% space on prompts

Supports real-time, scalable deployment

Abstract

Large Language Models (LLMs) have changed the way natural language processing works, but it is still hard to store and manage prompts efficiently in production environments. This paper presents LoPace (Lossless Optimized Prompt Accurate Compression Engine), a novel compression framework designed specifically for prompt storage in LLM applications. LoPace uses three different ways to compress data: Zstandard-based compression, Byte-Pair Encoding (BPE) tokenization with binary packing, and a hybrid method that combines the two. We show that LoPace saves an average of 72.2\% of space while still allowing for 100\% lossless reconstruction by testing it on 386 different prompts, such as code snippets, markdown documentation, and structured content. The hybrid method always works better than each technique on its own. It gets mean compression ratios of 4.89x (range: 1.22--19.09x) and speeds of 3.3--10.7 MB/s. Our findings show that LoPace is ready for production, with a small memory footprint (0.35 MB on average) and great scalability for big databases and real-time LLM apps.