DeXOR: Enabling XOR in Decimal Space for Streaming Lossless Compression of Floating-point Data
Chuanyi Lv, Huan Li, Dingyu Yang, Zhongle Xie, Lu Chen, Christian S. Jensen

TL;DR
DeXOR is a novel compression framework that efficiently encodes streaming floating-point data in decimal space, achieving higher compression ratios and faster decompression while maintaining robustness under extreme conditions.
Contribution
DeXOR introduces decimal XOR procedures and error-tolerant strategies for effective lossless compression of floating-point streams, outperforming existing methods.
Findings
15% higher compression ratio than state-of-the-art schemes
20% faster decompression speed
Robust performance under extreme conditions
Abstract
With streaming floating-point numbers being increasingly prevalent, effective and efficient compression of such data is critical. Compression schemes must be able to exploit the similarity, or smoothness, of consecutive numbers and must be able to contend with extreme conditions, such as high-precision values or the absence of smoothness. We present DeXOR, a novel framework that enables decimal XOR procedure to encode decimal-space longest common prefixes and suffixes, achieving optimal prefix reuse and effective redundancy elimination. To ensure accurate and low-cost decompression even with binary-decimal conversion errors, DeXOR incorporates 1) scaled truncation with error-tolerant rounding and 2) different bit management strategies optimized for decimal XOR. Additionally, a robust exception handler enhances stability by managing floating-point exponents, maintaining high compression…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsNumerical Methods and Algorithms · Advanced Data Storage Technologies · Algorithms and Data Compression
