Optimized Arithmetic Coding for Efficient Data Compression in the Resource-Constrained Internet of Things(IoT)

TL;DR

This paper introduces an optimized arithmetic coding algorithm tailored for resource-limited IoT devices, significantly improving compression speed and efficiency while maintaining data integrity for real-time data transmission.

Contribution

It presents a novel optimized arithmetic coding method incorporating iterative, PCA, and cardinality reduction techniques specifically designed for IoT environments.

Findings

Achieved a compression ratio of 814:1 on image data.

Reduced compression time to 101 ms per image.

Lowered CPU and memory usage during compression.

Abstract

The Internet of Things (IoT) generates vast amounts of heterogeneous data, ranging from sensor readings to log alerts and images, that pose challenges to storage and data transmission in resource-constrained environments. In this context, lossless data compression techniques, like Arithmetic Coding, offer an effective solution owing to their high compression ratio. However, the standard Arithmetic Coding technique is computationally intensive, leading to high memory and processing overhead. This paper proposes an optimized version of Arithmetic coding for the IoT environment that incorporates three improvements using Iterative and Iteration Optimizations for minimizing redundant computations and achieving faster convergence; Principal Component Analysis(PCA) for dimensionality reduction and identifying key features; and lastly, Cardinality reduction for grouping similar probabilities to improve the compression efficiency. The proposed method was evaluated on a dataset of images and demonstrated significant reductions in the time to compress, CPU utilization, and memory consumption, and preserves data integrity as seen through the low RMSE values. The optimized version of the Arithmetic Coding algorithm achieves an impressive compression ratio of 814:1 and 101 ms to compress a single image. This makes the optimized algorithm suitable for real-time applications and resource-constrained environments for efficient data transmission and storage.