Taking snapshots from a stream

TL;DR

This paper introduces a probabilistic snapshot method for data streams that enables memory-efficient storage of historical information, applicable to web servers, networks, and video streams.

Contribution

It presents a novel probabilistic snapshot technique with controllable properties for streaming data, suitable for various real-time applications.

Findings

Allows controlled probabilistic snapshots of data streams

Enables memory-limited storage of historical data

Applicable to web, network, and video streaming scenarios

Abstract

This work is devoted to a certain class of probabilistic snapshots for elements of the observed data stream. We show you how one can control their probabilistic properties and we show some potential applications. Our solution can be used to store information from the observed history with limited memory. It can be used for both web server applications and Ad hoc networks and, for example, for automatic taking snapshots from video stream online of unknown size.