Progressive Temporal Window Widening
David Tolpin

TL;DR
The paper presents Progressive Window Widening, an adaptive algorithm for data stream processing that dynamically adjusts batch intervals to efficiently detect patterns of varying durations without delays or memory issues.
Contribution
It introduces a novel progressive widening algorithm that improves pattern detection in data streams by adaptively adjusting batch sizes, addressing limitations of fixed-interval processing.
Findings
Effective detection of patterns of unknown duration
Reduces delays and memory overflow in stream processing
Applicable to security, monitoring, and user behavior analysis
Abstract
This paper introduces a scheme for data stream processing which is robust to batch duration. Streaming frameworks process streams in batches retrieved at fixed time intervals. In a common setting a pattern recognition algorithm is applied independently to each batch. Choosing the right time interval is tough --- a pattern may not fit in an interval which is too short, but detection will be delayed and memory may be exhausted if the interval is too long. We propose here Progressive Window Widening, an algorithm for increasing the interval gradually so that patterns are caught at any pace without unnecessary delays or memory overflow. This algorithm is relevant to computer security, system monitoring, user behavior tracking, and other applications where patterns of unknown or varying duration must be recognized online in data streams. Modern data stream processing frameworks are…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsData Stream Mining Techniques · Advanced Database Systems and Queries · Time Series Analysis and Forecasting
