# A Comprehensive Survey on Parallelization and Elasticity in Stream   Processing

**Authors:** Henriette R\"oger, Ruben Mayer

arXiv: 1901.09716 · 2019-01-30

## TL;DR

This survey reviews and categorizes current methods for parallelization and elasticity in stream processing systems, highlighting the importance of these techniques for managing high-volume, dynamic data streams in IoT applications.

## Contribution

It provides the first comprehensive classification of existing approaches for parallelization and elasticity in stream processing, consolidating research and guiding future work.

## Key findings

- Identifies key categories of parallelization techniques.
- Highlights the importance of elasticity for QoS.
- Provides a structured overview of current methods.

## Abstract

Stream Processing (SP) has evolved as the leading paradigm to process and gain value from the high volume of streaming data produced e.g. in the domain of the Internet of Things. An SP system is a middleware that deploys a network of operators between data sources, such as sensors, and the consuming applications. SP systems typically face intense and highly dynamic data streams. Parallelization and elasticity enables SP systems to process these streams with continuously high quality of service. The current research landscape provides a broad spectrum of methods for parallelization and elasticity in SP. Each method makes specific assumptions and focuses on particular aspects of the problem. However, the literature lacks a comprehensive overview and categorization of the state of the art in SP parallelization and elasticity, which is necessary to consolidate the state of the research and to plan future research directions on this basis. Therefore, in this survey, we study the literature and develop a classification of current methods for both parallelization and elasticity in SP systems.

## Full text

_Full body text omitted from this summary view._ Fetch the complete paper as Markdown: https://tomesphere.com/paper/1901.09716/full.md

## Figures

9 figures with captions in the complete paper: https://tomesphere.com/paper/1901.09716/full.md

## References

159 references — full list in the complete paper: https://tomesphere.com/paper/1901.09716/full.md

---
Source: https://tomesphere.com/paper/1901.09716