Chiron: Optimizing Fault Tolerance in QoS-aware Distributed Stream Processing Jobs

TL;DR

Chiron is an automated approach that optimizes checkpoint frequency in QoS-aware streaming jobs to balance fault tolerance, performance, and availability, demonstrated through integration with Apache Flink.

Contribution

It introduces a method for automatically tuning checkpoint intervals in streaming jobs based on profiling, improving fault tolerance without manual configuration.

Findings

Effective checkpoint optimization improves system performance.

Chiron maintains QoS constraints while reducing recovery overhead.

Experimental results validate Chiron's benefits in real-world scenarios.

Abstract

Fault tolerance is a property which needs deeper consideration when dealing with streaming jobs requiring high levels of availability and low-latency processing even in case of failures where Quality-of-Service constraints must be adhered to. Typically, systems achieve fault tolerance and the ability to recover automatically from partial failures by implementing Checkpoint and Rollback Recovery. However, this is an expensive operation which impacts negatively on the overall performance of the system and manually optimizing fault tolerance for specific jobs is a difficult and time consuming task. In this paper we introduce Chiron, an approach for automatically optimizing the frequency with which checkpoints are performed in streaming jobs. For any chosen job, parallel profiling runs are performed, each containing a variant of the configurations, with the resulting metrics used to model the impact of checkpoint-based fault tolerance on performance and availability. Understanding these relationships is key to minimizing performance objectives and meeting strict Quality-of-Service constraints. We implemented Chiron prototypically together with Apache Flink and demonstrate its usefulness experimentally.