AutoTune: Improving End-to-end Performance and Resource Efficiency for Microservice Applications

TL;DR

AutoTune is an automated tool designed to optimize resource allocation in microservice applications, reducing resource use while ensuring performance, addressing the complexity of manual tuning in large-scale web services.

Contribution

The paper introduces AutoTune, a novel end-to-end system that automatically tunes resource allocations for microservices to improve efficiency and performance.

Findings

AutoTune reduces resource utilization significantly.

Maintains application performance within specified thresholds.

Automates a complex manual tuning process.

Abstract

Most large web-scale applications are now built by composing collections (from a few up to 100s or 1000s) of microservices. Operators need to decide how many resources are allocated to each microservice, and these allocations can have a large impact on application performance. Manually determining allocations that are both cost-efficient and meet performance requirements is challenging, even for experienced operators. In this paper we present AutoTune, an end-to-end tool that automatically minimizes resource utilization while maintaining good application performance.