Shattering the Ephemeral Storage Cost Barrier for Data-Intensive Serverless Workflows

TL;DR

Zipline is a novel data transfer method for serverless workflows that enables direct function-to-function communication, significantly reducing costs and improving performance for data-intensive applications.

Contribution

We introduce Zipline, a new API-preserving data transfer technique that enables direct memory-to-memory communication in serverless platforms, overcoming existing data transfer inefficiencies.

Findings

Zipline reduces data transfer costs by 2-5x compared to S3.

Zipline achieves 17-772x cost savings over ElastiCache.

Zipline improves execution latency by 1.3-3.4x versus S3.

Abstract

Serverless computing is a popular cloud deployment paradigm where developers implement applications as workflows of functions that invoke each other. Cloud providers automatically scale function instances on demand and forward workflow requests to appropriate instances. However, current serverless clouds lack efficient cross-function data transfer, limiting the execution of data-intensive applications. Functions often rely on third-party services like AWS S3, AWS ElastiCache, or multi-tier solutions for intermediate data transfers, which introduces inefficiencies. We demonstrate that such through-storage transfers make data-intensive deployments economically impractical, with storage costs comprising more than 24-99% of the total serverless bill. To address this, we introduce Zipline, a fast, API-preserving data communication method for serverless platforms. Zipline enables direct function-to-function transfers, where the sender function buffers payloads in memory and sends a reference to the receiver. The receiver retrieves the data directly from the sender's memory, guided by the load balancer and autoscaler. Zipline integrates seamlessly with existing autoscaling, maintains invocation semantics, and eliminates the costs and overheads of intermediate services. We prototype Zipline in vHive/Knative on AWS EC2 nodes, demonstrating significant improvements. Zipline reduces costs and enhances latency and bandwidth compared to AWS S3 (the lowest-cost solution) and ElastiCache (the highest-performance solution). On real-world applications, Zipline lowers costs by 2-5x and reduces execution times by 1.3-3.4x versus S3. Compared to ElastiCache, Zipline achieves 17-772x cost reductions while improving performance by 2-5%.