TL;DR
This paper demonstrates that the default Linux scheduler significantly increases serverless function costs and proposes a hybrid scheduling approach tailored to FaaS workloads to reduce expenses effectively.
Contribution
It introduces a novel hybrid scheduling method that improves cost efficiency for serverless functions by customizing OS scheduling based on function duration.
Findings
Default Linux CFS increases serverless costs by up to 10X.
Hybrid scheduling reduces user-facing costs without provider overhead.
Tailored OS scheduling improves efficiency for short-lived serverless functions.
Abstract
In Function-as-a-Service (FaaS) serverless, large applications are split into short-lived stateless functions. Deploying functions is mutually profitable: users need not be concerned with resource management, while providers can keep their servers at high utilization rates running thousands of functions concurrently on a single machine. It is exactly this high concurrency that comes at a cost. The standard Linux Completely Fair Scheduler (CFS) switches often between tasks, which leads to prolonged execution times. We present evidence that relying on the default Linux CFS scheduler increases serverless workloads cost by up to 10X. In this article, we raise awareness and make a case for rethinking the OS-level scheduling in Linux for serverless workloads composed of many short-lived processes. To make serverless more affordable we introduce a hybrid two-level scheduling approach that…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
