Cora: Accelerating Stateful Network Applications with SmartNICs
Shaoke Xi, Jiaqi Gao, Mengqi Liu, Jiamin Cao, Fuliang Li, Kai Bu, Kui, Ren, Minlan Yu, Dennis Cai, Ennan Zhai

TL;DR
Cora is a compiler and runtime system that offloads stateful network applications to SmartNICs, significantly reducing CPU usage and accelerating network functions by intelligently partitioning workloads based on traffic dynamics.
Contribution
Cora introduces an accurate performance model and adaptive compiler algorithm for offloading stateful applications to SmartNICs, improving efficiency and resource utilization.
Findings
Cora reduces CPU core usage by up to 94%.
Cora accelerates network functions by 44.9%-82.3%.
Cora adapts to traffic changes to maintain low CPU usage.
Abstract
With the growing performance requirements on networked applications, there is a new trend of offloading stateful network applications to SmartNICs to improve performance and reduce the total cost of ownership. However, offloading stateful network applications is non-trivial due to state operation complexity, state resource consumption, and the complicated relationship between traffic and state. Naively partitioning the program by state or traffic can result in a suboptimal partition plan with higher CPU usage or even packet drops. In this paper, we propose Cora, a compiler and runtime that offloads stateful network applications to SmartNIC-accelerated hosts. Cora compiler introduces an accurate performance model for each SmartNIC and employs an efficient compiling algorithm to search the offloading plan. Cora runtime can monitor traffic dynamics and adapt to minimize CPU usage. Cora is…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsSmart Grid Security and Resilience · Software System Performance and Reliability · Software-Defined Networks and 5G
