NetRPC: Enabling In-Network Computation in Remote Procedure Calls

TL;DR

NetRPC introduces a user-friendly RPC system that enables in-network computation, significantly improving performance for distributed applications with minimal programming effort.

Contribution

It presents a general INC-enabled RPC framework with familiar interfaces and optimization techniques, simplifying in-network computation for developers.

Findings

Achieves similar performance to state-of-the-art INC solutions

Requires only about 5% of human-written code

Demonstrates effectiveness on real testbed across various applications

Abstract

People have shown that in-network computation (INC) significantly boosts performance in many application scenarios include distributed training, MapReduce, agreement, and network monitoring. However, existing INC programming is unfriendly to the normal application developers, demanding tedious network engineering details like flow control, packet organization, chip-specific programming language, and ASIC architecture with many limitations. We propose a general INC-enabled RPC system, NetRPC. NetRPC provides a set of familiar and lightweight interfaces for software developers to describe an INC application using a traditional RPC programming model. NetRPC also proposes a general-purpose INC implementation together with a set of optimization techniques to guarantee the efficiency of various types of INC applications running on a shared INC data plane. We conduct extensive experiments on different types of applications on the real testbed. Results show that using only about 5% or even fewer human-written lines of code, NetRPC can achieve performance similar to the state-of-the-art INC solutions.