Fast and Scalable Channels in Kotlin Coroutines

TL;DR

This paper introduces a new fast and scalable algorithm for implementing rendezvous and buffered channels in Kotlin Coroutines, significantly improving performance and integrating seamlessly into the existing library.

Contribution

The paper presents a novel algorithm for channels that enhances speed and scalability, supporting full semantics and integrating into Kotlin Coroutines.

Findings

Up to 9.8x performance speedup compared to existing implementations.

Successful integration into Kotlin Coroutines library.

Demonstrated scalability and expressiveness of the new algorithm.

Abstract

Asynchronous programming has gained significant popularity over the last decade: support for this programming pattern is available in many popular languages via libraries and native language implementations, typically in the form of coroutines or the async/await construct. Instead of programming via shared memory, this concept assumes implicit synchronization through message passing. The key data structure enabling such communication is the rendezvous channel. Roughly, a rendezvous channel is a blocking queue of size zero, so both send(e) and receive() operations wait for each other, performing a rendezvous when they meet. To optimize the message passing pattern, channels are usually equipped with a fixed-size buffer, so send(e)-s do not suspend and put elements into the buffer until its capacity is exceeded. This primitive is known as a buffered channel. This paper presents a fast and scalable algorithm for both rendezvous and buffered channels. Similarly to modern queues, our solution is based on an infinite array with two positional counters for send(e) and receive() operations, leveraging the unconditional Fetch-And-Add instruction to update them. Yet, the algorithm requires non-trivial modifications of this classic pattern, in order to support the full channel semantics, such as buffering and cancellation of waiting requests. We compare the performance of our solution to that of the Kotlin implementation, as well as against other academic proposals, showing up to 9.8x speedup. To showcase its expressiveness and performance, we also integrated the proposed algorithm into the standard Kotlin Coroutines library, replacing the previous channel implementations.