The Instability of all Backoff Protocols

TL;DR

This paper proves that no backoff protocol can be stable for all positive arrival rates in a shared communication channel, confirming a long-standing conjecture by Aldous from 1987.

Contribution

We prove Aldous's conjecture that all backoff protocols are unstable for any positive arrival rate in shared resource communication models.

Findings

All backoff protocols are unstable for any positive arrival rate.

Binary exponential backoff is unstable for all positive λ.

The conjecture by Aldous from 1987 is confirmed.

Abstract

In this paper we prove Aldous's conjecture from 1987 that there is no backoff protocol that is stable for any positive arrival rate. The setting is a communication channel for coordinating requests for a shared resource. Each user who wants to access the resource makes a request by sending a message to the channel. The users don't have any way to communicate with each other, except by sending messages to the channel. The operation of the channel proceeds in discrete time steps. If exactly one message is sent to the channel during a time step then this message succeeds (and leaves the system). If multiple messages are sent during a time step then these messages collide. Each of the users that sent these messages therefore waits a random amount of time before re-sending. A backoff protocol is a randomised algorithm for determining how long to wait -- the waiting time is a function of how many collisions a message has had. Specifically, a backoff protocol is described by a send sequence $\overline{p} = (p_0,p_1,p_2,\ldots)$. If a message has had $k$ collisions before a time step then, with probability $p_k$, it sends during that time step, whereas with probability $1-p_k$ it is silent (waiting for later). The most famous backoff protocol is binary exponential backoff, where $p_k = 2^{-k}$. Under Kelly's model, in which the number of new messages that arrive in the system at each time step is given by a Poisson random variable with mean $\lambda$, Aldous proved that binary exponential backoff is unstable for any positive $\lambda$. He conjectured that the same is true for any backoff protocol. We prove this conjecture.