An Online Learning Approach to Shortest Path and Backpressure Routing in Wireless Networks

TL;DR

This paper introduces an online learning algorithm for adaptive routing in wireless networks with unknown link states, achieving near-optimal throughput and low path costs through rigorous analysis and extensive simulations.

Contribution

The paper presents a novel online learning algorithm for shortest path and backpressure routing that learns link states and optimizes network performance without prior knowledge.

Findings

Achieves logarithmic regret over time compared to an ideal with full knowledge.

Demonstrates high efficiency through extensive simulations.

Provides rigorous theoretical analysis of the algorithm's performance.

Abstract

We consider the adaptive routing problem in multihop wireless networks. The link states are assumed to be random variables drawn from unknown distributions, independent and identically distributed across links and time. This model has attracted a growing interest recently in cognitive radio networks and adaptive communication systems. In such networks, devices are cognitive in the sense of learning the link states and updating the transmission parameters to allow efficient resource utilization. This model contrasts sharply with the vast literature on routing algorithms that assumed complete knowledge about the link state means. The goal is to design an algorithm that learns online optimal paths for data transmissions to maximize the network throughput while attaining low path cost over flows in the network. We develop a novel Online Learning for Shortest path and Backpressure (OLSB) algorithm to achieve this goal. We analyze the performance of OLSB rigorously and show that it achieves a logarithmic regret with time, defined as the loss of an algorithm as compared to a genie that has complete knowledge about the link state means. We further evaluate the performance of OLSB numerically via extensive simulations, which support the theoretical findings and demonstrate its high efficiency.