Superlinear lower bounds for multipass graph processing

TL;DR

This paper establishes superlinear space lower bounds for multipass streaming algorithms solving fundamental graph problems, using communication complexity techniques and novel information cost bounds.

Contribution

It introduces new superlinear lower bounds for p-pass streaming algorithms on key graph problems, advancing understanding of space complexity in streaming models.

Findings

Proves lower bounds of n^{1+Ω(1/p)}/p^{O(1)} for multiple graph problems

Develops a communication complexity lower bound for a graph distance intersection game

Establishes an information cost lower bound for a decision pointer chasing problem

Abstract

We prove $n^{1+\Omega(1/p)}/p^{O(1)}$ lower bounds for the space complexity of $p$-pass streaming algorithms solving the following problems on $n$-vertex graphs: * testing if an undirected graph has a perfect matching (this implies lower bounds for computing a maximum matching or even just the maximum matching size), * testing if two specific vertices are at distance at most $2(p+1)$ in an undirected graph, * testing if there is a directed path from $s$ to $t$ for two specific vertices $s$ and $t$ in a directed graph. Prior to our result, it was known that these problems require $\Omega(n^2)$ space in one pass, but no $n^{1+\Omega(1)}$ lower bound was known for any $p\ge 2$. These streaming results follow from a communication complexity lower bound for a communication game in which the players hold two graphs on the same set of vertices. The task of the players is to find out whether the sets of vertices at distance exactly $p+1$ from a specific vertex intersect. The game requires a significant amount of communication only if the players are forced to speak in a specific difficult order. This is reminiscent of lower bounds for communication problems such as indexing and pointer chasing. Among other things, our line of attack requires proving an information cost lower bound for a decision version of the classic pointer chasing problem and a direct sum type theorem for the disjunction of several instances of this problem.