Inferring Hidden Structures in Random Graphs

TL;DR

This paper investigates the fundamental limits and algorithms for detecting and recovering hidden structured communities in random graphs, highlighting a phase transition where computational constraints impact statistical performance.

Contribution

It derives lower bounds and develops algorithms for detecting and recovering planted structures, revealing an 'easy-hard-impossible' phase transition influenced by computational constraints.

Findings

Lower bounds for detection and recovery in terms of graph parameters.

Algorithms matching the lower bounds for detection and recovery.

Evidence of a phase transition influenced by computational complexity.

Abstract

We study the two inference problems of detecting and recovering an isolated community of \emph{general} structure planted in a random graph. The detection problem is formalized as a hypothesis testing problem, where under the null hypothesis, the graph is a realization of an Erd\H{o}s-R\'{e}nyi random graph $\mathcal{G}(n,q)$ with edge density $q\in(0,1)$; under the alternative, there is an unknown structure $\Gamma_k$ on $k$ nodes, planted in $\mathcal{G}(n,q)$, such that it appears as an \emph{induced subgraph}. In case of a successful detection, we are concerned with the task of recovering the corresponding structure. For these problems, we investigate the fundamental limits from both the statistical and computational perspectives. Specifically, we derive lower bounds for detecting/recovering the structure $\Gamma_k$ in terms of the parameters $(n,k,q)$, as well as certain properties of $\Gamma_k$, and exhibit computationally unbounded optimal algorithms that achieve these lower bounds. We also consider the problem of testing in polynomial-time. As is customary in many similar structured high-dimensional problems, our model undergoes an "easy-hard-impossible" phase transition and computational constraints can severely penalize the statistical performance. To provide an evidence for this phenomenon, we show that the class of low-degree polynomials algorithms match the statistical performance of the polynomial-time algorithms we develop.