On the Fundamental Limits of Recovering Tree Sparse Vectors from Noisy Linear Measurements

TL;DR

This paper establishes fundamental limits for support recovery of tree-sparse signals from noisy linear measurements, demonstrating that adaptive sensing strategies are nearly optimal compared to any other approach.

Contribution

It provides the first theoretical performance bounds for support recovery of tree-sparse signals, showing the near-optimality of adaptive sensing strategies.

Findings

Adaptive tree sensing is nearly optimal for support recovery.

Fundamental limits are established for non-adaptive and adaptive measurements.

Support recovery performance depends on measurement strategy and signal structure.

Abstract

Recent breakthrough results in compressive sensing (CS) have established that many high dimensional signals can be accurately recovered from a relatively small number of non-adaptive linear observations, provided that the signals possess a sparse representation in some basis. Subsequent efforts have shown that the performance of CS can be improved by exploiting additional structure in the locations of the nonzero signal coefficients during inference, or by utilizing some form of data-dependent adaptive measurement focusing during the sensing process. To our knowledge, our own previous work was the first to establish the potential benefits that can be achieved when fusing the notions of adaptive sensing and structured sparsity -- that work examined the task of support recovery from noisy linear measurements, and established that an adaptive sensing strategy specifically tailored to signals that are tree-sparse can significantly outperform adaptive and non-adaptive sensing strategies that are agnostic to the underlying structure. In this work we establish fundamental performance limits for the task of support recovery of tree-sparse signals from noisy measurements, in settings where measurements may be obtained either non-adaptively (using a randomized Gaussian measurement strategy motivated by initial CS investigations) or by any adaptive sensing strategy. Our main results here imply that the adaptive tree sensing procedure analyzed in our previous work is nearly optimal, in the sense that no other sensing and estimation strategy can perform fundamentally better for identifying the support of tree-sparse signals.