A Generalised Differential Framework for Measuring Signal Sparsity

TL;DR

This paper introduces a flexible and general framework called GDS for creating new sparsity metrics based on differences among signal coefficients, proving its effectiveness and superiority over existing metrics like the Gini Index.

Contribution

The paper presents the GDS framework that generalizes existing sparsity metrics, ensuring they meet key criteria and demonstrating its advantages through theoretical proofs and empirical tests.

Findings

GDS encompasses the Gini Index as a special case.

GDS-based algorithms require fewer dimensions for accurate signal reconstruction.

GDS improves sparsity measurement accuracy and flexibility.

Abstract

The notion of signal sparsity has been gaining increasing interest in information theory and signal processing communities. As a consequence, a plethora of sparsity metrics has been presented in the literature. The appropriateness of these metrics is typically evaluated against a set of objective criteria that has been proposed for assessing the credibility of any sparsity metric. In this paper, we propose a Generalised Differential Sparsity (GDS) framework for generating novel sparsity metrics whose functionality is based on the concept that sparsity is encoded in the differences among the signal coefficients. We rigorously prove that every metric generated using GDS satisfies all the aforementioned criteria and we provide a computationally efficient formula that makes GDS suitable for high-dimensional signals. The great advantage of GDS is its flexibility to offer sparsity metrics that can be well-tailored to certain requirements stemming from the nature of the data and the problem to be solved. This is in contrast to current state-of-the-art sparsity metrics like Gini Index (GI), which is actually proven to be only a specific instance of GDS, demonstrating the generalisation power of our framework. In verifying our claims, we have incorporated GDS in a stochastic signal recovery algorithm and experimentally investigated its efficacy in reconstructing randomly projected sparse signals. As a result, it is proven that GDS, in comparison to GI, both loosens the bounds of the assumed sparsity of the original signals and reduces the minimum number of projected dimensions, required to guarantee an almost perfect reconstruction of heavily compressed signals. The superiority of GDS over GI in conjunction with the fact that the latter is considered as a standard in numerous scientific domains, prove the great potential of GDS as a general purpose framework for measuring sparsity.