Second-Order and Moderate Deviation Asymptotics for Successive Refinement

TL;DR

This paper establishes the optimal second-order coding region and moderate deviations constant for successive refinement source coding, covering both discrete and Gaussian sources, with new insights into the second-order behavior and transition phenomena.

Contribution

It derives the second-order coding region and moderate deviations constant for successive refinement source coding with a joint excess-distortion probability constraint, including new insights and simplified expressions for successively refinable sources.

Findings

Derived the optimal second-order coding region for DMS and GMS.

Identified a transition from bivariate to univariate Gaussian characterization.

Provided new bounds and insights for successively refinable sources.

Abstract

We derive the optimal second-order coding region and moderate deviations constant for successive refinement source coding with a joint excess-distortion probability constraint. We consider two scenarios: (i) a discrete memoryless source (DMS) and arbitrary distortion measures at the decoders and (ii) a Gaussian memoryless source (GMS) and quadratic distortion measures at the decoders. For a DMS with arbitrary distortion measures, we prove an achievable second-order coding region, using type covering lemmas by Kanlis and Narayan and by No, Ingber and Weissman. We prove the converse using the perturbation approach by Gu and Effros. When the DMS is successively refinable, the expressions for the second-order coding region and the moderate deviations constant are simplified and easily computable. For this case, we also obtain new insights on the second-order behavior compared to the scenario where separate excess-distortion proabilities are considered. For example, we describe a DMS, for which the optimal second-order region transitions from being characterizable by a bivariate Gaussian to a univariate Gaussian, as the distortion levels are varied. We then consider a GMS with quadratic distortion measures. To prove the direct part, we make use of the sphere covering theorem by Verger-Gaugry, together with appropriately-defined Gaussian type classes. To prove the converse, we generalize Kostina and Verd\'u's one-shot converse bound for point-to-point lossy source coding. We remark that this proof is applicable to general successively refinable sources. In the proofs of the moderate deviations results for both scenarios, we follow a strategy similar to that for the second-order asymptotics and use the moderate deviations principle.