Posterior Matching over Binary-Input Memoryless Symmetric Channels: Non-Asymptotic Bounds and Low-Complexity Encoding

TL;DR

This paper develops a non-asymptotic analysis and a low-complexity encoding scheme for variable-length feedback codes over a broad class of binary-input memoryless symmetric channels, including continuous-output channels.

Contribution

It extends posterior matching analysis to continuous-output channels and proposes a polynomial-complexity encoder with explicit performance bounds.

Findings

Derived a non-asymptotic achievability bound with explicit channel parameter dependence.

Proposed a low-complexity encoder enforcing SED partition with polynomial complexity.

Quantization introduces a capacity loss of O(log B / B^2) for B-level quantizers.

Abstract

We study variable-length feedback (VLF) codes over binary-input memoryless symmetric (BMS) channels using posterior matching with small-enough-difference (SED) partitioning. Prior analyses of SED-based schemes rely on bounded log-likelihood ratio (LLR) increments, restricting their scope to discrete-output channels such as the binary symmetric channel (BSC). We remove this restriction and provide an analysis of posterior matching that covers a broad class of BMS channels, including continuous-output channels such as the binary-input AWGN channel. We derive a novel non-asymptotic achievability bound on the expected decoding time that decomposes into communication, confirmation, and recovery terms with explicit dependence on the channel capacity~$C$, the KL divergence~$C_1$, and the Bhattacharyya parameter of the channel. The proof develops new stopping-time and overshoot bounds for submartingales and random walks with unbounded increments, drawing on tools from renewal theory. On the algorithmic side, we propose a low-complexity encoder that enforces the exact SED partition at every step by grouping messages according to their log-likelihood ratios that are assumed to land on a lattice, and applying a batched correction step that restores the partition balance. The resulting encoder complexity is polynomial in the number of transmitted bits. For continuous-output channels, the lattice structure is enforced through output quantization satisfying an exact induced-lattice constraint; the associated capacity loss is $O(\log B / B^2)$ for a $B$-level quantizer. These results yield a VLF coding scheme for BMS channels that simultaneously achieves strong non-asymptotic performance and practical encoder complexity.