LightCode: Light Analytical and Neural Codes for Channels with Feedback

TL;DR

This paper introduces LightCode, a low-complexity, interpretable neural code for feedback channels that outperforms existing schemes in reliability, especially in low-SNR regions, by combining analytical and neural approaches.

Contribution

It presents PowerBlast, an analytical code inspired by classical schemes, and LightCode, a lightweight neural code, advancing reliable communication with interpretability and reduced computational costs.

Findings

PowerBlast outperforms SK and GN schemes at high SNR.

LightCode achieves state-of-the-art reliability in low-SNR regions.

Analysis links LightCode to PowerBlast, highlighting performance-critical components.

Abstract

The design of reliable and efficient codes for channels with feedback remains a longstanding challenge in communication theory. While significant improvements have been achieved by leveraging deep learning techniques, neural codes often suffer from high computational costs, a lack of interpretability, and limited practicality in resource-constrained settings. We focus on designing low-complexity coding schemes that are interpretable and more suitable for communication systems. We advance both analytical and neural codes. First, we demonstrate that PowerBlast, an analytical coding scheme inspired by Schalkwijk-Kailath (SK) and Gallager-Nakibo\u{g}lu (GN) schemes, achieves notable reliability improvements over both SK and GN schemes, outperforming neural codes in high signal-to-noise ratio (SNR) regions. Next, to enhance reliability in low-SNR regions, we propose LightCode, a lightweight neural code that achieves state-of-the-art reliability while using a fraction of memory and compute compared to existing deeplearning-based codes. Finally, we systematically analyze the learned codes, establishing connections between LightCode and PowerBlast, identifying components crucial for performance, and providing interpretation aided by linear regression analysis.