TransCoder: A Neural-Enhancement Framework for Channel Codes

TL;DR

TransCoder is a neural-enhanced framework using transformer architecture to improve the reliability of traditional error-correcting codes in noisy communication channels, especially effective for longer codes and low code rates.

Contribution

It introduces a flexible neural module that enhances existing ECCs through iterative decoding with attention mechanisms, achieving improved performance with manageable complexity.

Findings

Significantly reduces block error rate across various codes and channel conditions.

Maintains computational complexity comparable to traditional decoders.

Particularly effective for longer codes and low code rates.

Abstract

Reliable communication over noisy channels requires the design of specialized error-correcting codes (ECCs) tailored to specific system requirements. Recently, neural network-based decoders have emerged as promising tools for enhancing ECC reliability, yet their high computational complexity prevents their potential practical deployment. In this paper, we take a different approach and design a neural transmission scheme that employs the transformer architecture in order to improve the reliability of existing ECCs. We call this approach TransCoder, alluding both to its function and architecture. TransCoder operates as a code-adaptive neural module aimed at performance enhancement that can be implemented flexibly at either the transmitter, receiver, or both. The framework employs an iterative decoding procedure, where both noisy information from the channel and updates from the conventional ECC decoder are processed by a neural decoder block, utilizing a block attention mechanism for efficiency. Through extensive simulations with various conventional codes (LDPC, BCH, Polar, and Turbo) and across a wide range of channel conditions, we demonstrate that TransCoder significantly improves block error rate (BLER) performance while maintaining computational complexity comparable to traditional decoders. Notably, our approach is particularly effective for longer codes (block length >64) and at lower code rates, scenarios in which existing neural decoders often struggle (despite their formidable computational complexity). The results establish TransCoder as a promising practical solution for reliable communication among resource-constrained wireless devices.