Deep Learning Aided Broadcast Codes with Feedback
Jacqueline Malayter, Christopher Brinton, David Love

TL;DR
This paper extends deep learning aided feedback codes to the AWGN broadcast channel, demonstrating improved performance over traditional schemes and exploring the effectiveness of RNN and MLP architectures under various conditions.
Contribution
It introduces two deep learning based broadcast coding architectures for AWGN channels and evaluates their performance in different noise regimes and training frameworks.
Findings
Deep learning codes outperform linear schemes in most cases.
Lightweight MLP-based codes excel in reliable conditions.
RNN-based codes perform better in highly unreliable scenarios.
Abstract
Deep learning aided codes have been shown to improve code performance in feedback codes in high noise regimes due to the ability to leverage non-linearity in code design. In the additive white Gaussian broadcast channel (AWGN-BC), the addition of feedback may allow the capacity region to extend far beyond the capacity region of the channel without feedback, enabling higher data rates. On the other hand, there are limited deep-learning aided implementations of broadcast codes. In this work, we extend two classes of deep-learning assisted feedback codes to the AWGN-BC channel; the first being an RNN-based architecture and the second being a lightweight MLP-based architecture. Both codes are trained using a global model, and then they are trained using a more realistic vertical federated learning based framework. We first show that in most cases, using an AWGN-BC code outperforms a…
Peer Reviews
Decision·ICLR 2025 Conference Withdrawn Submission
* The proposed models are the first fully-learnable architectures for an AWGN-broadcast channel (AWGN-BC). They show excellent performance compared with a conventional concatenated linear code. * The authors investigate a federated learning strategy for training weights in the models. In particular, they examine the effect of noise in transmitting gradients in the training process. * These issues are of importance in terms of future wireless communications.
Although the reviewer agrees with the importance of the issues, there are several flaws in this manuscript. 1. **Poor technical contributions** The contributions of this manuscript are twofold: the proposal of deep-learning architectures for AWGN-BC and the proposal of federated learning for these models. However, the proposed architectures are simple extensions of existing models for single-user cases. In short, the modifications are only learning multiple decoders and changing the loss funct
The authors consider the case of a multiuser broadcast channel with feedback. Feedback is known to improve the capacity region of the multiuser channel without feedback. Moreover, the behavior of this setup in the finite blocklength regime is not addressed in the literature. Thus, the application of machine learning in designing codes for broadcast channels with feedback seems quite reasonable and interesting.
The paper lacks some discussion related to the broadcast channel with feedback. The authors just say that «the use of feedback in the AWGN-BC channel can far exceed the capacity of the AWGN-BC channel without feedback». I think that more discussion on this topic may significantly improve the understanding of the problem and numerical results analysis. The questions that I suggest to address may be as follows: - What are existing theoretical results on capacity region? - How exactly the capacity
The main strength of the paper is to study a communication scenario that has not received much attention, particularly in terms of the application of recently developed neural network based code designs.
- The novelty of the paper is very limited. The authors mainly take two existing designs and train these models by considering multiple receivers. This is rather trivial, and as such the paper does not introduce any new concept, architecture or tool. - The federated learning (FL) approach is not well motivated or explained. Why would a vertical FL approach make sense here? As long as the channel model is available, what prevents the encoder from training all the decoders centrally? Is it a com
1. Relatively unexplored problem space. While deep learning based feedback schemes are well studied for single user AWGN channels, utility of the same for broadcast channels is not well studied and open for improvements. 2. The paper is well written overall and easy to follow for someone familiar with the problem space. 3. The concept of federated training of encoder and decoders is novel and interesting and relevant to practical settings. 4. Performance gains over existing linear schemes is
1. Limited novelty from an architecture and training perspective, as both RPC and LightCode schemes are being reused directly from existing works. 2. No system model included in the main body of the paper, making the problem setup hard to grasp. 3. Throughout the paper, there was the mention of LightCode being simpler than RPC. But there is not study on the complaexity, memory, and run-time comparison between the schemes makaing it harder to understand the difference between the schemes in ter
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAdvanced Data Compression Techniques · Speech and Audio Processing
