WiMamba: Linear-Scale Wireless Foundation Model
Tomer Raviv, Nir Shlezinger

TL;DR
WiMamba introduces a scalable, low-latency wireless foundation model using state-space architectures, outperforming transformer-based models in efficiency while maintaining strong performance across tasks.
Contribution
The paper presents WiMamba, a novel wireless foundation model based on state-space architectures that reduces complexity and improves scalability compared to transformer-based models.
Findings
WiMamba achieves linear-time sequence modeling.
It matches or outperforms transformer-based models on multiple tasks.
It offers significant latency and memory savings.
Abstract
Foundation models learn transferable representations, motivating growing interest in their application to wireless systems. Existing wireless foundation models are predominantly based on transformer architectures, whose quadratic computational and memory complexity can hinder practical deployment for large-scale channels. In this work, we introduce WiMamba, a wireless foundation model built upon the recently proposed Mamba architecture, which replaces attention mechanisms with selective state-space models and enables linear-time sequence modeling. Leveraging this architectural advantage combined with adaptive preprocessing, WiMamba achieves scalable and low-latency inference while maintaining strong representational expressivity. We further develop a dedicated task-agnostic, self-supervised pre-training framework tailored to wireless channels, resulting in a genuine foundation model…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
