Large Wireless Model (LWM): A Foundation Model for Wireless Channels

TL;DR

The paper introduces Large Wireless Model (LWM), a transformer-based foundation model for wireless channels that generates universal embeddings to improve diverse wireless communication and sensing tasks, especially with limited data.

Contribution

LWM is the first task-agnostic foundation model for wireless channels, pre-trained on large datasets to produce rich, contextualized embeddings for various downstream applications.

Findings

LWM improves performance in downstream wireless tasks.

LWM's embeddings outperform raw channel representations.

LWM enables efficient adaptation with limited data.

Abstract

This paper presents Large Wireless Model (LWM) -- the world's first foundation model for wireless channels. Designed as a task-agnostic model, LWM generates universal, rich, contextualized channel embeddings (features) that potentially enhance performance across a wide range of downstream tasks in wireless communication and sensing systems. Towards this objective, LWM, which has a transformer-based architecture, was pre-trained in a self-supervised manner on large-scale wireless channel datasets. Our results show consistent improvements in downstream tasks when using the LWM embeddings compared to raw channel representations, especially in scenarios with high-complexity machine learning tasks and limited training datasets. This LWM's ability to learn from large-scale wireless data opens a promising direction for intelligent systems that can efficiently adapt to diverse tasks with limited data, paving the way for addressing key challenges in wireless communication and sensing systems.