WirelessGPT: A Generative Pre-trained Multi-task Learning Framework for Wireless Communication

TL;DR

WirelessGPT is a large-scale, multi-task foundation model for wireless communication and sensing, enabling unified, efficient, and scalable solutions with minimal fine-tuning and significant performance improvements.

Contribution

It introduces WirelessGPT, the first foundation model for multi-task wireless communication and sensing, unifying functionalities and reducing dependence on labeled data.

Findings

Demonstrates significant performance improvements over traditional methods.

Supports diverse wireless tasks with minimal fine-tuning.

Establishes a new benchmark for multi-task wireless models.

Abstract

This paper introduces WirelessGPT, a pioneering foundation model specifically designed for multi-task learning in wireless communication and sensing. Specifically, WirelessGPT leverages large-scale wireless channel datasets for unsupervised pretraining and extracting universal channel representations, which captures complex spatiotemporal dependencies. In fact,this task-agnostic design adapts WirelessGPT seamlessly to a wide range of downstream tasks, using a unified representation with minimal fine-tuning. By unifying communication and sensing functionalities, WirelessGPT addresses the limitations of task-specific models, offering a scalable and efficient solution for integrated sensing and communication (ISAC). With an initial parameter size of around 80 million, WirelessGPT demonstrates significant improvements over conventional methods and smaller AI models, reducing reliance on large-scale labeled data. As the first foundation model capable of supporting diverse tasks across different domains, WirelessGPT establishes a new benchmark, paving the way for future advancements in multi-task wireless systems.