A Survey of Personalized Federated Foundation Models for Privacy-Preserving Recommendation

TL;DR

This survey reviews recent advances in integrating foundation models with federated learning to enable personalized, privacy-preserving recommendation systems, emphasizing architectural challenges and solutions.

Contribution

It provides a comprehensive overview of personalization techniques and foundation model adaptations within federated architectures for privacy-preserving recommendations.

Findings

Analyzes effective personalization techniques under federated settings.

Discusses adaptation strategies of foundation models for federated architectures.

Highlights the balance between global knowledge and user-specific privacy needs.

Abstract

Integrating Foundation Models (FMs) into recommendation systems is an emerging and promising research direction. However, centralized paradigms face growing pressure from privacy concerns and strict regulatory requirements. Federated learning offers a viable solution that enables collaborative model refinement while keeping raw user data on local devices or organizational silos. Yet, applying FMs in this setting creates a fundamental tension, where the system must balance the leverage of global knowledge with the necessity of capturing user personality. This survey provides a comprehensive overview of Personalized Federated Foundation Models for privacy-preserving recommendation, and reviews recent progress in this emerging field. We first analyze personalization techniques that function effectively under federated settings. Furthermore, we discuss the adaptation of foundation models to such federated architectures to balance generalization with user-specific needs for achieving privacy-preserving recommendation. In contrast to existing reviews, our work specifically emphasizes the architectural intersection of federation, personalization, and foundation models. \looseness=-1