Meta-Learning for Cold-Start Personalization in Prompt-Tuned LLMs

TL;DR

This paper presents a meta-learning approach for prompt-tuning large language models to enable quick, personalized recommendations in cold-start scenarios, supporting real-time adaptation with minimal data and computational resources.

Contribution

It introduces a novel meta-learning framework using prompt-tuning with first- and second-order optimization for efficient user personalization in LLM-based recommender systems.

Findings

Outperforms baseline models on MovieLens-1M, Amazon Reviews, and Recbole datasets.

Achieves real-time personalization in under 300 ms on consumer GPUs.

Supports zero-history personalization, enabling rapid risk profiling in financial systems.

Abstract

Generative, explainable, and flexible recommender systems, derived using Large Language Models (LLM) are promising and poorly adapted to the cold-start user situation, where there is little to no history of interaction. The current solutions i.e. supervised fine-tuning and collaborative filtering are dense-user-item focused and would be expensive to maintain and update. This paper introduces a meta-learning framework, that can be used to perform parameter-efficient prompt-tuning, to effectively personalize LLM-based recommender systems quickly at cold-start. The model learns soft prompt embeddings with first-order (Reptile) and second-order (MAML) optimization by treating each of the users as the tasks. As augmentations to the input tokens, these learnable vectors are the differentiable control variables that represent user behavioral priors. The prompts are meta-optimized through episodic sampling, inner-loop adaptation, and outer-loop generalization. On MovieLens-1M, Amazon Reviews, and Recbole, we can see that our adaptive model outperforms strong baselines in NDCG@10, HR@10, and MRR, and it runs in real-time (i.e., below 300 ms) on consumer GPUs. Zero-history personalization is also supported by this scalable solution, and its 275 ms rate of adaptation allows successful real-time risk profiling of financial systems by shortening detection latency and improving payment network stability. Crucially, the 275 ms adaptation capability can enable real-time risk profiling for financial institutions, reducing systemic vulnerability detection latency significantly versus traditional compliance checks. By preventing contagion in payment networks (e.g., Fedwire), the framework strengthens national financial infrastructure resilience.