Large Language Model Enhanced Graph Invariant Contrastive Learning for Out-of-Distribution Recommendation

TL;DR

This paper introduces InvGCLLM, a novel framework that combines invariant graph contrastive learning with large language models to improve out-of-distribution recommendation by refining graph structures and learning more robust representations.

Contribution

It proposes a new causal learning framework integrating LLMs with invariant graph contrastive learning for OOD recommendation, addressing spurious correlations.

Findings

Significant OOD recommendation performance improvements

Outperforms state-of-the-art baselines on four datasets

Effective graph refinement guided by LLMs

Abstract

Out-of-distribution (OOD) generalization has emerged as a significant challenge in graph recommender systems. Traditional graph neural network algorithms often fail because they learn spurious environmental correlations instead of stable causal relationships, leading to substantial performance degradation under distribution shifts. While recent advancements in Large Language Models (LLMs) offer a promising avenue due to their vast world knowledge and reasoning capabilities, effectively integrating this knowledge with the fine-grained topology of specific graphs to solve the OOD problem remains a significant challenge. To address these issues, we propose {$\textbf{Inv}$ariant $\textbf{G}$raph $\textbf{C}$ontrastive Learning with $\textbf{LLM}$s for Out-of-Distribution Recommendation (InvGCLLM)}, an innovative causal learning framework that synergistically integrates the strengths of data-driven models and knowledge-driven LLMs. Our framework first employs a data-driven invariant learning model to generate causal confidence scores for each user-item interaction. These scores then guide an LLM to perform targeted graph refinement, leveraging its world knowledge to prune spurious connections and augment missing causal links. Finally, the structurally purified graphs provide robust supervision for a causality-guided contrastive learning objective, enabling the model to learn representations that are resilient to spurious correlations. Experiments conducted on four public datasets demonstrate that InvGCLLM achieves significant improvements in out-of-distribution recommendation, consistently outperforming state-of-the-art baselines.