When Relevance Meets Novelty: Dual-Stable Periodic Optimization for Serendipitous Recommendation

TL;DR

This paper introduces CoEA, a novel recommendation framework that combines dual-stable interest exploration and periodic optimization to enhance serendipity by balancing relevance and novelty, addressing feedback loops and static biases.

Contribution

The paper proposes the CoEA method, integrating dual-stable interest modeling with a dynamic, periodic optimization process for improved serendipitous recommendations.

Findings

Enhanced recommendation diversity and relevance.

Effective long-term interest modeling incorporating group identity.

Improved online and offline recommendation performance.

Abstract

Traditional recommendation systems tend to trap users in strong feedback loops by excessively pushing content aligned with their historical preferences, thereby limiting exploration opportunities and causing content fatigue. Although large language models (LLMs) demonstrate potential with their diverse content generation capabilities, existing LLM-enhanced dual-model frameworks face two major limitations: first, they overlook long-term preferences driven by group identity, leading to biased interest modeling; second, they suffer from static optimization flaws, as a one-time alignment process fails to leverage incremental user data for closed-loop optimization. To address these challenges, we propose the Co-Evolutionary Alignment (CoEA) method. For interest modeling bias, we introduce Dual-Stable Interest Exploration (DSIE) module, jointly modeling long-term group identity and short-term individual interests through parallel processing of behavioral sequences. For static optimization limitations, we design a Periodic Collaborative Optimization (PCO) mechanism. This mechanism regularly conducts preference verification on incremental data using the Relevance LLM, then guides the Novelty LLM to perform fine-tuning based on the verification results, and subsequently feeds back the output of the continually fine-tuned Novelty LLM to the Relevance LLM for re-evaluation, thereby achieving a dynamic closed-loop optimization. Extensive online and offline experiments verify the effectiveness of the CoEA model in serendipitous recommendation.