DRDT: Dynamic Reflection with Divergent Thinking for LLM-based Sequential Recommendation

TL;DR

This paper introduces DRDT, a novel reasoning approach using dynamic reflection and divergent thinking within a retriever-reranker framework, significantly improving LLM-based sequential recommendation without fine-tuning.

Contribution

It presents a new reasoning principle, Dynamic Reflection with Divergent Thinking, tailored for sequential recommendation, leveraging user feedback and high-level preferences.

Findings

Outperforms GPT-3.5 on three datasets with 7b models.

Effective without fine-tuning LLMs.

Demonstrates the potential of tailored reasoning strategies for recommendation tasks.

Abstract

The rise of Large Language Models (LLMs) has sparked interest in their application to sequential recommendation tasks as they can provide supportive item information. However, due to the inherent complexities of sequential recommendation, such as sequential patterns across datasets, noise within sequences, and the temporal evolution of user preferences, existing LLM reasoning strategies, such as in-context learning and chain-of-thought are not fully effective. To address these challenges, we introduce a novel reasoning principle: Dynamic Reflection with Divergent Thinking within a retriever-reranker framework. Our approach starts with a collaborative in-context demonstration retriever, which collects sequences exhibiting collaborative behaviors as in-context examples. Following this, we abstract high-level user preferences across multiple aspects, providing a more nuanced understanding of user interests and circumventing the noise within the raw sequences. The cornerstone of our methodology is dynamic reflection, a process that emulates human learning through probing, critiquing, and reflecting, using user feedback to tailor the analysis more effectively to the target user in a temporal manner. We evaluate our approach on three datasets using six pre-trained LLMs. The superior performance observed across these models demonstrates the efficacy of our reasoning strategy, notably achieved without the need to fine-tune the LLMs. With our principle, we managed to outperform GPT-Turbo-3.5 on three datasets using 7b models e.g., Vicuna-7b and Openchat-7b on NDCG@10. This research not only highlights the potential of LLMs in enhancing sequential recommendation systems but also underscores the importance of developing tailored reasoning strategies to fully harness their capabilities.