Large Language Model with Graph Convolution for Recommendation

TL;DR

This paper introduces a graph-aware convolutional approach using large language models to improve user and item descriptions in recommendation systems by capturing high-order relations in user-item graphs.

Contribution

It proposes a novel method that integrates LLMs with graph convolution to utilize structured graph information for better recommendation descriptions.

Findings

Outperforms state-of-the-art methods on three real-world datasets

Effectively captures high-order relations in user-item graphs

Reduces context length by breaking down description tasks

Abstract

In recent years, efforts have been made to use text information for better user profiling and item characterization in recommendations. However, text information can sometimes be of low quality, hindering its effectiveness for real-world applications. With knowledge and reasoning capabilities capsuled in Large Language Models (LLMs), utilizing LLMs emerges as a promising way for description improvement. However, existing ways of prompting LLMs with raw texts ignore structured knowledge of user-item interactions, which may lead to hallucination problems like inconsistent description generation. To this end, we propose a Graph-aware Convolutional LLM method to elicit LLMs to capture high-order relations in the user-item graph. To adapt text-based LLMs with structured graphs, We use the LLM as an aggregator in graph processing, allowing it to understand graph-based information step by step. Specifically, the LLM is required for description enhancement by exploring multi-hop neighbors layer by layer, thereby propagating information progressively in the graph. To enable LLMs to capture large-scale graph information, we break down the description task into smaller parts, which drastically reduces the context length of the token input with each step. Extensive experiments on three real-world datasets show that our method consistently outperforms state-of-the-art methods.