Learning Multi-Aspect Item Palette: A Semantic Tokenization Framework for Generative Recommendation

TL;DR

This paper introduces LAMIA, a novel multi-aspect semantic tokenization framework that improves generative recommendation models by learning an item palette of embeddings, addressing limitations of previous methods like RQ-VAE.

Contribution

LAMIA proposes a new item palette-based semantic tokenization approach that captures multiple item aspects and enhances encoder representations, outperforming existing methods.

Findings

Significant improvement in recommendation accuracy.

Effective multi-aspect semantic representation.

Enhanced training stability and embedding extraction.

Abstract

Traditional recommendation models often rely on unique item identifiers (IDs) to distinguish between items, which can hinder their ability to effectively leverage item content information and generalize to long-tailed or cold-start items. Recently, semantic tokenization has been proposed as a promising solution that aims to tokenize each item's semantic representation into a sequence of discrete tokens. These semantic tokens have become fundamental in training generative recommendation models. However, existing methods typically rely on RQ-VAE, a residual vector quantizer, for semantic tokenization. This reliance introduces several key limitations, including challenges in embedding extraction, hierarchical coarse-to-fine quantization, and training stability. To address these issues, we introduce LAMIA, a novel approach for multi-aspect semantic tokenization. Unlike RQ-VAE, which uses a single embedding, LAMIA learns an ``item palette''--a collection of independent and semantically parallel embeddings that capture multiple aspects of items. Additionally, LAMIA enhances the semantic encoders through domain-specific tuning using text-based reconstruction tasks, resulting in more representative item palette embeddings. We have conducted extensive experiments to validate the effectiveness of the LAMIA framework across various recommendation tasks and datasets. Our results demonstrate significant improvements in recommendation accuracy over existing methods. To facilitate reproducible research, we will release the source code, data, and configurations.