Towards Automatic Sampling of User Behaviors for Sequential Recommender Systems

TL;DR

AutoSAM introduces an automatic, reinforcement learning-based sampling framework for sequential recommender systems, improving their ability to select informative user behaviors and enhance recommendation accuracy.

Contribution

The paper proposes AutoSAM, a novel reinforcement learning-based sampling method that non-uniformly selects user behaviors to improve sequential recommendation performance.

Findings

AutoSAM outperforms baseline models on benchmark datasets.

The reinforcement learning approach effectively guides sampling decisions.

The framework improves recommendation accuracy and generalizability.

Abstract

Sequential recommender systems (SRS) have gained increasing popularity due to their remarkable proficiency in capturing dynamic user preferences. In the current setup of SRS, a common configuration is to uniformly consider each historical behavior as a positive interaction. However, this setting has the potential to yield sub-optimal performance as each individual item often have a different impact on shaping the user's interests. Hence, in this paper, we propose a novel automatic sampling framework for sequential recommendation, named AutoSAM, to non-uniformly treat historical behaviors. Specifically, AutoSAM extends the conventional SRS framework by integrating an extra sampler to intelligently discern the skew distribution of the raw input, and then sample informative sub-sets to build more generalizable SRS. To tackle the challenges posed by non differentiable sampling actions and to introduce multiple decision factors for sampling, we further design a novel reinforcement learning based method to guide the training of the sampler. Furthermore, we theoretically devise multi-objective sampling rewards including \textit{Future Prediction} and \textit{Sequence Perplexity}, and then optimize the whole framework in an end-to-end manner by combining the policy gradient. We conduct extensive experiments on benchmark recommendation models and four real-world datasets. The experimental results demonstrate the effectiveness of the proposed AutoSAM.